00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 1005 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3672 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.097 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.097 The recommended git tool is: git 00:00:00.097 using credential 00000000-0000-0000-0000-000000000002 00:00:00.124 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.144 Fetching changes from the remote Git repository 00:00:00.146 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.173 Using shallow fetch with depth 1 00:00:00.173 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.173 > git --version # timeout=10 00:00:00.198 > git --version # 'git version 2.39.2' 00:00:00.198 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.213 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.213 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.573 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.586 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.599 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.599 > git config core.sparsecheckout # timeout=10 00:00:05.611 > git read-tree -mu HEAD # timeout=10 00:00:05.626 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.648 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.648 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.729 [Pipeline] Start of Pipeline 00:00:05.741 [Pipeline] library 00:00:05.742 Loading library shm_lib@master 00:00:05.742 Library shm_lib@master is cached. Copying from home. 00:00:05.765 [Pipeline] node 00:00:05.774 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.776 [Pipeline] { 00:00:05.789 [Pipeline] catchError 00:00:05.791 [Pipeline] { 00:00:05.805 [Pipeline] wrap 00:00:05.814 [Pipeline] { 00:00:05.821 [Pipeline] stage 00:00:05.823 [Pipeline] { (Prologue) 00:00:06.024 [Pipeline] sh 00:00:06.312 + logger -p user.info -t JENKINS-CI 00:00:06.333 [Pipeline] echo 00:00:06.335 Node: GP11 00:00:06.342 [Pipeline] sh 00:00:06.648 [Pipeline] setCustomBuildProperty 00:00:06.659 [Pipeline] echo 00:00:06.661 Cleanup processes 00:00:06.666 [Pipeline] sh 00:00:06.949 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.949 1530872 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.963 [Pipeline] sh 00:00:07.247 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.247 ++ grep -v 'sudo pgrep' 00:00:07.247 ++ awk '{print $1}' 00:00:07.247 + sudo kill -9 00:00:07.247 + true 00:00:07.261 [Pipeline] cleanWs 00:00:07.271 [WS-CLEANUP] Deleting project workspace... 00:00:07.271 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.279 [WS-CLEANUP] done 00:00:07.284 [Pipeline] setCustomBuildProperty 00:00:07.298 [Pipeline] sh 00:00:07.579 + sudo git config --global --replace-all safe.directory '*' 00:00:07.681 [Pipeline] httpRequest 00:00:08.186 [Pipeline] echo 00:00:08.188 Sorcerer 10.211.164.101 is alive 00:00:08.198 [Pipeline] retry 00:00:08.201 [Pipeline] { 00:00:08.217 [Pipeline] httpRequest 00:00:08.222 HttpMethod: GET 00:00:08.223 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.223 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.247 Response Code: HTTP/1.1 200 OK 00:00:08.248 Success: Status code 200 is in the accepted range: 200,404 00:00:08.248 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:14.950 [Pipeline] } 00:00:14.967 [Pipeline] // retry 00:00:14.975 [Pipeline] sh 00:00:15.261 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:15.277 [Pipeline] httpRequest 00:00:16.854 [Pipeline] echo 00:00:16.856 Sorcerer 10.211.164.101 is alive 00:00:16.866 [Pipeline] retry 00:00:16.868 [Pipeline] { 00:00:16.883 [Pipeline] httpRequest 00:00:16.887 HttpMethod: GET 00:00:16.888 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.888 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.900 Response Code: HTTP/1.1 200 OK 00:00:16.900 Success: Status code 200 is in the accepted range: 200,404 00:00:16.901 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:28.797 [Pipeline] } 00:01:28.815 [Pipeline] // retry 00:01:28.823 [Pipeline] sh 00:01:29.111 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:31.696 [Pipeline] sh 00:01:31.980 + git -C spdk log --oneline -n5 00:01:31.980 c13c99a5e test: Various fixes for Fedora40 00:01:31.980 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:31.980 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:31.980 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:31.980 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:31.999 [Pipeline] withCredentials 00:01:32.010 > git --version # timeout=10 00:01:32.024 > git --version # 'git version 2.39.2' 00:01:32.042 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:32.045 [Pipeline] { 00:01:32.054 [Pipeline] retry 00:01:32.057 [Pipeline] { 00:01:32.073 [Pipeline] sh 00:01:32.357 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:32.625 [Pipeline] } 00:01:32.640 [Pipeline] // retry 00:01:32.645 [Pipeline] } 00:01:32.660 [Pipeline] // withCredentials 00:01:32.668 [Pipeline] httpRequest 00:01:33.496 [Pipeline] echo 00:01:33.498 Sorcerer 10.211.164.101 is alive 00:01:33.508 [Pipeline] retry 00:01:33.511 [Pipeline] { 00:01:33.525 [Pipeline] httpRequest 00:01:33.530 HttpMethod: GET 00:01:33.531 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:33.532 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:33.536 Response Code: HTTP/1.1 200 OK 00:01:33.536 Success: Status code 200 is in the accepted range: 200,404 00:01:33.537 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:37.620 [Pipeline] } 00:01:37.635 [Pipeline] // retry 00:01:37.641 [Pipeline] sh 00:01:37.923 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:39.311 [Pipeline] sh 00:01:39.594 + git -C dpdk log --oneline -n5 00:01:39.594 caf0f5d395 version: 22.11.4 00:01:39.594 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:39.594 dc9c799c7d vhost: fix missing spinlock unlock 00:01:39.594 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:39.594 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:39.604 [Pipeline] } 00:01:39.617 [Pipeline] // stage 00:01:39.627 [Pipeline] stage 00:01:39.629 [Pipeline] { (Prepare) 00:01:39.649 [Pipeline] writeFile 00:01:39.665 [Pipeline] sh 00:01:39.944 + logger -p user.info -t JENKINS-CI 00:01:39.956 [Pipeline] sh 00:01:40.236 + logger -p user.info -t JENKINS-CI 00:01:40.247 [Pipeline] sh 00:01:40.528 + cat autorun-spdk.conf 00:01:40.528 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:40.528 SPDK_TEST_NVMF=1 00:01:40.528 SPDK_TEST_NVME_CLI=1 00:01:40.528 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:40.528 SPDK_TEST_NVMF_NICS=e810 00:01:40.528 SPDK_TEST_VFIOUSER=1 00:01:40.528 SPDK_RUN_UBSAN=1 00:01:40.528 NET_TYPE=phy 00:01:40.528 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:40.528 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:40.534 RUN_NIGHTLY=1 00:01:40.539 [Pipeline] readFile 00:01:40.563 [Pipeline] withEnv 00:01:40.565 [Pipeline] { 00:01:40.578 [Pipeline] sh 00:01:40.859 + set -ex 00:01:40.859 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:40.859 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:40.859 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:40.859 ++ SPDK_TEST_NVMF=1 00:01:40.859 ++ SPDK_TEST_NVME_CLI=1 00:01:40.859 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:40.859 ++ SPDK_TEST_NVMF_NICS=e810 00:01:40.859 ++ SPDK_TEST_VFIOUSER=1 00:01:40.859 ++ SPDK_RUN_UBSAN=1 00:01:40.859 ++ NET_TYPE=phy 00:01:40.859 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:40.859 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:40.859 ++ RUN_NIGHTLY=1 00:01:40.859 + case $SPDK_TEST_NVMF_NICS in 00:01:40.859 + DRIVERS=ice 00:01:40.859 + [[ tcp == \r\d\m\a ]] 00:01:40.859 + [[ -n ice ]] 00:01:40.859 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:40.859 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:40.859 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:40.859 rmmod: ERROR: Module irdma is not currently loaded 00:01:40.859 rmmod: ERROR: Module i40iw is not currently loaded 00:01:40.859 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:40.859 + true 00:01:40.859 + for D in $DRIVERS 00:01:40.859 + sudo modprobe ice 00:01:40.859 + exit 0 00:01:40.868 [Pipeline] } 00:01:40.882 [Pipeline] // withEnv 00:01:40.888 [Pipeline] } 00:01:40.901 [Pipeline] // stage 00:01:40.911 [Pipeline] catchError 00:01:40.913 [Pipeline] { 00:01:40.928 [Pipeline] timeout 00:01:40.928 Timeout set to expire in 1 hr 0 min 00:01:40.930 [Pipeline] { 00:01:40.942 [Pipeline] stage 00:01:40.944 [Pipeline] { (Tests) 00:01:40.955 [Pipeline] sh 00:01:41.231 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:41.231 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:41.231 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:41.231 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:41.231 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:41.231 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:41.231 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:41.231 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:41.231 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:41.231 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:41.231 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:41.231 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:41.231 + source /etc/os-release 00:01:41.231 ++ NAME='Fedora Linux' 00:01:41.231 ++ VERSION='39 (Cloud Edition)' 00:01:41.231 ++ ID=fedora 00:01:41.231 ++ VERSION_ID=39 00:01:41.231 ++ VERSION_CODENAME= 00:01:41.231 ++ PLATFORM_ID=platform:f39 00:01:41.231 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:41.231 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:41.231 ++ LOGO=fedora-logo-icon 00:01:41.231 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:41.231 ++ HOME_URL=https://fedoraproject.org/ 00:01:41.231 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:41.231 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:41.231 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:41.231 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:41.231 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:41.231 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:41.231 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:41.231 ++ SUPPORT_END=2024-11-12 00:01:41.231 ++ VARIANT='Cloud Edition' 00:01:41.231 ++ VARIANT_ID=cloud 00:01:41.231 + uname -a 00:01:41.231 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:41.231 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:42.167 Hugepages 00:01:42.167 node hugesize free / total 00:01:42.167 node0 1048576kB 0 / 0 00:01:42.167 node0 2048kB 0 / 0 00:01:42.167 node1 1048576kB 0 / 0 00:01:42.167 node1 2048kB 0 / 0 00:01:42.167 00:01:42.167 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:42.167 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:42.167 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:42.167 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:42.167 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:42.167 + rm -f /tmp/spdk-ld-path 00:01:42.167 + source autorun-spdk.conf 00:01:42.167 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:42.167 ++ SPDK_TEST_NVMF=1 00:01:42.167 ++ SPDK_TEST_NVME_CLI=1 00:01:42.167 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:42.167 ++ SPDK_TEST_NVMF_NICS=e810 00:01:42.167 ++ SPDK_TEST_VFIOUSER=1 00:01:42.167 ++ SPDK_RUN_UBSAN=1 00:01:42.167 ++ NET_TYPE=phy 00:01:42.167 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:42.167 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.167 ++ RUN_NIGHTLY=1 00:01:42.167 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:42.167 + [[ -n '' ]] 00:01:42.167 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:42.437 + for M in /var/spdk/build-*-manifest.txt 00:01:42.437 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:42.437 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:42.437 + for M in /var/spdk/build-*-manifest.txt 00:01:42.437 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:42.437 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:42.437 + for M in /var/spdk/build-*-manifest.txt 00:01:42.437 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:42.437 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:42.437 ++ uname 00:01:42.437 + [[ Linux == \L\i\n\u\x ]] 00:01:42.437 + sudo dmesg -T 00:01:42.437 + sudo dmesg --clear 00:01:42.437 + dmesg_pid=1532205 00:01:42.437 + [[ Fedora Linux == FreeBSD ]] 00:01:42.437 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:42.437 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:42.437 + sudo dmesg -Tw 00:01:42.437 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:42.437 + [[ -x /usr/src/fio-static/fio ]] 00:01:42.437 + export FIO_BIN=/usr/src/fio-static/fio 00:01:42.437 + FIO_BIN=/usr/src/fio-static/fio 00:01:42.437 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:42.437 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:42.437 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:42.437 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:42.437 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:42.437 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:42.437 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:42.437 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:42.437 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:42.437 Test configuration: 00:01:42.437 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:42.437 SPDK_TEST_NVMF=1 00:01:42.437 SPDK_TEST_NVME_CLI=1 00:01:42.437 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:42.437 SPDK_TEST_NVMF_NICS=e810 00:01:42.437 SPDK_TEST_VFIOUSER=1 00:01:42.437 SPDK_RUN_UBSAN=1 00:01:42.437 NET_TYPE=phy 00:01:42.437 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:42.437 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.437 RUN_NIGHTLY=1 16:54:39 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:42.437 16:54:39 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:42.437 16:54:39 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:42.437 16:54:39 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:42.437 16:54:39 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:42.437 16:54:39 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:42.437 16:54:39 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:42.437 16:54:39 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:42.437 16:54:39 -- paths/export.sh@5 -- $ export PATH 00:01:42.437 16:54:39 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:42.437 16:54:39 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:42.438 16:54:39 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:42.438 16:54:39 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732722879.XXXXXX 00:01:42.438 16:54:39 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732722879.O3Dl1c 00:01:42.438 16:54:39 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.438 16:54:39 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:42.438 16:54:39 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:42.438 16:54:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.438 16:54:39 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:42.438 16:54:39 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:42.438 16:54:39 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:42.438 16:54:39 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:42.438 16:54:39 -- spdk/autobuild.sh@16 -- $ date -u 00:01:42.438 Wed Nov 27 03:54:39 PM UTC 2024 00:01:42.438 16:54:39 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:42.438 LTS-67-gc13c99a5e 00:01:42.438 16:54:39 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:42.438 16:54:39 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:42.438 16:54:39 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:42.438 16:54:39 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:42.438 16:54:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:42.438 16:54:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.438 ************************************ 00:01:42.438 START TEST ubsan 00:01:42.438 ************************************ 00:01:42.438 16:54:39 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:42.438 using ubsan 00:01:42.438 00:01:42.438 real 0m0.000s 00:01:42.438 user 0m0.000s 00:01:42.438 sys 0m0.000s 00:01:42.438 16:54:39 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:42.438 16:54:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.438 ************************************ 00:01:42.438 END TEST ubsan 00:01:42.438 ************************************ 00:01:42.438 16:54:39 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:42.438 16:54:39 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:42.438 16:54:39 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:42.438 16:54:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:42.438 16:54:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.438 ************************************ 00:01:42.438 START TEST build_native_dpdk 00:01:42.438 ************************************ 00:01:42.438 16:54:39 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:42.438 16:54:39 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:42.438 16:54:39 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:42.438 16:54:39 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:42.438 16:54:39 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:42.438 16:54:39 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:42.438 16:54:39 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:42.438 16:54:39 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:42.438 16:54:39 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:42.438 16:54:39 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:42.438 16:54:39 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:42.438 16:54:39 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.438 16:54:39 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.438 16:54:39 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:42.438 caf0f5d395 version: 22.11.4 00:01:42.438 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:42.438 dc9c799c7d vhost: fix missing spinlock unlock 00:01:42.438 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:42.438 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:42.438 16:54:39 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:42.438 16:54:39 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:42.438 16:54:39 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:42.438 16:54:39 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:42.438 16:54:39 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:42.438 16:54:39 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:42.438 16:54:39 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:42.438 16:54:39 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:42.438 16:54:39 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:42.438 16:54:39 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:42.438 16:54:39 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:42.438 16:54:39 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:42.438 16:54:39 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:42.438 16:54:39 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:42.438 16:54:39 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:42.438 16:54:39 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:42.438 16:54:39 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:42.438 16:54:39 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:42.438 16:54:39 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:42.438 16:54:39 -- scripts/common.sh@343 -- $ case "$op" in 00:01:42.438 16:54:39 -- scripts/common.sh@344 -- $ : 1 00:01:42.438 16:54:39 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:42.438 16:54:39 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:42.438 16:54:39 -- scripts/common.sh@364 -- $ decimal 22 00:01:42.438 16:54:39 -- scripts/common.sh@352 -- $ local d=22 00:01:42.438 16:54:39 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:42.438 16:54:39 -- scripts/common.sh@354 -- $ echo 22 00:01:42.438 16:54:39 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:42.438 16:54:39 -- scripts/common.sh@365 -- $ decimal 21 00:01:42.438 16:54:39 -- scripts/common.sh@352 -- $ local d=21 00:01:42.438 16:54:39 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:42.438 16:54:39 -- scripts/common.sh@354 -- $ echo 21 00:01:42.438 16:54:39 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:42.438 16:54:39 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:42.438 16:54:39 -- scripts/common.sh@366 -- $ return 1 00:01:42.438 16:54:39 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:42.438 patching file config/rte_config.h 00:01:42.438 Hunk #1 succeeded at 60 (offset 1 line). 00:01:42.438 16:54:39 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:42.438 16:54:39 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:42.438 16:54:39 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:42.438 16:54:39 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:42.438 16:54:39 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:42.438 16:54:39 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:42.438 16:54:39 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:42.438 16:54:39 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:42.438 16:54:39 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:42.438 16:54:39 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:42.438 16:54:39 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:42.438 16:54:39 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:42.438 16:54:39 -- scripts/common.sh@343 -- $ case "$op" in 00:01:42.438 16:54:39 -- scripts/common.sh@344 -- $ : 1 00:01:42.438 16:54:39 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:42.438 16:54:39 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:42.438 16:54:39 -- scripts/common.sh@364 -- $ decimal 22 00:01:42.438 16:54:39 -- scripts/common.sh@352 -- $ local d=22 00:01:42.438 16:54:39 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:42.438 16:54:39 -- scripts/common.sh@354 -- $ echo 22 00:01:42.438 16:54:39 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:42.438 16:54:39 -- scripts/common.sh@365 -- $ decimal 24 00:01:42.438 16:54:39 -- scripts/common.sh@352 -- $ local d=24 00:01:42.438 16:54:39 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:42.438 16:54:39 -- scripts/common.sh@354 -- $ echo 24 00:01:42.438 16:54:39 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:42.438 16:54:39 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:42.438 16:54:39 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:42.438 16:54:39 -- scripts/common.sh@367 -- $ return 0 00:01:42.438 16:54:39 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:42.438 patching file lib/pcapng/rte_pcapng.c 00:01:42.438 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:42.438 16:54:39 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:42.438 16:54:39 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:42.438 16:54:39 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:42.438 16:54:39 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:42.438 16:54:39 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:47.716 The Meson build system 00:01:47.716 Version: 1.5.0 00:01:47.716 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:47.716 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:47.716 Build type: native build 00:01:47.716 Program cat found: YES (/usr/bin/cat) 00:01:47.716 Project name: DPDK 00:01:47.716 Project version: 22.11.4 00:01:47.716 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:47.716 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:47.716 Host machine cpu family: x86_64 00:01:47.716 Host machine cpu: x86_64 00:01:47.716 Message: ## Building in Developer Mode ## 00:01:47.716 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:47.716 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:47.716 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:47.716 Program objdump found: YES (/usr/bin/objdump) 00:01:47.716 Program python3 found: YES (/usr/bin/python3) 00:01:47.716 Program cat found: YES (/usr/bin/cat) 00:01:47.716 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:47.716 Checking for size of "void *" : 8 00:01:47.716 Checking for size of "void *" : 8 (cached) 00:01:47.716 Library m found: YES 00:01:47.716 Library numa found: YES 00:01:47.716 Has header "numaif.h" : YES 00:01:47.716 Library fdt found: NO 00:01:47.716 Library execinfo found: NO 00:01:47.716 Has header "execinfo.h" : YES 00:01:47.716 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:47.716 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:47.716 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:47.716 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:47.716 Run-time dependency openssl found: YES 3.1.1 00:01:47.716 Run-time dependency libpcap found: YES 1.10.4 00:01:47.716 Has header "pcap.h" with dependency libpcap: YES 00:01:47.716 Compiler for C supports arguments -Wcast-qual: YES 00:01:47.716 Compiler for C supports arguments -Wdeprecated: YES 00:01:47.716 Compiler for C supports arguments -Wformat: YES 00:01:47.716 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:47.716 Compiler for C supports arguments -Wformat-security: NO 00:01:47.716 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:47.716 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:47.716 Compiler for C supports arguments -Wnested-externs: YES 00:01:47.716 Compiler for C supports arguments -Wold-style-definition: YES 00:01:47.716 Compiler for C supports arguments -Wpointer-arith: YES 00:01:47.716 Compiler for C supports arguments -Wsign-compare: YES 00:01:47.716 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:47.716 Compiler for C supports arguments -Wundef: YES 00:01:47.716 Compiler for C supports arguments -Wwrite-strings: YES 00:01:47.716 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:47.716 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:47.716 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:47.716 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:47.716 Compiler for C supports arguments -mavx512f: YES 00:01:47.716 Checking if "AVX512 checking" compiles: YES 00:01:47.716 Fetching value of define "__SSE4_2__" : 1 00:01:47.716 Fetching value of define "__AES__" : 1 00:01:47.716 Fetching value of define "__AVX__" : 1 00:01:47.716 Fetching value of define "__AVX2__" : (undefined) 00:01:47.716 Fetching value of define "__AVX512BW__" : (undefined) 00:01:47.716 Fetching value of define "__AVX512CD__" : (undefined) 00:01:47.716 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:47.716 Fetching value of define "__AVX512F__" : (undefined) 00:01:47.716 Fetching value of define "__AVX512VL__" : (undefined) 00:01:47.716 Fetching value of define "__PCLMUL__" : 1 00:01:47.716 Fetching value of define "__RDRND__" : 1 00:01:47.716 Fetching value of define "__RDSEED__" : (undefined) 00:01:47.716 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:47.716 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:47.716 Message: lib/kvargs: Defining dependency "kvargs" 00:01:47.716 Message: lib/telemetry: Defining dependency "telemetry" 00:01:47.716 Checking for function "getentropy" : YES 00:01:47.716 Message: lib/eal: Defining dependency "eal" 00:01:47.716 Message: lib/ring: Defining dependency "ring" 00:01:47.716 Message: lib/rcu: Defining dependency "rcu" 00:01:47.716 Message: lib/mempool: Defining dependency "mempool" 00:01:47.716 Message: lib/mbuf: Defining dependency "mbuf" 00:01:47.716 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:47.716 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:47.716 Compiler for C supports arguments -mpclmul: YES 00:01:47.716 Compiler for C supports arguments -maes: YES 00:01:47.716 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:47.716 Compiler for C supports arguments -mavx512bw: YES 00:01:47.716 Compiler for C supports arguments -mavx512dq: YES 00:01:47.716 Compiler for C supports arguments -mavx512vl: YES 00:01:47.716 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:47.716 Compiler for C supports arguments -mavx2: YES 00:01:47.716 Compiler for C supports arguments -mavx: YES 00:01:47.716 Message: lib/net: Defining dependency "net" 00:01:47.716 Message: lib/meter: Defining dependency "meter" 00:01:47.716 Message: lib/ethdev: Defining dependency "ethdev" 00:01:47.716 Message: lib/pci: Defining dependency "pci" 00:01:47.716 Message: lib/cmdline: Defining dependency "cmdline" 00:01:47.716 Message: lib/metrics: Defining dependency "metrics" 00:01:47.716 Message: lib/hash: Defining dependency "hash" 00:01:47.716 Message: lib/timer: Defining dependency "timer" 00:01:47.716 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:47.716 Compiler for C supports arguments -mavx2: YES (cached) 00:01:47.716 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:47.716 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:47.716 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:47.716 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:47.716 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:47.716 Message: lib/acl: Defining dependency "acl" 00:01:47.716 Message: lib/bbdev: Defining dependency "bbdev" 00:01:47.716 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:47.716 Run-time dependency libelf found: YES 0.191 00:01:47.716 Message: lib/bpf: Defining dependency "bpf" 00:01:47.716 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:47.716 Message: lib/compressdev: Defining dependency "compressdev" 00:01:47.716 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:47.716 Message: lib/distributor: Defining dependency "distributor" 00:01:47.716 Message: lib/efd: Defining dependency "efd" 00:01:47.716 Message: lib/eventdev: Defining dependency "eventdev" 00:01:47.716 Message: lib/gpudev: Defining dependency "gpudev" 00:01:47.716 Message: lib/gro: Defining dependency "gro" 00:01:47.716 Message: lib/gso: Defining dependency "gso" 00:01:47.716 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:47.716 Message: lib/jobstats: Defining dependency "jobstats" 00:01:47.717 Message: lib/latencystats: Defining dependency "latencystats" 00:01:47.717 Message: lib/lpm: Defining dependency "lpm" 00:01:47.717 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:47.717 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:47.717 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:47.717 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:47.717 Message: lib/member: Defining dependency "member" 00:01:47.717 Message: lib/pcapng: Defining dependency "pcapng" 00:01:47.717 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:47.717 Message: lib/power: Defining dependency "power" 00:01:47.717 Message: lib/rawdev: Defining dependency "rawdev" 00:01:47.717 Message: lib/regexdev: Defining dependency "regexdev" 00:01:47.717 Message: lib/dmadev: Defining dependency "dmadev" 00:01:47.717 Message: lib/rib: Defining dependency "rib" 00:01:47.717 Message: lib/reorder: Defining dependency "reorder" 00:01:47.717 Message: lib/sched: Defining dependency "sched" 00:01:47.717 Message: lib/security: Defining dependency "security" 00:01:47.717 Message: lib/stack: Defining dependency "stack" 00:01:47.717 Has header "linux/userfaultfd.h" : YES 00:01:47.717 Message: lib/vhost: Defining dependency "vhost" 00:01:47.717 Message: lib/ipsec: Defining dependency "ipsec" 00:01:47.717 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:47.717 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:47.717 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:47.717 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:47.717 Message: lib/fib: Defining dependency "fib" 00:01:47.717 Message: lib/port: Defining dependency "port" 00:01:47.717 Message: lib/pdump: Defining dependency "pdump" 00:01:47.717 Message: lib/table: Defining dependency "table" 00:01:47.717 Message: lib/pipeline: Defining dependency "pipeline" 00:01:47.717 Message: lib/graph: Defining dependency "graph" 00:01:47.717 Message: lib/node: Defining dependency "node" 00:01:47.717 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:47.717 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:47.717 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:47.717 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:47.717 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:47.717 Compiler for C supports arguments -Wno-unused-value: YES 00:01:48.697 Compiler for C supports arguments -Wno-format: YES 00:01:48.697 Compiler for C supports arguments -Wno-format-security: YES 00:01:48.697 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:48.697 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:48.697 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:48.697 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:48.697 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:48.697 Compiler for C supports arguments -mavx2: YES (cached) 00:01:48.697 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:48.697 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:48.697 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:48.697 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:48.697 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:48.697 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:48.697 Configuring doxy-api.conf using configuration 00:01:48.697 Program sphinx-build found: NO 00:01:48.697 Configuring rte_build_config.h using configuration 00:01:48.697 Message: 00:01:48.697 ================= 00:01:48.697 Applications Enabled 00:01:48.697 ================= 00:01:48.697 00:01:48.697 apps: 00:01:48.697 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:48.697 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:48.697 test-security-perf, 00:01:48.697 00:01:48.697 Message: 00:01:48.697 ================= 00:01:48.697 Libraries Enabled 00:01:48.697 ================= 00:01:48.697 00:01:48.697 libs: 00:01:48.697 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:48.697 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:48.697 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:48.697 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:48.697 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:48.697 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:48.697 table, pipeline, graph, node, 00:01:48.697 00:01:48.697 Message: 00:01:48.697 =============== 00:01:48.697 Drivers Enabled 00:01:48.697 =============== 00:01:48.697 00:01:48.697 common: 00:01:48.697 00:01:48.697 bus: 00:01:48.697 pci, vdev, 00:01:48.697 mempool: 00:01:48.697 ring, 00:01:48.697 dma: 00:01:48.697 00:01:48.697 net: 00:01:48.697 i40e, 00:01:48.697 raw: 00:01:48.697 00:01:48.697 crypto: 00:01:48.697 00:01:48.697 compress: 00:01:48.697 00:01:48.697 regex: 00:01:48.697 00:01:48.697 vdpa: 00:01:48.697 00:01:48.697 event: 00:01:48.697 00:01:48.697 baseband: 00:01:48.697 00:01:48.697 gpu: 00:01:48.697 00:01:48.697 00:01:48.697 Message: 00:01:48.697 ================= 00:01:48.697 Content Skipped 00:01:48.697 ================= 00:01:48.697 00:01:48.697 apps: 00:01:48.697 00:01:48.697 libs: 00:01:48.697 kni: explicitly disabled via build config (deprecated lib) 00:01:48.697 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:48.697 00:01:48.697 drivers: 00:01:48.697 common/cpt: not in enabled drivers build config 00:01:48.697 common/dpaax: not in enabled drivers build config 00:01:48.697 common/iavf: not in enabled drivers build config 00:01:48.697 common/idpf: not in enabled drivers build config 00:01:48.697 common/mvep: not in enabled drivers build config 00:01:48.697 common/octeontx: not in enabled drivers build config 00:01:48.697 bus/auxiliary: not in enabled drivers build config 00:01:48.697 bus/dpaa: not in enabled drivers build config 00:01:48.697 bus/fslmc: not in enabled drivers build config 00:01:48.697 bus/ifpga: not in enabled drivers build config 00:01:48.697 bus/vmbus: not in enabled drivers build config 00:01:48.697 common/cnxk: not in enabled drivers build config 00:01:48.697 common/mlx5: not in enabled drivers build config 00:01:48.697 common/qat: not in enabled drivers build config 00:01:48.697 common/sfc_efx: not in enabled drivers build config 00:01:48.697 mempool/bucket: not in enabled drivers build config 00:01:48.697 mempool/cnxk: not in enabled drivers build config 00:01:48.697 mempool/dpaa: not in enabled drivers build config 00:01:48.697 mempool/dpaa2: not in enabled drivers build config 00:01:48.697 mempool/octeontx: not in enabled drivers build config 00:01:48.697 mempool/stack: not in enabled drivers build config 00:01:48.697 dma/cnxk: not in enabled drivers build config 00:01:48.697 dma/dpaa: not in enabled drivers build config 00:01:48.697 dma/dpaa2: not in enabled drivers build config 00:01:48.697 dma/hisilicon: not in enabled drivers build config 00:01:48.697 dma/idxd: not in enabled drivers build config 00:01:48.697 dma/ioat: not in enabled drivers build config 00:01:48.697 dma/skeleton: not in enabled drivers build config 00:01:48.697 net/af_packet: not in enabled drivers build config 00:01:48.697 net/af_xdp: not in enabled drivers build config 00:01:48.697 net/ark: not in enabled drivers build config 00:01:48.697 net/atlantic: not in enabled drivers build config 00:01:48.697 net/avp: not in enabled drivers build config 00:01:48.697 net/axgbe: not in enabled drivers build config 00:01:48.697 net/bnx2x: not in enabled drivers build config 00:01:48.697 net/bnxt: not in enabled drivers build config 00:01:48.697 net/bonding: not in enabled drivers build config 00:01:48.697 net/cnxk: not in enabled drivers build config 00:01:48.697 net/cxgbe: not in enabled drivers build config 00:01:48.697 net/dpaa: not in enabled drivers build config 00:01:48.697 net/dpaa2: not in enabled drivers build config 00:01:48.697 net/e1000: not in enabled drivers build config 00:01:48.697 net/ena: not in enabled drivers build config 00:01:48.697 net/enetc: not in enabled drivers build config 00:01:48.697 net/enetfec: not in enabled drivers build config 00:01:48.697 net/enic: not in enabled drivers build config 00:01:48.697 net/failsafe: not in enabled drivers build config 00:01:48.697 net/fm10k: not in enabled drivers build config 00:01:48.697 net/gve: not in enabled drivers build config 00:01:48.697 net/hinic: not in enabled drivers build config 00:01:48.697 net/hns3: not in enabled drivers build config 00:01:48.697 net/iavf: not in enabled drivers build config 00:01:48.697 net/ice: not in enabled drivers build config 00:01:48.697 net/idpf: not in enabled drivers build config 00:01:48.697 net/igc: not in enabled drivers build config 00:01:48.697 net/ionic: not in enabled drivers build config 00:01:48.697 net/ipn3ke: not in enabled drivers build config 00:01:48.697 net/ixgbe: not in enabled drivers build config 00:01:48.697 net/kni: not in enabled drivers build config 00:01:48.697 net/liquidio: not in enabled drivers build config 00:01:48.697 net/mana: not in enabled drivers build config 00:01:48.697 net/memif: not in enabled drivers build config 00:01:48.697 net/mlx4: not in enabled drivers build config 00:01:48.697 net/mlx5: not in enabled drivers build config 00:01:48.697 net/mvneta: not in enabled drivers build config 00:01:48.697 net/mvpp2: not in enabled drivers build config 00:01:48.697 net/netvsc: not in enabled drivers build config 00:01:48.697 net/nfb: not in enabled drivers build config 00:01:48.697 net/nfp: not in enabled drivers build config 00:01:48.697 net/ngbe: not in enabled drivers build config 00:01:48.697 net/null: not in enabled drivers build config 00:01:48.697 net/octeontx: not in enabled drivers build config 00:01:48.697 net/octeon_ep: not in enabled drivers build config 00:01:48.697 net/pcap: not in enabled drivers build config 00:01:48.697 net/pfe: not in enabled drivers build config 00:01:48.697 net/qede: not in enabled drivers build config 00:01:48.697 net/ring: not in enabled drivers build config 00:01:48.697 net/sfc: not in enabled drivers build config 00:01:48.697 net/softnic: not in enabled drivers build config 00:01:48.697 net/tap: not in enabled drivers build config 00:01:48.697 net/thunderx: not in enabled drivers build config 00:01:48.697 net/txgbe: not in enabled drivers build config 00:01:48.697 net/vdev_netvsc: not in enabled drivers build config 00:01:48.697 net/vhost: not in enabled drivers build config 00:01:48.697 net/virtio: not in enabled drivers build config 00:01:48.697 net/vmxnet3: not in enabled drivers build config 00:01:48.697 raw/cnxk_bphy: not in enabled drivers build config 00:01:48.697 raw/cnxk_gpio: not in enabled drivers build config 00:01:48.697 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:48.697 raw/ifpga: not in enabled drivers build config 00:01:48.697 raw/ntb: not in enabled drivers build config 00:01:48.697 raw/skeleton: not in enabled drivers build config 00:01:48.697 crypto/armv8: not in enabled drivers build config 00:01:48.697 crypto/bcmfs: not in enabled drivers build config 00:01:48.697 crypto/caam_jr: not in enabled drivers build config 00:01:48.697 crypto/ccp: not in enabled drivers build config 00:01:48.697 crypto/cnxk: not in enabled drivers build config 00:01:48.697 crypto/dpaa_sec: not in enabled drivers build config 00:01:48.697 crypto/dpaa2_sec: not in enabled drivers build config 00:01:48.697 crypto/ipsec_mb: not in enabled drivers build config 00:01:48.697 crypto/mlx5: not in enabled drivers build config 00:01:48.697 crypto/mvsam: not in enabled drivers build config 00:01:48.697 crypto/nitrox: not in enabled drivers build config 00:01:48.697 crypto/null: not in enabled drivers build config 00:01:48.697 crypto/octeontx: not in enabled drivers build config 00:01:48.697 crypto/openssl: not in enabled drivers build config 00:01:48.697 crypto/scheduler: not in enabled drivers build config 00:01:48.697 crypto/uadk: not in enabled drivers build config 00:01:48.697 crypto/virtio: not in enabled drivers build config 00:01:48.697 compress/isal: not in enabled drivers build config 00:01:48.697 compress/mlx5: not in enabled drivers build config 00:01:48.697 compress/octeontx: not in enabled drivers build config 00:01:48.697 compress/zlib: not in enabled drivers build config 00:01:48.697 regex/mlx5: not in enabled drivers build config 00:01:48.697 regex/cn9k: not in enabled drivers build config 00:01:48.697 vdpa/ifc: not in enabled drivers build config 00:01:48.697 vdpa/mlx5: not in enabled drivers build config 00:01:48.697 vdpa/sfc: not in enabled drivers build config 00:01:48.698 event/cnxk: not in enabled drivers build config 00:01:48.698 event/dlb2: not in enabled drivers build config 00:01:48.698 event/dpaa: not in enabled drivers build config 00:01:48.698 event/dpaa2: not in enabled drivers build config 00:01:48.698 event/dsw: not in enabled drivers build config 00:01:48.698 event/opdl: not in enabled drivers build config 00:01:48.698 event/skeleton: not in enabled drivers build config 00:01:48.698 event/sw: not in enabled drivers build config 00:01:48.698 event/octeontx: not in enabled drivers build config 00:01:48.698 baseband/acc: not in enabled drivers build config 00:01:48.698 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:48.698 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:48.698 baseband/la12xx: not in enabled drivers build config 00:01:48.698 baseband/null: not in enabled drivers build config 00:01:48.698 baseband/turbo_sw: not in enabled drivers build config 00:01:48.698 gpu/cuda: not in enabled drivers build config 00:01:48.698 00:01:48.698 00:01:48.698 Build targets in project: 316 00:01:48.698 00:01:48.698 DPDK 22.11.4 00:01:48.698 00:01:48.698 User defined options 00:01:48.698 libdir : lib 00:01:48.698 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.698 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:48.698 c_link_args : 00:01:48.698 enable_docs : false 00:01:48.698 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:48.698 enable_kmods : false 00:01:48.698 machine : native 00:01:48.698 tests : false 00:01:48.698 00:01:48.698 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:48.698 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:48.698 16:54:45 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:48.698 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:48.698 [1/745] Generating lib/rte_telemetry_def with a custom command 00:01:48.698 [2/745] Generating lib/rte_kvargs_def with a custom command 00:01:48.698 [3/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:48.698 [4/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:48.698 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:48.698 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:48.698 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:48.698 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:48.698 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:48.698 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:48.698 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:48.698 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:48.698 [13/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:48.698 [14/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:48.698 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:48.698 [16/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:48.959 [17/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:48.959 [18/745] Linking static target lib/librte_kvargs.a 00:01:48.959 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:48.959 [20/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:48.959 [21/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:48.959 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:48.959 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:48.959 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:48.959 [25/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:48.959 [26/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:48.959 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:48.959 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:48.959 [29/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:48.959 [30/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:48.959 [31/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:48.959 [32/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:48.959 [33/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:48.959 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:48.959 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:48.959 [36/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:48.959 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:48.959 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:48.959 [39/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:48.959 [40/745] Generating lib/rte_eal_mingw with a custom command 00:01:48.959 [41/745] Generating lib/rte_eal_def with a custom command 00:01:48.959 [42/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:48.959 [43/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:48.959 [44/745] Generating lib/rte_ring_def with a custom command 00:01:48.959 [45/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:48.959 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:48.959 [47/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:48.959 [48/745] Generating lib/rte_ring_mingw with a custom command 00:01:48.959 [49/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:48.959 [50/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:48.959 [51/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:48.959 [52/745] Generating lib/rte_rcu_def with a custom command 00:01:48.959 [53/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:48.959 [54/745] Generating lib/rte_rcu_mingw with a custom command 00:01:48.959 [55/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:48.959 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:48.959 [57/745] Generating lib/rte_mempool_def with a custom command 00:01:48.959 [58/745] Generating lib/rte_mempool_mingw with a custom command 00:01:48.959 [59/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:48.959 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:48.959 [61/745] Generating lib/rte_mbuf_def with a custom command 00:01:48.959 [62/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:48.959 [63/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:48.959 [64/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:48.959 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:49.222 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:49.222 [67/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:49.222 [68/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:49.222 [69/745] Generating lib/rte_net_def with a custom command 00:01:49.222 [70/745] Generating lib/rte_net_mingw with a custom command 00:01:49.222 [71/745] Generating lib/rte_meter_def with a custom command 00:01:49.222 [72/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:49.222 [73/745] Generating lib/rte_meter_mingw with a custom command 00:01:49.222 [74/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:49.222 [75/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:49.222 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:49.222 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:49.222 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:49.222 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.222 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:49.222 [81/745] Linking static target lib/librte_ring.a 00:01:49.222 [82/745] Linking target lib/librte_kvargs.so.23.0 00:01:49.222 [83/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:49.222 [84/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:49.222 [85/745] Generating lib/rte_pci_def with a custom command 00:01:49.485 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:49.485 [87/745] Linking static target lib/librte_meter.a 00:01:49.485 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:49.485 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:49.485 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:49.485 [91/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:49.485 [92/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:49.485 [93/745] Linking static target lib/librte_pci.a 00:01:49.485 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:49.485 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:49.485 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:49.485 [97/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:49.485 [98/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:49.748 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.748 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:49.748 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:49.748 [102/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.748 [103/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:49.748 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:49.748 [105/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.748 [106/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:49.748 [107/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:49.748 [108/745] Generating lib/rte_cmdline_def with a custom command 00:01:49.748 [109/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:49.748 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:49.748 [111/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:49.748 [112/745] Linking static target lib/librte_telemetry.a 00:01:49.748 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:49.748 [114/745] Generating lib/rte_metrics_def with a custom command 00:01:49.748 [115/745] Generating lib/rte_metrics_mingw with a custom command 00:01:49.748 [116/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:49.748 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:49.748 [118/745] Generating lib/rte_hash_def with a custom command 00:01:50.014 [119/745] Generating lib/rte_hash_mingw with a custom command 00:01:50.014 [120/745] Generating lib/rte_timer_def with a custom command 00:01:50.014 [121/745] Generating lib/rte_timer_mingw with a custom command 00:01:50.014 [122/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:50.014 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:50.014 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:50.014 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:50.274 [126/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:50.274 [127/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:50.274 [128/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:50.274 [129/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:50.274 [130/745] Generating lib/rte_acl_def with a custom command 00:01:50.274 [131/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:50.274 [132/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:50.274 [133/745] Generating lib/rte_acl_mingw with a custom command 00:01:50.274 [134/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:50.274 [135/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:50.274 [136/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:50.274 [137/745] Generating lib/rte_bitratestats_def with a custom command 00:01:50.274 [138/745] Generating lib/rte_bbdev_def with a custom command 00:01:50.274 [139/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.274 [140/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:50.274 [141/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:50.274 [142/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:50.274 [143/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:50.274 [144/745] Linking target lib/librte_telemetry.so.23.0 00:01:50.533 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:50.533 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:50.533 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:50.533 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:50.533 [149/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:50.533 [150/745] Generating lib/rte_bpf_def with a custom command 00:01:50.533 [151/745] Generating lib/rte_bpf_mingw with a custom command 00:01:50.533 [152/745] Generating lib/rte_cfgfile_def with a custom command 00:01:50.533 [153/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:50.533 [154/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:50.533 [155/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:50.533 [156/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:50.533 [157/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:50.533 [158/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:50.533 [159/745] Generating lib/rte_compressdev_def with a custom command 00:01:50.533 [160/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:50.533 [161/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:50.791 [162/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:50.791 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:01:50.791 [164/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:50.791 [165/745] Linking static target lib/librte_rcu.a 00:01:50.791 [166/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:50.791 [167/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:50.791 [168/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:50.791 [169/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:50.791 [170/745] Linking static target lib/librte_cmdline.a 00:01:50.791 [171/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:50.791 [172/745] Generating lib/rte_distributor_def with a custom command 00:01:50.791 [173/745] Linking static target lib/librte_timer.a 00:01:50.791 [174/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:50.791 [175/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:50.791 [176/745] Generating lib/rte_distributor_mingw with a custom command 00:01:50.791 [177/745] Generating lib/rte_efd_def with a custom command 00:01:50.791 [178/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:50.791 [179/745] Generating lib/rte_efd_mingw with a custom command 00:01:50.791 [180/745] Linking static target lib/librte_net.a 00:01:51.054 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:51.054 [182/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:51.054 [183/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:51.054 [184/745] Linking static target lib/librte_metrics.a 00:01:51.054 [185/745] Linking static target lib/librte_cfgfile.a 00:01:51.054 [186/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:51.054 [187/745] Linking static target lib/librte_mempool.a 00:01:51.315 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.315 [189/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:51.315 [190/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.315 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.315 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:51.315 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:51.315 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:51.581 [195/745] Linking static target lib/librte_eal.a 00:01:51.581 [196/745] Generating lib/rte_eventdev_def with a custom command 00:01:51.581 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:51.581 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:51.581 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:51.581 [200/745] Generating lib/rte_gpudev_def with a custom command 00:01:51.581 [201/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.581 [202/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:51.581 [203/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:51.581 [204/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:51.581 [205/745] Linking static target lib/librte_bitratestats.a 00:01:51.581 [206/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:51.581 [207/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:51.581 [208/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.581 [209/745] Generating lib/rte_gro_def with a custom command 00:01:51.581 [210/745] Generating lib/rte_gro_mingw with a custom command 00:01:51.581 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:51.843 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:51.843 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:51.843 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:51.843 [215/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:51.843 [216/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.843 [217/745] Generating lib/rte_gso_def with a custom command 00:01:51.843 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:52.107 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:52.107 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:52.107 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:52.107 [222/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.107 [223/745] Generating lib/rte_ip_frag_def with a custom command 00:01:52.107 [224/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:52.107 [225/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:52.107 [226/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:52.107 [227/745] Linking static target lib/librte_bbdev.a 00:01:52.107 [228/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:52.107 [229/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:52.369 [230/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.369 [231/745] Generating lib/rte_jobstats_def with a custom command 00:01:52.369 [232/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:52.369 [233/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:52.369 [234/745] Generating lib/rte_latencystats_def with a custom command 00:01:52.369 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:52.369 [236/745] Generating lib/rte_lpm_def with a custom command 00:01:52.369 [237/745] Generating lib/rte_lpm_mingw with a custom command 00:01:52.369 [238/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:52.369 [239/745] Linking static target lib/librte_compressdev.a 00:01:52.369 [240/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:52.369 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:52.369 [242/745] Linking static target lib/librte_jobstats.a 00:01:52.631 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:52.631 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:52.896 [245/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:52.896 [246/745] Generating lib/rte_member_def with a custom command 00:01:52.896 [247/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:52.896 [248/745] Linking static target lib/librte_distributor.a 00:01:52.896 [249/745] Generating lib/rte_member_mingw with a custom command 00:01:52.896 [250/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:52.896 [251/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.896 [252/745] Generating lib/rte_pcapng_def with a custom command 00:01:52.896 [253/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:52.896 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:53.163 [255/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:53.163 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:53.163 [257/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.163 [258/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:53.163 [259/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:53.163 [260/745] Linking static target lib/librte_bpf.a 00:01:53.163 [261/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:53.163 [262/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:53.163 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:53.163 [264/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:53.163 [265/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:53.163 [266/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:53.163 [267/745] Generating lib/rte_power_def with a custom command 00:01:53.163 [268/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.163 [269/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:53.163 [270/745] Generating lib/rte_power_mingw with a custom command 00:01:53.163 [271/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:53.422 [272/745] Linking static target lib/librte_gpudev.a 00:01:53.422 [273/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:53.422 [274/745] Generating lib/rte_rawdev_def with a custom command 00:01:53.422 [275/745] Linking static target lib/librte_gro.a 00:01:53.422 [276/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:53.422 [277/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:53.422 [278/745] Generating lib/rte_regexdev_def with a custom command 00:01:53.422 [279/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:53.422 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:53.422 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:53.422 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:53.422 [283/745] Generating lib/rte_rib_def with a custom command 00:01:53.422 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:53.422 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:53.687 [286/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:53.687 [287/745] Generating lib/rte_reorder_mingw with a custom command 00:01:53.687 [288/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:53.687 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.687 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.687 [291/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:53.687 [292/745] Generating lib/rte_sched_def with a custom command 00:01:53.687 [293/745] Generating lib/rte_sched_mingw with a custom command 00:01:53.687 [294/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:53.687 [295/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:53.687 [296/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:53.687 [297/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:53.687 [298/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:53.687 [299/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:53.687 [300/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:53.687 [301/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.687 [302/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:53.687 [303/745] Linking static target lib/librte_latencystats.a 00:01:53.952 [304/745] Generating lib/rte_security_def with a custom command 00:01:53.952 [305/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:53.952 [306/745] Generating lib/rte_security_mingw with a custom command 00:01:53.952 [307/745] Generating lib/rte_stack_mingw with a custom command 00:01:53.952 [308/745] Generating lib/rte_stack_def with a custom command 00:01:53.952 [309/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:53.952 [310/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:53.952 [311/745] Linking static target lib/librte_rawdev.a 00:01:53.952 [312/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:53.952 [313/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:53.952 [314/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:53.952 [315/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:53.952 [316/745] Linking static target lib/librte_stack.a 00:01:53.952 [317/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:53.952 [318/745] Generating lib/rte_vhost_def with a custom command 00:01:53.952 [319/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:53.952 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:01:53.952 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:54.213 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:54.213 [323/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:54.213 [324/745] Linking static target lib/librte_dmadev.a 00:01:54.213 [325/745] Linking static target lib/librte_ip_frag.a 00:01:54.213 [326/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.213 [327/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:54.213 [328/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:54.213 [329/745] Generating lib/rte_ipsec_def with a custom command 00:01:54.213 [330/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:54.475 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.475 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:54.475 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:54.736 [334/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.736 [335/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.736 [336/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.736 [337/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:54.736 [338/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:54.736 [339/745] Generating lib/rte_fib_def with a custom command 00:01:54.736 [340/745] Generating lib/rte_fib_mingw with a custom command 00:01:54.736 [341/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:54.736 [342/745] Linking static target lib/librte_gso.a 00:01:54.736 [343/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:54.996 [344/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:54.996 [345/745] Linking static target lib/librte_regexdev.a 00:01:54.996 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.996 [347/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.996 [348/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:54.996 [349/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:54.996 [350/745] Linking static target lib/librte_efd.a 00:01:55.256 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:55.256 [352/745] Linking static target lib/librte_pcapng.a 00:01:55.256 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:55.256 [354/745] Linking static target lib/librte_lpm.a 00:01:55.256 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:55.256 [356/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:55.256 [357/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:55.256 [358/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:55.519 [359/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:55.519 [360/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:55.519 [361/745] Linking static target lib/librte_reorder.a 00:01:55.519 [362/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.519 [363/745] Generating lib/rte_port_def with a custom command 00:01:55.519 [364/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:55.519 [365/745] Generating lib/rte_port_mingw with a custom command 00:01:55.519 [366/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:55.519 [367/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:55.519 [368/745] Linking static target lib/acl/libavx2_tmp.a 00:01:55.519 [369/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:55.519 [370/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:55.780 [371/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:55.780 [372/745] Generating lib/rte_pdump_mingw with a custom command 00:01:55.780 [373/745] Generating lib/rte_pdump_def with a custom command 00:01:55.780 [374/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:55.780 [375/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.780 [376/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:55.780 [377/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:55.780 [378/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:55.780 [379/745] Linking static target lib/librte_security.a 00:01:55.780 [380/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:55.780 [381/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:55.780 [382/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.780 [383/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.780 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:55.780 [385/745] Linking static target lib/librte_power.a 00:01:56.057 [386/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:56.057 [387/745] Linking static target lib/librte_hash.a 00:01:56.057 [388/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:56.057 [389/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.057 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:56.057 [391/745] Linking static target lib/librte_rib.a 00:01:56.057 [392/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:56.057 [393/745] Linking static target lib/acl/libavx512_tmp.a 00:01:56.057 [394/745] Linking static target lib/librte_acl.a 00:01:56.342 [395/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:56.342 [396/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:56.342 [397/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:56.342 [398/745] Generating lib/rte_table_def with a custom command 00:01:56.342 [399/745] Generating lib/rte_table_mingw with a custom command 00:01:56.342 [400/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.624 [401/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:56.624 [402/745] Linking static target lib/librte_ethdev.a 00:01:56.624 [403/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.624 [404/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.624 [405/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:56.885 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:56.885 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:56.885 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:56.885 [409/745] Generating lib/rte_pipeline_def with a custom command 00:01:56.885 [410/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:56.885 [411/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:56.885 [412/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:56.885 [413/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:57.144 [414/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.144 [415/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:57.144 [416/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:57.144 [417/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:57.144 [418/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:57.144 [419/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:57.144 [420/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:57.144 [421/745] Generating lib/rte_graph_mingw with a custom command 00:01:57.144 [422/745] Generating lib/rte_graph_def with a custom command 00:01:57.144 [423/745] Linking static target lib/librte_fib.a 00:01:57.144 [424/745] Linking static target lib/librte_mbuf.a 00:01:57.405 [425/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:57.405 [426/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:57.405 [427/745] Linking static target lib/librte_eventdev.a 00:01:57.405 [428/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.405 [429/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:57.405 [430/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:57.405 [431/745] Linking static target lib/librte_member.a 00:01:57.405 [432/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:57.405 [433/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:57.405 [434/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:57.405 [435/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:57.405 [436/745] Generating lib/rte_node_def with a custom command 00:01:57.405 [437/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:57.671 [438/745] Generating lib/rte_node_mingw with a custom command 00:01:57.671 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:57.671 [440/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.671 [441/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:57.671 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:57.671 [443/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:57.930 [444/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:57.930 [445/745] Linking static target lib/librte_sched.a 00:01:57.930 [446/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:57.930 [447/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:57.930 [448/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:57.930 [449/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:57.930 [450/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:57.930 [451/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:57.930 [452/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:57.930 [453/745] Linking static target lib/librte_cryptodev.a 00:01:57.930 [454/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.930 [455/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:57.930 [456/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:57.930 [457/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.930 [458/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:57.930 [459/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:57.930 [460/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:58.191 [461/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:58.191 [462/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:58.191 [463/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:58.191 [464/745] Linking static target lib/librte_pdump.a 00:01:58.191 [465/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:58.191 [466/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:58.191 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:58.191 [468/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:58.191 [469/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:58.454 [470/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:58.454 [471/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:58.454 [472/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:58.454 [473/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:58.454 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:58.454 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:58.454 [476/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.454 [477/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:58.454 [478/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:58.716 [479/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:58.716 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:58.716 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:58.716 [482/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.716 [483/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:58.716 [484/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:58.716 [485/745] Linking static target lib/librte_table.a 00:01:58.716 [486/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:58.716 [487/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:58.716 [488/745] Linking static target lib/librte_ipsec.a 00:01:58.716 [489/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.716 [490/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:58.716 [491/745] Linking static target drivers/librte_bus_vdev.a 00:01:58.716 [492/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.978 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:58.978 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:59.240 [495/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:59.240 [496/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.240 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:59.240 [498/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:59.240 [499/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.504 [500/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:59.504 [501/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:59.504 [502/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:59.504 [503/745] Linking static target lib/librte_graph.a 00:01:59.504 [504/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:59.504 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:59.504 [506/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:59.504 [507/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.504 [508/745] Linking static target drivers/librte_bus_pci.a 00:01:59.504 [509/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:59.504 [510/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.504 [511/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:59.765 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:59.765 [513/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.765 [514/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:02:00.027 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:02:00.027 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.294 [517/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:02:00.294 [518/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.294 [519/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:02:00.294 [520/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:02:00.294 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:02:00.554 [522/745] Linking static target lib/librte_port.a 00:02:00.554 [523/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:02:00.554 [524/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:00.554 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:00.554 [526/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:02:00.813 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.813 [528/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:02:00.813 [529/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:02:01.085 [530/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:02:01.085 [531/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:01.085 [532/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:01.085 [533/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:02:01.085 [534/745] Linking static target drivers/librte_mempool_ring.a 00:02:01.085 [535/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:02:01.085 [536/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:01.085 [537/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:02:01.349 [538/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.350 [539/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:02:01.350 [540/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:02:01.350 [541/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.611 [542/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:02:01.611 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:02:01.611 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:02:01.872 [545/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:02:01.872 [546/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:02:01.872 [547/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:02:01.872 [548/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:02:01.872 [549/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:02:01.872 [550/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:02:02.133 [551/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:02:02.395 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:02:02.395 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:02:02.653 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:02:02.653 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:02:02.653 [556/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:02:02.653 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:02:02.913 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:02:02.913 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:02:03.177 [560/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:02:03.177 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:02:03.177 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:02:03.177 [563/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:02:03.177 [564/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:02:03.177 [565/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:02:03.177 [566/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:02:03.439 [567/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:02:03.439 [568/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:02:03.439 [569/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:02:03.439 [570/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.439 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:02:03.439 [572/745] Linking target lib/librte_eal.so.23.0 00:02:03.439 [573/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:02:03.702 [574/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:02:03.702 [575/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:02:03.702 [576/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:02:03.702 [577/745] Linking target lib/librte_ring.so.23.0 00:02:03.702 [578/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:02:03.966 [579/745] Linking target lib/librte_meter.so.23.0 00:02:03.966 [580/745] Linking target lib/librte_pci.so.23.0 00:02:03.966 [581/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:02:03.966 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:02:03.966 [583/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.966 [584/745] Linking target lib/librte_timer.so.23.0 00:02:03.966 [585/745] Linking target lib/librte_acl.so.23.0 00:02:03.966 [586/745] Linking target lib/librte_cfgfile.so.23.0 00:02:03.966 [587/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:02:03.966 [588/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:02:03.966 [589/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:02:03.966 [590/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:02:03.966 [591/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:02:04.228 [592/745] Linking target lib/librte_jobstats.so.23.0 00:02:04.228 [593/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:02:04.228 [594/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:02:04.228 [595/745] Linking target lib/librte_rawdev.so.23.0 00:02:04.228 [596/745] Linking target lib/librte_rcu.so.23.0 00:02:04.228 [597/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:02:04.228 [598/745] Linking target lib/librte_mempool.so.23.0 00:02:04.228 [599/745] Linking target lib/librte_stack.so.23.0 00:02:04.228 [600/745] Linking target lib/librte_dmadev.so.23.0 00:02:04.228 [601/745] Linking target drivers/librte_bus_vdev.so.23.0 00:02:04.228 [602/745] Linking target lib/librte_graph.so.23.0 00:02:04.228 [603/745] Linking target drivers/librte_bus_pci.so.23.0 00:02:04.228 [604/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:02:04.228 [605/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:02:04.228 [606/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:02:04.228 [607/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:04.228 [608/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:02:04.228 [609/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:02:04.490 [610/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:02:04.490 [611/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:02:04.491 [612/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:02:04.491 [613/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:02:04.491 [614/745] Linking target lib/librte_mbuf.so.23.0 00:02:04.491 [615/745] Linking target lib/librte_rib.so.23.0 00:02:04.491 [616/745] Linking target drivers/librte_mempool_ring.so.23.0 00:02:04.491 [617/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:02:04.752 [618/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:02:04.752 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:02:04.752 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:02:04.752 [621/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:02:04.752 [622/745] Linking target lib/librte_bbdev.so.23.0 00:02:04.752 [623/745] Linking target lib/librte_net.so.23.0 00:02:04.752 [624/745] Linking target lib/librte_compressdev.so.23.0 00:02:05.011 [625/745] Linking target lib/librte_cryptodev.so.23.0 00:02:05.011 [626/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:02:05.011 [627/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:02:05.011 [628/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:02:05.011 [629/745] Linking target lib/librte_gpudev.so.23.0 00:02:05.011 [630/745] Linking target lib/librte_distributor.so.23.0 00:02:05.011 [631/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:02:05.011 [632/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:05.011 [633/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:02:05.011 [634/745] Linking target lib/librte_cmdline.so.23.0 00:02:05.011 [635/745] Linking target lib/librte_reorder.so.23.0 00:02:05.011 [636/745] Linking target lib/librte_ethdev.so.23.0 00:02:05.011 [637/745] Linking target lib/librte_hash.so.23.0 00:02:05.011 [638/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:02:05.011 [639/745] Linking target lib/librte_regexdev.so.23.0 00:02:05.273 [640/745] Linking target lib/librte_sched.so.23.0 00:02:05.273 [641/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:02:05.273 [642/745] Linking target lib/librte_fib.so.23.0 00:02:05.273 [643/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:05.273 [644/745] Linking target lib/librte_security.so.23.0 00:02:05.273 [645/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:02:05.273 [646/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:02:05.273 [647/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:02:05.273 [648/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:02:05.273 [649/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:02:05.273 [650/745] Linking target lib/librte_lpm.so.23.0 00:02:05.273 [651/745] Linking target lib/librte_efd.so.23.0 00:02:05.273 [652/745] Linking target lib/librte_member.so.23.0 00:02:05.536 [653/745] Linking target lib/librte_metrics.so.23.0 00:02:05.536 [654/745] Linking target lib/librte_gso.so.23.0 00:02:05.536 [655/745] Linking target lib/librte_gro.so.23.0 00:02:05.536 [656/745] Linking target lib/librte_bpf.so.23.0 00:02:05.536 [657/745] Linking target lib/librte_ip_frag.so.23.0 00:02:05.536 [658/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:02:05.536 [659/745] Linking target lib/librte_eventdev.so.23.0 00:02:05.536 [660/745] Linking target lib/librte_pcapng.so.23.0 00:02:05.536 [661/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:02:05.536 [662/745] Linking target lib/librte_power.so.23.0 00:02:05.536 [663/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:05.536 [664/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:05.536 [665/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:05.536 [666/745] Linking target lib/librte_ipsec.so.23.0 00:02:05.536 [667/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:02:05.536 [668/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:02:05.536 [669/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:02:05.536 [670/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:02:05.536 [671/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:02:05.794 [672/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:02:05.794 [673/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:02:05.794 [674/745] Linking target lib/librte_latencystats.so.23.0 00:02:05.794 [675/745] Linking target lib/librte_bitratestats.so.23.0 00:02:05.794 [676/745] Linking target lib/librte_pdump.so.23.0 00:02:05.794 [677/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:02:05.794 [678/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:02:05.794 [679/745] Linking target lib/librte_port.so.23.0 00:02:05.794 [680/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:05.794 [681/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:02:05.794 [682/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:06.053 [683/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:02:06.053 [684/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:02:06.053 [685/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:06.053 [686/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:06.053 [687/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:06.053 [688/745] Linking target lib/librte_table.so.23.0 00:02:06.053 [689/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:06.053 [690/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:02:06.312 [691/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:02:06.312 [692/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:06.312 [693/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:06.312 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:06.571 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:06.830 [696/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:06.830 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:06.830 [698/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:07.088 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:07.347 [700/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:07.347 [701/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:07.347 [702/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:07.605 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:07.864 [704/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:07.864 [705/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:07.864 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:07.864 [707/745] Linking static target drivers/librte_net_i40e.a 00:02:08.122 [708/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:08.122 [709/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:08.122 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:08.378 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.378 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:02:09.310 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:09.310 [714/745] Linking static target lib/librte_node.a 00:02:09.310 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.310 [716/745] Linking target lib/librte_node.so.23.0 00:02:09.877 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:10.135 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:10.701 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:18.805 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:50.870 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:50.870 [722/745] Linking static target lib/librte_vhost.a 00:02:50.870 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:50.870 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:59.060 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:59.060 [726/745] Linking static target lib/librte_pipeline.a 00:02:59.060 [727/745] Linking target app/dpdk-dumpcap 00:02:59.060 [728/745] Linking target app/dpdk-proc-info 00:02:59.060 [729/745] Linking target app/dpdk-test-regex 00:02:59.060 [730/745] Linking target app/dpdk-test-security-perf 00:02:59.060 [731/745] Linking target app/dpdk-test-fib 00:02:59.060 [732/745] Linking target app/dpdk-test-cmdline 00:02:59.060 [733/745] Linking target app/dpdk-pdump 00:02:59.060 [734/745] Linking target app/dpdk-test-sad 00:02:59.060 [735/745] Linking target app/dpdk-test-gpudev 00:02:59.060 [736/745] Linking target app/dpdk-test-flow-perf 00:02:59.060 [737/745] Linking target app/dpdk-test-pipeline 00:02:59.060 [738/745] Linking target app/dpdk-test-acl 00:02:59.060 [739/745] Linking target app/dpdk-test-bbdev 00:02:59.060 [740/745] Linking target app/dpdk-test-eventdev 00:02:59.060 [741/745] Linking target app/dpdk-test-crypto-perf 00:02:59.060 [742/745] Linking target app/dpdk-test-compress-perf 00:02:59.060 [743/745] Linking target app/dpdk-testpmd 00:03:00.963 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:00.963 [745/745] Linking target lib/librte_pipeline.so.23.0 00:03:00.963 16:55:57 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:03:00.963 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:03:00.963 [0/1] Installing files. 00:03:00.963 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.963 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.964 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:01.227 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:01.227 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:01.228 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.229 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.230 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:01.231 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:01.232 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:01.232 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.232 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.233 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:01.806 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:01.806 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:01.806 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.806 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:01.806 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.807 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.808 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.809 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:01.810 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:01.810 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:03:01.810 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:03:01.810 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:03:01.810 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:03:01.810 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:03:01.810 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:03:01.810 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:03:01.810 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:03:01.810 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:03:01.810 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:03:01.810 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:03:01.810 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:03:01.810 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:03:01.810 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:03:01.810 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:03:01.810 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:03:01.810 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:03:01.810 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:03:01.810 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:03:01.810 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:03:01.810 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:03:01.810 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:03:01.810 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:03:01.810 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:03:01.810 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:03:01.810 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:03:01.810 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:03:01.810 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:03:01.810 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:03:01.810 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:03:01.810 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:03:01.810 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:03:01.810 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:03:01.810 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:03:01.810 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:03:01.810 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:03:01.810 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:03:01.810 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:03:01.810 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:03:01.810 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:03:01.810 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:03:01.810 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:03:01.810 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:03:01.810 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:03:01.810 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:03:01.810 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:03:01.810 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:03:01.810 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:03:01.810 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:03:01.810 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:03:01.810 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:03:01.811 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:03:01.811 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:03:01.811 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:03:01.811 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:03:01.811 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:03:01.811 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:03:01.811 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:03:01.811 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:03:01.811 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:03:01.811 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:03:01.811 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:03:01.811 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:03:01.811 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:03:01.811 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:03:01.811 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:03:01.811 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:03:01.811 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:03:01.811 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:03:01.811 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:03:01.811 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:03:01.811 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:03:01.811 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:03:01.811 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:03:01.811 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:03:01.811 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:03:01.811 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:03:01.811 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:03:01.811 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:03:01.811 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:03:01.811 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:03:01.811 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:03:01.811 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:03:01.811 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:03:01.811 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:03:01.811 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:03:01.811 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:03:01.811 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:03:01.811 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:03:01.811 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:03:01.811 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:03:01.811 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:03:01.811 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:03:01.811 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:03:01.811 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:03:01.811 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:03:01.811 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:03:01.811 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:03:01.811 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:03:01.811 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:03:01.811 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:03:01.811 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:03:01.811 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:03:01.811 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:03:01.811 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:03:01.811 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:03:01.811 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:03:01.811 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:03:01.811 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:03:01.811 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:03:01.811 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:03:01.811 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:03:01.811 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:03:01.811 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:03:01.811 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:03:01.811 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:03:01.811 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:03:01.811 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:03:01.811 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:03:01.811 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:03:01.811 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:03:01.811 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:03:01.811 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:03:01.811 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:03:01.811 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:03:01.811 16:55:58 -- common/autobuild_common.sh@192 -- $ uname -s 00:03:01.811 16:55:58 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:03:01.811 16:55:58 -- common/autobuild_common.sh@203 -- $ cat 00:03:01.811 16:55:58 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:01.811 00:03:01.811 real 1m19.347s 00:03:01.811 user 14m20.923s 00:03:01.811 sys 1m50.699s 00:03:01.811 16:55:58 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:01.811 16:55:58 -- common/autotest_common.sh@10 -- $ set +x 00:03:01.811 ************************************ 00:03:01.811 END TEST build_native_dpdk 00:03:01.811 ************************************ 00:03:01.811 16:55:58 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:01.811 16:55:58 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:01.811 16:55:58 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:03:01.811 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:03:02.071 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:02.071 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:02.071 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:02.330 Using 'verbs' RDMA provider 00:03:12.561 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:22.535 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:22.535 Creating mk/config.mk...done. 00:03:22.535 Creating mk/cc.flags.mk...done. 00:03:22.535 Type 'make' to build. 00:03:22.535 16:56:17 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:22.535 16:56:17 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:22.535 16:56:17 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:22.535 16:56:17 -- common/autotest_common.sh@10 -- $ set +x 00:03:22.535 ************************************ 00:03:22.535 START TEST make 00:03:22.535 ************************************ 00:03:22.535 16:56:17 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:22.535 make[1]: Nothing to be done for 'all'. 00:03:23.112 The Meson build system 00:03:23.112 Version: 1.5.0 00:03:23.112 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:23.112 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:23.112 Build type: native build 00:03:23.112 Project name: libvfio-user 00:03:23.112 Project version: 0.0.1 00:03:23.112 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:23.112 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:23.112 Host machine cpu family: x86_64 00:03:23.112 Host machine cpu: x86_64 00:03:23.112 Run-time dependency threads found: YES 00:03:23.112 Library dl found: YES 00:03:23.112 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:23.112 Run-time dependency json-c found: YES 0.17 00:03:23.112 Run-time dependency cmocka found: YES 1.1.7 00:03:23.112 Program pytest-3 found: NO 00:03:23.112 Program flake8 found: NO 00:03:23.112 Program misspell-fixer found: NO 00:03:23.112 Program restructuredtext-lint found: NO 00:03:23.112 Program valgrind found: YES (/usr/bin/valgrind) 00:03:23.112 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:23.112 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:23.112 Compiler for C supports arguments -Wwrite-strings: YES 00:03:23.112 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:23.112 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:23.112 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:23.112 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:23.112 Build targets in project: 8 00:03:23.112 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:23.112 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:23.112 00:03:23.112 libvfio-user 0.0.1 00:03:23.112 00:03:23.112 User defined options 00:03:23.112 buildtype : debug 00:03:23.112 default_library: shared 00:03:23.112 libdir : /usr/local/lib 00:03:23.112 00:03:23.112 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:24.060 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:24.060 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:24.060 [2/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:24.060 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:24.060 [4/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:24.060 [5/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:24.060 [6/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:24.060 [7/37] Compiling C object samples/null.p/null.c.o 00:03:24.060 [8/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:24.060 [9/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:24.060 [10/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:24.319 [11/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:24.319 [12/37] Compiling C object samples/server.p/server.c.o 00:03:24.319 [13/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:24.319 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:24.319 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:24.319 [16/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:24.319 [17/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:24.319 [18/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:24.319 [19/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:24.319 [20/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:24.319 [21/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:24.319 [22/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:24.319 [23/37] Compiling C object samples/client.p/client.c.o 00:03:24.319 [24/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:24.320 [25/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:24.320 [26/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:24.320 [27/37] Linking target samples/client 00:03:24.582 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:24.582 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:24.582 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:24.582 [31/37] Linking target test/unit_tests 00:03:24.841 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:24.841 [33/37] Linking target samples/gpio-pci-idio-16 00:03:24.841 [34/37] Linking target samples/server 00:03:24.841 [35/37] Linking target samples/null 00:03:24.841 [36/37] Linking target samples/lspci 00:03:24.841 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:24.841 INFO: autodetecting backend as ninja 00:03:24.841 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:25.105 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:25.678 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:25.678 ninja: no work to do. 00:03:37.875 CC lib/ut_mock/mock.o 00:03:37.875 CC lib/ut/ut.o 00:03:37.875 CC lib/log/log.o 00:03:37.875 CC lib/log/log_flags.o 00:03:37.875 CC lib/log/log_deprecated.o 00:03:37.875 LIB libspdk_ut_mock.a 00:03:37.875 SO libspdk_ut_mock.so.5.0 00:03:37.875 LIB libspdk_ut.a 00:03:37.875 LIB libspdk_log.a 00:03:37.875 SO libspdk_ut.so.1.0 00:03:37.875 SYMLINK libspdk_ut_mock.so 00:03:37.875 SO libspdk_log.so.6.1 00:03:37.875 SYMLINK libspdk_ut.so 00:03:37.875 SYMLINK libspdk_log.so 00:03:37.875 CXX lib/trace_parser/trace.o 00:03:37.875 CC lib/ioat/ioat.o 00:03:37.875 CC lib/util/base64.o 00:03:37.875 CC lib/util/bit_array.o 00:03:37.875 CC lib/dma/dma.o 00:03:37.875 CC lib/util/cpuset.o 00:03:37.875 CC lib/util/crc16.o 00:03:37.875 CC lib/util/crc32.o 00:03:37.875 CC lib/util/crc32c.o 00:03:37.875 CC lib/util/crc32_ieee.o 00:03:37.875 CC lib/util/crc64.o 00:03:37.875 CC lib/util/dif.o 00:03:37.875 CC lib/util/fd.o 00:03:37.875 CC lib/util/file.o 00:03:37.875 CC lib/util/hexlify.o 00:03:37.875 CC lib/util/iov.o 00:03:37.875 CC lib/util/math.o 00:03:37.875 CC lib/util/pipe.o 00:03:37.875 CC lib/util/strerror_tls.o 00:03:37.875 CC lib/util/string.o 00:03:37.875 CC lib/util/uuid.o 00:03:37.875 CC lib/util/fd_group.o 00:03:37.875 CC lib/util/zipf.o 00:03:37.875 CC lib/util/xor.o 00:03:37.875 CC lib/vfio_user/host/vfio_user_pci.o 00:03:37.875 CC lib/vfio_user/host/vfio_user.o 00:03:37.875 LIB libspdk_dma.a 00:03:37.876 SO libspdk_dma.so.3.0 00:03:37.876 SYMLINK libspdk_dma.so 00:03:37.876 LIB libspdk_ioat.a 00:03:37.876 SO libspdk_ioat.so.6.0 00:03:37.876 LIB libspdk_vfio_user.a 00:03:37.876 SO libspdk_vfio_user.so.4.0 00:03:37.876 SYMLINK libspdk_ioat.so 00:03:37.876 SYMLINK libspdk_vfio_user.so 00:03:37.876 LIB libspdk_util.a 00:03:37.876 SO libspdk_util.so.8.0 00:03:37.876 SYMLINK libspdk_util.so 00:03:37.876 CC lib/json/json_parse.o 00:03:37.876 CC lib/vmd/vmd.o 00:03:37.876 CC lib/rdma/common.o 00:03:37.876 CC lib/json/json_util.o 00:03:37.876 CC lib/conf/conf.o 00:03:37.876 CC lib/idxd/idxd.o 00:03:37.876 CC lib/vmd/led.o 00:03:37.876 CC lib/rdma/rdma_verbs.o 00:03:37.876 CC lib/idxd/idxd_user.o 00:03:37.876 CC lib/json/json_write.o 00:03:37.876 CC lib/env_dpdk/env.o 00:03:37.876 CC lib/idxd/idxd_kernel.o 00:03:37.876 CC lib/env_dpdk/memory.o 00:03:37.876 CC lib/env_dpdk/pci.o 00:03:37.876 CC lib/env_dpdk/init.o 00:03:37.876 CC lib/env_dpdk/threads.o 00:03:37.876 CC lib/env_dpdk/pci_ioat.o 00:03:37.876 CC lib/env_dpdk/pci_virtio.o 00:03:37.876 CC lib/env_dpdk/pci_vmd.o 00:03:37.876 CC lib/env_dpdk/pci_idxd.o 00:03:37.876 CC lib/env_dpdk/pci_event.o 00:03:37.876 CC lib/env_dpdk/sigbus_handler.o 00:03:37.876 CC lib/env_dpdk/pci_dpdk.o 00:03:37.876 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:37.876 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:37.876 LIB libspdk_trace_parser.a 00:03:37.876 SO libspdk_trace_parser.so.4.0 00:03:37.876 SYMLINK libspdk_trace_parser.so 00:03:37.876 LIB libspdk_conf.a 00:03:37.876 SO libspdk_conf.so.5.0 00:03:37.876 SYMLINK libspdk_conf.so 00:03:37.876 LIB libspdk_json.a 00:03:37.876 SO libspdk_json.so.5.1 00:03:37.876 LIB libspdk_rdma.a 00:03:37.876 SO libspdk_rdma.so.5.0 00:03:37.876 SYMLINK libspdk_json.so 00:03:37.876 SYMLINK libspdk_rdma.so 00:03:37.876 CC lib/jsonrpc/jsonrpc_server.o 00:03:37.876 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:37.876 CC lib/jsonrpc/jsonrpc_client.o 00:03:37.876 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:37.876 LIB libspdk_idxd.a 00:03:37.876 SO libspdk_idxd.so.11.0 00:03:37.876 SYMLINK libspdk_idxd.so 00:03:37.876 LIB libspdk_vmd.a 00:03:37.876 SO libspdk_vmd.so.5.0 00:03:37.876 SYMLINK libspdk_vmd.so 00:03:38.134 LIB libspdk_jsonrpc.a 00:03:38.134 SO libspdk_jsonrpc.so.5.1 00:03:38.134 SYMLINK libspdk_jsonrpc.so 00:03:38.134 CC lib/rpc/rpc.o 00:03:38.393 LIB libspdk_rpc.a 00:03:38.393 SO libspdk_rpc.so.5.0 00:03:38.393 SYMLINK libspdk_rpc.so 00:03:38.651 CC lib/sock/sock.o 00:03:38.651 CC lib/trace/trace.o 00:03:38.651 CC lib/trace/trace_flags.o 00:03:38.651 CC lib/sock/sock_rpc.o 00:03:38.651 CC lib/trace/trace_rpc.o 00:03:38.651 CC lib/notify/notify.o 00:03:38.651 CC lib/notify/notify_rpc.o 00:03:38.651 LIB libspdk_notify.a 00:03:38.651 SO libspdk_notify.so.5.0 00:03:38.909 LIB libspdk_trace.a 00:03:38.909 SYMLINK libspdk_notify.so 00:03:38.909 SO libspdk_trace.so.9.0 00:03:38.909 SYMLINK libspdk_trace.so 00:03:38.909 LIB libspdk_sock.a 00:03:38.909 SO libspdk_sock.so.8.0 00:03:38.909 CC lib/thread/thread.o 00:03:38.909 CC lib/thread/iobuf.o 00:03:39.168 SYMLINK libspdk_sock.so 00:03:39.168 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:39.168 CC lib/nvme/nvme_ctrlr.o 00:03:39.168 CC lib/nvme/nvme_fabric.o 00:03:39.168 CC lib/nvme/nvme_ns_cmd.o 00:03:39.168 CC lib/nvme/nvme_ns.o 00:03:39.168 CC lib/nvme/nvme_pcie_common.o 00:03:39.168 CC lib/nvme/nvme_pcie.o 00:03:39.168 CC lib/nvme/nvme_qpair.o 00:03:39.168 CC lib/nvme/nvme.o 00:03:39.168 CC lib/nvme/nvme_quirks.o 00:03:39.168 CC lib/nvme/nvme_transport.o 00:03:39.168 CC lib/nvme/nvme_discovery.o 00:03:39.168 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:39.168 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:39.168 CC lib/nvme/nvme_tcp.o 00:03:39.168 CC lib/nvme/nvme_opal.o 00:03:39.168 CC lib/nvme/nvme_io_msg.o 00:03:39.168 CC lib/nvme/nvme_poll_group.o 00:03:39.168 CC lib/nvme/nvme_zns.o 00:03:39.168 CC lib/nvme/nvme_cuse.o 00:03:39.168 CC lib/nvme/nvme_vfio_user.o 00:03:39.168 CC lib/nvme/nvme_rdma.o 00:03:39.426 LIB libspdk_env_dpdk.a 00:03:39.426 SO libspdk_env_dpdk.so.13.0 00:03:39.426 SYMLINK libspdk_env_dpdk.so 00:03:40.803 LIB libspdk_thread.a 00:03:40.803 SO libspdk_thread.so.9.0 00:03:40.803 SYMLINK libspdk_thread.so 00:03:40.803 CC lib/init/json_config.o 00:03:40.803 CC lib/vfu_tgt/tgt_endpoint.o 00:03:40.803 CC lib/blob/blobstore.o 00:03:40.803 CC lib/init/subsystem.o 00:03:40.803 CC lib/vfu_tgt/tgt_rpc.o 00:03:40.803 CC lib/virtio/virtio.o 00:03:40.803 CC lib/accel/accel.o 00:03:40.803 CC lib/blob/request.o 00:03:40.803 CC lib/init/subsystem_rpc.o 00:03:40.803 CC lib/virtio/virtio_vhost_user.o 00:03:40.803 CC lib/accel/accel_rpc.o 00:03:40.804 CC lib/blob/zeroes.o 00:03:40.804 CC lib/virtio/virtio_vfio_user.o 00:03:40.804 CC lib/init/rpc.o 00:03:40.804 CC lib/accel/accel_sw.o 00:03:40.804 CC lib/blob/blob_bs_dev.o 00:03:40.804 CC lib/virtio/virtio_pci.o 00:03:41.062 LIB libspdk_init.a 00:03:41.062 SO libspdk_init.so.4.0 00:03:41.062 SYMLINK libspdk_init.so 00:03:41.062 LIB libspdk_virtio.a 00:03:41.062 LIB libspdk_vfu_tgt.a 00:03:41.062 SO libspdk_virtio.so.6.0 00:03:41.062 SO libspdk_vfu_tgt.so.2.0 00:03:41.320 SYMLINK libspdk_vfu_tgt.so 00:03:41.320 SYMLINK libspdk_virtio.so 00:03:41.320 CC lib/event/app.o 00:03:41.320 CC lib/event/reactor.o 00:03:41.320 CC lib/event/log_rpc.o 00:03:41.320 CC lib/event/app_rpc.o 00:03:41.321 CC lib/event/scheduler_static.o 00:03:41.579 LIB libspdk_nvme.a 00:03:41.579 SO libspdk_nvme.so.12.0 00:03:41.579 LIB libspdk_event.a 00:03:41.579 SO libspdk_event.so.12.0 00:03:41.837 SYMLINK libspdk_event.so 00:03:41.837 SYMLINK libspdk_nvme.so 00:03:41.837 LIB libspdk_accel.a 00:03:41.837 SO libspdk_accel.so.14.0 00:03:41.837 SYMLINK libspdk_accel.so 00:03:42.096 CC lib/bdev/bdev.o 00:03:42.096 CC lib/bdev/bdev_rpc.o 00:03:42.096 CC lib/bdev/bdev_zone.o 00:03:42.096 CC lib/bdev/part.o 00:03:42.096 CC lib/bdev/scsi_nvme.o 00:03:43.470 LIB libspdk_blob.a 00:03:43.728 SO libspdk_blob.so.10.1 00:03:43.728 SYMLINK libspdk_blob.so 00:03:43.728 CC lib/blobfs/blobfs.o 00:03:43.728 CC lib/blobfs/tree.o 00:03:43.728 CC lib/lvol/lvol.o 00:03:44.706 LIB libspdk_blobfs.a 00:03:44.706 SO libspdk_blobfs.so.9.0 00:03:44.706 LIB libspdk_lvol.a 00:03:44.706 SYMLINK libspdk_blobfs.so 00:03:44.706 LIB libspdk_bdev.a 00:03:44.706 SO libspdk_lvol.so.9.1 00:03:44.706 SO libspdk_bdev.so.14.0 00:03:44.706 SYMLINK libspdk_lvol.so 00:03:44.706 SYMLINK libspdk_bdev.so 00:03:44.978 CC lib/ublk/ublk.o 00:03:44.978 CC lib/nvmf/ctrlr.o 00:03:44.978 CC lib/ublk/ublk_rpc.o 00:03:44.978 CC lib/scsi/dev.o 00:03:44.978 CC lib/nbd/nbd.o 00:03:44.978 CC lib/ftl/ftl_core.o 00:03:44.978 CC lib/scsi/lun.o 00:03:44.978 CC lib/nbd/nbd_rpc.o 00:03:44.978 CC lib/nvmf/ctrlr_discovery.o 00:03:44.978 CC lib/ftl/ftl_init.o 00:03:44.978 CC lib/ftl/ftl_layout.o 00:03:44.978 CC lib/scsi/port.o 00:03:44.978 CC lib/nvmf/ctrlr_bdev.o 00:03:44.978 CC lib/scsi/scsi.o 00:03:44.978 CC lib/ftl/ftl_debug.o 00:03:44.978 CC lib/ftl/ftl_io.o 00:03:44.978 CC lib/nvmf/subsystem.o 00:03:44.978 CC lib/nvmf/nvmf.o 00:03:44.978 CC lib/scsi/scsi_bdev.o 00:03:44.978 CC lib/scsi/scsi_pr.o 00:03:44.978 CC lib/ftl/ftl_sb.o 00:03:44.978 CC lib/ftl/ftl_l2p.o 00:03:44.978 CC lib/nvmf/nvmf_rpc.o 00:03:44.978 CC lib/scsi/scsi_rpc.o 00:03:44.978 CC lib/ftl/ftl_l2p_flat.o 00:03:44.978 CC lib/ftl/ftl_nv_cache.o 00:03:44.978 CC lib/scsi/task.o 00:03:44.978 CC lib/nvmf/tcp.o 00:03:44.978 CC lib/nvmf/transport.o 00:03:44.978 CC lib/ftl/ftl_band.o 00:03:44.978 CC lib/nvmf/vfio_user.o 00:03:44.978 CC lib/ftl/ftl_band_ops.o 00:03:44.978 CC lib/ftl/ftl_writer.o 00:03:44.978 CC lib/nvmf/rdma.o 00:03:44.978 CC lib/ftl/ftl_rq.o 00:03:44.978 CC lib/ftl/ftl_reloc.o 00:03:44.978 CC lib/ftl/ftl_l2p_cache.o 00:03:44.978 CC lib/ftl/ftl_p2l.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:44.978 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:45.239 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:45.239 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:45.239 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:45.239 CC lib/ftl/utils/ftl_conf.o 00:03:45.239 CC lib/ftl/utils/ftl_md.o 00:03:45.239 CC lib/ftl/utils/ftl_mempool.o 00:03:45.239 CC lib/ftl/utils/ftl_bitmap.o 00:03:45.239 CC lib/ftl/utils/ftl_property.o 00:03:45.239 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:45.239 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:45.239 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:45.239 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:45.239 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:45.239 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:45.498 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:45.498 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:45.498 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:45.498 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:45.498 CC lib/ftl/base/ftl_base_dev.o 00:03:45.498 CC lib/ftl/base/ftl_base_bdev.o 00:03:45.498 CC lib/ftl/ftl_trace.o 00:03:45.756 LIB libspdk_nbd.a 00:03:45.757 SO libspdk_nbd.so.6.0 00:03:45.757 SYMLINK libspdk_nbd.so 00:03:45.757 LIB libspdk_scsi.a 00:03:45.757 SO libspdk_scsi.so.8.0 00:03:46.015 SYMLINK libspdk_scsi.so 00:03:46.015 LIB libspdk_ublk.a 00:03:46.015 SO libspdk_ublk.so.2.0 00:03:46.015 CC lib/iscsi/conn.o 00:03:46.015 CC lib/iscsi/init_grp.o 00:03:46.015 CC lib/iscsi/iscsi.o 00:03:46.015 CC lib/iscsi/md5.o 00:03:46.015 CC lib/iscsi/param.o 00:03:46.015 CC lib/iscsi/portal_grp.o 00:03:46.015 CC lib/vhost/vhost.o 00:03:46.015 CC lib/iscsi/tgt_node.o 00:03:46.015 CC lib/iscsi/iscsi_subsystem.o 00:03:46.015 CC lib/vhost/vhost_rpc.o 00:03:46.015 CC lib/iscsi/iscsi_rpc.o 00:03:46.015 CC lib/vhost/vhost_scsi.o 00:03:46.015 CC lib/iscsi/task.o 00:03:46.015 CC lib/vhost/vhost_blk.o 00:03:46.015 CC lib/vhost/rte_vhost_user.o 00:03:46.015 SYMLINK libspdk_ublk.so 00:03:46.274 LIB libspdk_ftl.a 00:03:46.533 SO libspdk_ftl.so.8.0 00:03:46.792 SYMLINK libspdk_ftl.so 00:03:47.359 LIB libspdk_vhost.a 00:03:47.359 SO libspdk_vhost.so.7.1 00:03:47.359 LIB libspdk_nvmf.a 00:03:47.359 SYMLINK libspdk_vhost.so 00:03:47.359 SO libspdk_nvmf.so.17.0 00:03:47.359 LIB libspdk_iscsi.a 00:03:47.617 SO libspdk_iscsi.so.7.0 00:03:47.617 SYMLINK libspdk_nvmf.so 00:03:47.617 SYMLINK libspdk_iscsi.so 00:03:47.877 CC module/env_dpdk/env_dpdk_rpc.o 00:03:47.877 CC module/vfu_device/vfu_virtio.o 00:03:47.877 CC module/vfu_device/vfu_virtio_blk.o 00:03:47.877 CC module/vfu_device/vfu_virtio_scsi.o 00:03:47.877 CC module/vfu_device/vfu_virtio_rpc.o 00:03:47.877 CC module/accel/ioat/accel_ioat.o 00:03:47.877 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:47.877 CC module/sock/posix/posix.o 00:03:47.877 CC module/accel/error/accel_error.o 00:03:47.877 CC module/scheduler/gscheduler/gscheduler.o 00:03:47.877 CC module/accel/dsa/accel_dsa.o 00:03:47.877 CC module/accel/error/accel_error_rpc.o 00:03:47.877 CC module/accel/ioat/accel_ioat_rpc.o 00:03:47.877 CC module/accel/dsa/accel_dsa_rpc.o 00:03:47.877 CC module/accel/iaa/accel_iaa.o 00:03:47.877 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:47.877 CC module/blob/bdev/blob_bdev.o 00:03:47.877 CC module/accel/iaa/accel_iaa_rpc.o 00:03:47.877 LIB libspdk_env_dpdk_rpc.a 00:03:48.135 SO libspdk_env_dpdk_rpc.so.5.0 00:03:48.135 SYMLINK libspdk_env_dpdk_rpc.so 00:03:48.135 LIB libspdk_scheduler_gscheduler.a 00:03:48.135 LIB libspdk_scheduler_dpdk_governor.a 00:03:48.135 SO libspdk_scheduler_gscheduler.so.3.0 00:03:48.135 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:48.135 LIB libspdk_accel_error.a 00:03:48.135 LIB libspdk_accel_ioat.a 00:03:48.135 LIB libspdk_scheduler_dynamic.a 00:03:48.135 SO libspdk_accel_error.so.1.0 00:03:48.135 SO libspdk_scheduler_dynamic.so.3.0 00:03:48.135 LIB libspdk_accel_iaa.a 00:03:48.135 SYMLINK libspdk_scheduler_gscheduler.so 00:03:48.135 SO libspdk_accel_ioat.so.5.0 00:03:48.135 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:48.135 SO libspdk_accel_iaa.so.2.0 00:03:48.135 LIB libspdk_accel_dsa.a 00:03:48.135 SYMLINK libspdk_scheduler_dynamic.so 00:03:48.135 SYMLINK libspdk_accel_error.so 00:03:48.135 SYMLINK libspdk_accel_ioat.so 00:03:48.135 SO libspdk_accel_dsa.so.4.0 00:03:48.135 LIB libspdk_blob_bdev.a 00:03:48.135 SYMLINK libspdk_accel_iaa.so 00:03:48.135 SO libspdk_blob_bdev.so.10.1 00:03:48.135 SYMLINK libspdk_accel_dsa.so 00:03:48.398 SYMLINK libspdk_blob_bdev.so 00:03:48.398 CC module/bdev/nvme/bdev_nvme.o 00:03:48.398 CC module/bdev/lvol/vbdev_lvol.o 00:03:48.398 CC module/blobfs/bdev/blobfs_bdev.o 00:03:48.398 CC module/bdev/error/vbdev_error.o 00:03:48.398 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:48.398 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:48.398 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:48.398 CC module/bdev/nvme/nvme_rpc.o 00:03:48.398 CC module/bdev/error/vbdev_error_rpc.o 00:03:48.398 CC module/bdev/gpt/gpt.o 00:03:48.398 CC module/bdev/nvme/bdev_mdns_client.o 00:03:48.398 CC module/bdev/malloc/bdev_malloc.o 00:03:48.398 CC module/bdev/delay/vbdev_delay.o 00:03:48.398 CC module/bdev/gpt/vbdev_gpt.o 00:03:48.398 CC module/bdev/nvme/vbdev_opal.o 00:03:48.398 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:48.398 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:48.398 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:48.398 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:48.398 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:48.398 CC module/bdev/ftl/bdev_ftl.o 00:03:48.398 CC module/bdev/passthru/vbdev_passthru.o 00:03:48.398 CC module/bdev/raid/bdev_raid.o 00:03:48.398 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:48.398 CC module/bdev/split/vbdev_split.o 00:03:48.398 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:48.398 CC module/bdev/raid/bdev_raid_rpc.o 00:03:48.398 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:48.398 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:48.398 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:48.398 CC module/bdev/split/vbdev_split_rpc.o 00:03:48.398 CC module/bdev/raid/bdev_raid_sb.o 00:03:48.398 CC module/bdev/null/bdev_null.o 00:03:48.398 CC module/bdev/raid/raid0.o 00:03:48.398 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:48.398 CC module/bdev/null/bdev_null_rpc.o 00:03:48.398 CC module/bdev/aio/bdev_aio.o 00:03:48.398 CC module/bdev/raid/raid1.o 00:03:48.398 CC module/bdev/iscsi/bdev_iscsi.o 00:03:48.398 CC module/bdev/aio/bdev_aio_rpc.o 00:03:48.398 CC module/bdev/raid/concat.o 00:03:48.398 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:48.657 LIB libspdk_vfu_device.a 00:03:48.657 SO libspdk_vfu_device.so.2.0 00:03:48.657 SYMLINK libspdk_vfu_device.so 00:03:48.916 LIB libspdk_blobfs_bdev.a 00:03:48.916 SO libspdk_blobfs_bdev.so.5.0 00:03:48.916 LIB libspdk_sock_posix.a 00:03:48.916 LIB libspdk_bdev_ftl.a 00:03:48.916 SYMLINK libspdk_blobfs_bdev.so 00:03:48.916 SO libspdk_sock_posix.so.5.0 00:03:48.916 LIB libspdk_bdev_passthru.a 00:03:48.916 LIB libspdk_bdev_split.a 00:03:48.916 SO libspdk_bdev_ftl.so.5.0 00:03:48.916 SO libspdk_bdev_split.so.5.0 00:03:48.916 SO libspdk_bdev_passthru.so.5.0 00:03:48.916 LIB libspdk_bdev_null.a 00:03:48.916 SYMLINK libspdk_sock_posix.so 00:03:48.916 SO libspdk_bdev_null.so.5.0 00:03:48.916 LIB libspdk_bdev_error.a 00:03:48.916 SYMLINK libspdk_bdev_ftl.so 00:03:48.916 LIB libspdk_bdev_gpt.a 00:03:48.916 LIB libspdk_bdev_zone_block.a 00:03:48.916 SYMLINK libspdk_bdev_passthru.so 00:03:48.916 SYMLINK libspdk_bdev_split.so 00:03:48.916 SO libspdk_bdev_error.so.5.0 00:03:48.916 SO libspdk_bdev_gpt.so.5.0 00:03:48.916 SO libspdk_bdev_zone_block.so.5.0 00:03:48.916 LIB libspdk_bdev_malloc.a 00:03:48.916 SYMLINK libspdk_bdev_null.so 00:03:48.916 LIB libspdk_bdev_aio.a 00:03:48.916 LIB libspdk_bdev_delay.a 00:03:48.916 SO libspdk_bdev_malloc.so.5.0 00:03:48.916 SYMLINK libspdk_bdev_error.so 00:03:48.916 SYMLINK libspdk_bdev_gpt.so 00:03:48.916 SO libspdk_bdev_aio.so.5.0 00:03:48.916 LIB libspdk_bdev_iscsi.a 00:03:48.916 SO libspdk_bdev_delay.so.5.0 00:03:48.916 SYMLINK libspdk_bdev_zone_block.so 00:03:49.175 SO libspdk_bdev_iscsi.so.5.0 00:03:49.175 SYMLINK libspdk_bdev_malloc.so 00:03:49.175 SYMLINK libspdk_bdev_delay.so 00:03:49.175 SYMLINK libspdk_bdev_aio.so 00:03:49.175 SYMLINK libspdk_bdev_iscsi.so 00:03:49.175 LIB libspdk_bdev_lvol.a 00:03:49.175 LIB libspdk_bdev_virtio.a 00:03:49.175 SO libspdk_bdev_lvol.so.5.0 00:03:49.175 SO libspdk_bdev_virtio.so.5.0 00:03:49.175 SYMLINK libspdk_bdev_lvol.so 00:03:49.175 SYMLINK libspdk_bdev_virtio.so 00:03:49.434 LIB libspdk_bdev_raid.a 00:03:49.434 SO libspdk_bdev_raid.so.5.0 00:03:49.692 SYMLINK libspdk_bdev_raid.so 00:03:50.627 LIB libspdk_bdev_nvme.a 00:03:50.627 SO libspdk_bdev_nvme.so.6.0 00:03:50.884 SYMLINK libspdk_bdev_nvme.so 00:03:51.143 CC module/event/subsystems/iobuf/iobuf.o 00:03:51.143 CC module/event/subsystems/vmd/vmd.o 00:03:51.143 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:51.143 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:51.143 CC module/event/subsystems/scheduler/scheduler.o 00:03:51.143 CC module/event/subsystems/sock/sock.o 00:03:51.143 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:51.143 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:51.143 LIB libspdk_event_sock.a 00:03:51.143 LIB libspdk_event_vhost_blk.a 00:03:51.143 LIB libspdk_event_vmd.a 00:03:51.143 LIB libspdk_event_scheduler.a 00:03:51.143 LIB libspdk_event_vfu_tgt.a 00:03:51.143 SO libspdk_event_sock.so.4.0 00:03:51.143 LIB libspdk_event_iobuf.a 00:03:51.143 SO libspdk_event_scheduler.so.3.0 00:03:51.143 SO libspdk_event_vhost_blk.so.2.0 00:03:51.143 SO libspdk_event_vfu_tgt.so.2.0 00:03:51.143 SO libspdk_event_vmd.so.5.0 00:03:51.143 SO libspdk_event_iobuf.so.2.0 00:03:51.143 SYMLINK libspdk_event_sock.so 00:03:51.143 SYMLINK libspdk_event_vfu_tgt.so 00:03:51.143 SYMLINK libspdk_event_scheduler.so 00:03:51.143 SYMLINK libspdk_event_vhost_blk.so 00:03:51.143 SYMLINK libspdk_event_vmd.so 00:03:51.143 SYMLINK libspdk_event_iobuf.so 00:03:51.401 CC module/event/subsystems/accel/accel.o 00:03:51.401 LIB libspdk_event_accel.a 00:03:51.658 SO libspdk_event_accel.so.5.0 00:03:51.658 SYMLINK libspdk_event_accel.so 00:03:51.658 CC module/event/subsystems/bdev/bdev.o 00:03:51.917 LIB libspdk_event_bdev.a 00:03:51.917 SO libspdk_event_bdev.so.5.0 00:03:51.917 SYMLINK libspdk_event_bdev.so 00:03:52.175 CC module/event/subsystems/scsi/scsi.o 00:03:52.175 CC module/event/subsystems/nbd/nbd.o 00:03:52.175 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:52.175 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:52.176 CC module/event/subsystems/ublk/ublk.o 00:03:52.176 LIB libspdk_event_nbd.a 00:03:52.176 LIB libspdk_event_ublk.a 00:03:52.176 LIB libspdk_event_scsi.a 00:03:52.176 SO libspdk_event_nbd.so.5.0 00:03:52.176 SO libspdk_event_ublk.so.2.0 00:03:52.176 SO libspdk_event_scsi.so.5.0 00:03:52.176 SYMLINK libspdk_event_nbd.so 00:03:52.176 SYMLINK libspdk_event_ublk.so 00:03:52.176 SYMLINK libspdk_event_scsi.so 00:03:52.176 LIB libspdk_event_nvmf.a 00:03:52.434 SO libspdk_event_nvmf.so.5.0 00:03:52.434 SYMLINK libspdk_event_nvmf.so 00:03:52.434 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:52.434 CC module/event/subsystems/iscsi/iscsi.o 00:03:52.434 LIB libspdk_event_vhost_scsi.a 00:03:52.434 LIB libspdk_event_iscsi.a 00:03:52.692 SO libspdk_event_vhost_scsi.so.2.0 00:03:52.692 SO libspdk_event_iscsi.so.5.0 00:03:52.692 SYMLINK libspdk_event_vhost_scsi.so 00:03:52.692 SYMLINK libspdk_event_iscsi.so 00:03:52.692 SO libspdk.so.5.0 00:03:52.692 SYMLINK libspdk.so 00:03:52.955 CC app/trace_record/trace_record.o 00:03:52.955 CC app/spdk_lspci/spdk_lspci.o 00:03:52.955 CC app/spdk_top/spdk_top.o 00:03:52.955 CXX app/trace/trace.o 00:03:52.955 CC app/spdk_nvme_identify/identify.o 00:03:52.955 CC app/spdk_nvme_discover/discovery_aer.o 00:03:52.955 CC app/spdk_nvme_perf/perf.o 00:03:52.955 TEST_HEADER include/spdk/accel.h 00:03:52.955 TEST_HEADER include/spdk/accel_module.h 00:03:52.955 CC test/rpc_client/rpc_client_test.o 00:03:52.955 TEST_HEADER include/spdk/assert.h 00:03:52.955 TEST_HEADER include/spdk/barrier.h 00:03:52.955 TEST_HEADER include/spdk/base64.h 00:03:52.955 TEST_HEADER include/spdk/bdev.h 00:03:52.955 TEST_HEADER include/spdk/bdev_module.h 00:03:52.955 TEST_HEADER include/spdk/bdev_zone.h 00:03:52.955 TEST_HEADER include/spdk/bit_array.h 00:03:52.955 TEST_HEADER include/spdk/bit_pool.h 00:03:52.955 TEST_HEADER include/spdk/blob_bdev.h 00:03:52.955 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:52.955 TEST_HEADER include/spdk/blobfs.h 00:03:52.955 TEST_HEADER include/spdk/blob.h 00:03:52.955 TEST_HEADER include/spdk/conf.h 00:03:52.955 TEST_HEADER include/spdk/config.h 00:03:52.955 TEST_HEADER include/spdk/cpuset.h 00:03:52.955 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:52.955 CC app/spdk_dd/spdk_dd.o 00:03:52.955 TEST_HEADER include/spdk/crc16.h 00:03:52.955 TEST_HEADER include/spdk/crc32.h 00:03:52.955 CC app/nvmf_tgt/nvmf_main.o 00:03:52.955 TEST_HEADER include/spdk/crc64.h 00:03:52.955 TEST_HEADER include/spdk/dif.h 00:03:52.955 CC app/iscsi_tgt/iscsi_tgt.o 00:03:52.955 TEST_HEADER include/spdk/dma.h 00:03:52.955 CC examples/ioat/perf/perf.o 00:03:52.955 CC app/vhost/vhost.o 00:03:52.955 CC examples/vmd/led/led.o 00:03:52.955 TEST_HEADER include/spdk/endian.h 00:03:52.955 CC examples/nvme/reconnect/reconnect.o 00:03:52.955 TEST_HEADER include/spdk/env_dpdk.h 00:03:52.955 CC examples/nvme/arbitration/arbitration.o 00:03:52.955 CC examples/vmd/lsvmd/lsvmd.o 00:03:52.955 CC examples/ioat/verify/verify.o 00:03:52.956 TEST_HEADER include/spdk/env.h 00:03:52.956 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:52.956 CC examples/nvme/hotplug/hotplug.o 00:03:52.956 TEST_HEADER include/spdk/event.h 00:03:52.956 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:52.956 CC examples/util/zipf/zipf.o 00:03:52.956 TEST_HEADER include/spdk/fd_group.h 00:03:52.956 CC examples/sock/hello_world/hello_sock.o 00:03:52.956 CC app/fio/nvme/fio_plugin.o 00:03:52.956 CC examples/nvme/abort/abort.o 00:03:52.956 TEST_HEADER include/spdk/fd.h 00:03:52.956 CC examples/idxd/perf/perf.o 00:03:52.956 CC examples/nvme/hello_world/hello_world.o 00:03:52.956 TEST_HEADER include/spdk/file.h 00:03:52.956 CC examples/accel/perf/accel_perf.o 00:03:52.956 CC test/event/event_perf/event_perf.o 00:03:52.956 TEST_HEADER include/spdk/ftl.h 00:03:52.956 TEST_HEADER include/spdk/gpt_spec.h 00:03:52.956 TEST_HEADER include/spdk/hexlify.h 00:03:52.956 TEST_HEADER include/spdk/histogram_data.h 00:03:52.956 CC test/nvme/aer/aer.o 00:03:52.956 CC test/thread/poller_perf/poller_perf.o 00:03:52.956 TEST_HEADER include/spdk/idxd.h 00:03:52.956 TEST_HEADER include/spdk/idxd_spec.h 00:03:52.956 CC app/spdk_tgt/spdk_tgt.o 00:03:52.956 TEST_HEADER include/spdk/init.h 00:03:52.956 TEST_HEADER include/spdk/ioat.h 00:03:52.956 TEST_HEADER include/spdk/ioat_spec.h 00:03:52.956 TEST_HEADER include/spdk/iscsi_spec.h 00:03:52.956 TEST_HEADER include/spdk/json.h 00:03:52.956 TEST_HEADER include/spdk/jsonrpc.h 00:03:52.956 TEST_HEADER include/spdk/likely.h 00:03:52.956 TEST_HEADER include/spdk/log.h 00:03:52.956 TEST_HEADER include/spdk/lvol.h 00:03:52.956 CC test/accel/dif/dif.o 00:03:52.956 CC examples/blob/cli/blobcli.o 00:03:52.956 TEST_HEADER include/spdk/memory.h 00:03:52.956 CC examples/thread/thread/thread_ex.o 00:03:52.956 TEST_HEADER include/spdk/mmio.h 00:03:52.956 TEST_HEADER include/spdk/nbd.h 00:03:52.956 CC examples/bdev/bdevperf/bdevperf.o 00:03:52.956 CC examples/blob/hello_world/hello_blob.o 00:03:52.956 TEST_HEADER include/spdk/notify.h 00:03:52.956 TEST_HEADER include/spdk/nvme.h 00:03:52.956 CC test/blobfs/mkfs/mkfs.o 00:03:52.956 CC examples/bdev/hello_world/hello_bdev.o 00:03:52.956 CC examples/nvmf/nvmf/nvmf.o 00:03:52.956 CC test/bdev/bdevio/bdevio.o 00:03:52.956 TEST_HEADER include/spdk/nvme_intel.h 00:03:52.956 CC test/dma/test_dma/test_dma.o 00:03:52.956 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:52.956 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:52.956 TEST_HEADER include/spdk/nvme_spec.h 00:03:52.956 CC test/app/bdev_svc/bdev_svc.o 00:03:52.956 TEST_HEADER include/spdk/nvme_zns.h 00:03:52.956 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:52.956 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:52.956 TEST_HEADER include/spdk/nvmf.h 00:03:52.956 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:52.956 CC test/env/mem_callbacks/mem_callbacks.o 00:03:52.956 TEST_HEADER include/spdk/nvmf_spec.h 00:03:52.956 TEST_HEADER include/spdk/nvmf_transport.h 00:03:53.219 TEST_HEADER include/spdk/opal.h 00:03:53.219 TEST_HEADER include/spdk/opal_spec.h 00:03:53.219 TEST_HEADER include/spdk/pci_ids.h 00:03:53.219 TEST_HEADER include/spdk/pipe.h 00:03:53.219 CC test/lvol/esnap/esnap.o 00:03:53.219 TEST_HEADER include/spdk/queue.h 00:03:53.219 TEST_HEADER include/spdk/reduce.h 00:03:53.219 TEST_HEADER include/spdk/rpc.h 00:03:53.219 TEST_HEADER include/spdk/scheduler.h 00:03:53.219 TEST_HEADER include/spdk/scsi.h 00:03:53.219 TEST_HEADER include/spdk/scsi_spec.h 00:03:53.219 TEST_HEADER include/spdk/sock.h 00:03:53.219 TEST_HEADER include/spdk/stdinc.h 00:03:53.219 TEST_HEADER include/spdk/string.h 00:03:53.219 TEST_HEADER include/spdk/thread.h 00:03:53.219 TEST_HEADER include/spdk/trace.h 00:03:53.219 TEST_HEADER include/spdk/trace_parser.h 00:03:53.219 TEST_HEADER include/spdk/tree.h 00:03:53.219 TEST_HEADER include/spdk/ublk.h 00:03:53.219 TEST_HEADER include/spdk/util.h 00:03:53.219 LINK spdk_lspci 00:03:53.219 TEST_HEADER include/spdk/uuid.h 00:03:53.219 TEST_HEADER include/spdk/version.h 00:03:53.219 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:53.219 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:53.219 TEST_HEADER include/spdk/vhost.h 00:03:53.219 TEST_HEADER include/spdk/vmd.h 00:03:53.219 TEST_HEADER include/spdk/xor.h 00:03:53.220 TEST_HEADER include/spdk/zipf.h 00:03:53.220 CXX test/cpp_headers/accel.o 00:03:53.220 LINK lsvmd 00:03:53.220 LINK rpc_client_test 00:03:53.220 LINK led 00:03:53.220 LINK event_perf 00:03:53.220 LINK poller_perf 00:03:53.220 LINK spdk_nvme_discover 00:03:53.220 LINK zipf 00:03:53.220 LINK interrupt_tgt 00:03:53.220 LINK nvmf_tgt 00:03:53.487 LINK cmb_copy 00:03:53.487 LINK vhost 00:03:53.487 LINK spdk_trace_record 00:03:53.487 LINK iscsi_tgt 00:03:53.487 LINK verify 00:03:53.487 LINK ioat_perf 00:03:53.487 LINK spdk_tgt 00:03:53.487 LINK hello_world 00:03:53.487 LINK bdev_svc 00:03:53.487 LINK hotplug 00:03:53.487 LINK mkfs 00:03:53.487 CXX test/cpp_headers/accel_module.o 00:03:53.487 LINK hello_sock 00:03:53.487 LINK mem_callbacks 00:03:53.487 LINK hello_blob 00:03:53.487 LINK hello_bdev 00:03:53.487 LINK thread 00:03:53.487 LINK aer 00:03:53.487 CXX test/cpp_headers/assert.o 00:03:53.753 LINK arbitration 00:03:53.753 LINK idxd_perf 00:03:53.753 LINK nvmf 00:03:53.753 LINK reconnect 00:03:53.753 LINK spdk_dd 00:03:53.753 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:53.753 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:53.753 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:53.753 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:53.753 LINK abort 00:03:53.753 CC test/event/reactor/reactor.o 00:03:53.753 CXX test/cpp_headers/barrier.o 00:03:53.753 CC test/app/histogram_perf/histogram_perf.o 00:03:53.753 LINK spdk_trace 00:03:53.753 CC test/env/vtophys/vtophys.o 00:03:53.753 CC test/app/jsoncat/jsoncat.o 00:03:53.753 LINK dif 00:03:53.753 CXX test/cpp_headers/base64.o 00:03:53.753 CC test/nvme/reset/reset.o 00:03:53.753 CC test/app/stub/stub.o 00:03:53.753 LINK test_dma 00:03:53.753 LINK bdevio 00:03:53.753 CC test/nvme/sgl/sgl.o 00:03:53.753 CC test/event/reactor_perf/reactor_perf.o 00:03:53.753 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:53.753 CXX test/cpp_headers/bdev.o 00:03:53.753 CXX test/cpp_headers/bdev_module.o 00:03:54.017 LINK nvme_fuzz 00:03:54.017 LINK accel_perf 00:03:54.017 CC app/fio/bdev/fio_plugin.o 00:03:54.017 CC test/env/memory/memory_ut.o 00:03:54.017 LINK nvme_manage 00:03:54.017 CC test/event/app_repeat/app_repeat.o 00:03:54.017 CXX test/cpp_headers/bdev_zone.o 00:03:54.017 CC test/nvme/e2edp/nvme_dp.o 00:03:54.017 CC test/env/pci/pci_ut.o 00:03:54.017 CC test/event/scheduler/scheduler.o 00:03:54.017 CC test/nvme/overhead/overhead.o 00:03:54.017 LINK reactor 00:03:54.017 LINK blobcli 00:03:54.017 LINK spdk_nvme 00:03:54.017 LINK pmr_persistence 00:03:54.017 LINK histogram_perf 00:03:54.017 LINK vtophys 00:03:54.017 CC test/nvme/err_injection/err_injection.o 00:03:54.017 CC test/nvme/startup/startup.o 00:03:54.017 CXX test/cpp_headers/bit_array.o 00:03:54.017 LINK jsoncat 00:03:54.017 CXX test/cpp_headers/bit_pool.o 00:03:54.017 CC test/nvme/simple_copy/simple_copy.o 00:03:54.017 CC test/nvme/connect_stress/connect_stress.o 00:03:54.017 CC test/nvme/reserve/reserve.o 00:03:54.017 CXX test/cpp_headers/blob_bdev.o 00:03:54.017 CC test/nvme/boot_partition/boot_partition.o 00:03:54.017 CC test/nvme/compliance/nvme_compliance.o 00:03:54.017 CXX test/cpp_headers/blobfs_bdev.o 00:03:54.017 CC test/nvme/fused_ordering/fused_ordering.o 00:03:54.280 LINK reactor_perf 00:03:54.280 CXX test/cpp_headers/blobfs.o 00:03:54.280 LINK stub 00:03:54.280 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:54.280 LINK env_dpdk_post_init 00:03:54.280 CXX test/cpp_headers/blob.o 00:03:54.280 CXX test/cpp_headers/conf.o 00:03:54.280 CXX test/cpp_headers/config.o 00:03:54.280 CXX test/cpp_headers/cpuset.o 00:03:54.280 LINK app_repeat 00:03:54.280 CXX test/cpp_headers/crc16.o 00:03:54.280 CXX test/cpp_headers/crc32.o 00:03:54.280 CC test/nvme/fdp/fdp.o 00:03:54.280 CC test/nvme/cuse/cuse.o 00:03:54.280 LINK reset 00:03:54.280 CXX test/cpp_headers/crc64.o 00:03:54.280 CXX test/cpp_headers/dif.o 00:03:54.280 CXX test/cpp_headers/dma.o 00:03:54.280 CXX test/cpp_headers/endian.o 00:03:54.280 CXX test/cpp_headers/env_dpdk.o 00:03:54.280 CXX test/cpp_headers/env.o 00:03:54.280 LINK sgl 00:03:54.280 CXX test/cpp_headers/event.o 00:03:54.280 CXX test/cpp_headers/fd_group.o 00:03:54.280 CXX test/cpp_headers/fd.o 00:03:54.280 LINK spdk_nvme_perf 00:03:54.546 LINK startup 00:03:54.546 CXX test/cpp_headers/file.o 00:03:54.546 LINK err_injection 00:03:54.546 LINK connect_stress 00:03:54.546 LINK boot_partition 00:03:54.546 CXX test/cpp_headers/ftl.o 00:03:54.546 LINK scheduler 00:03:54.546 LINK vhost_fuzz 00:03:54.546 CXX test/cpp_headers/gpt_spec.o 00:03:54.546 CXX test/cpp_headers/hexlify.o 00:03:54.547 CXX test/cpp_headers/histogram_data.o 00:03:54.547 LINK reserve 00:03:54.547 LINK bdevperf 00:03:54.547 LINK nvme_dp 00:03:54.547 CXX test/cpp_headers/idxd.o 00:03:54.547 CXX test/cpp_headers/idxd_spec.o 00:03:54.547 LINK simple_copy 00:03:54.547 CXX test/cpp_headers/init.o 00:03:54.547 LINK fused_ordering 00:03:54.547 LINK doorbell_aers 00:03:54.547 LINK spdk_nvme_identify 00:03:54.547 LINK spdk_top 00:03:54.547 CXX test/cpp_headers/ioat.o 00:03:54.547 LINK overhead 00:03:54.547 CXX test/cpp_headers/ioat_spec.o 00:03:54.547 CXX test/cpp_headers/iscsi_spec.o 00:03:54.547 CXX test/cpp_headers/json.o 00:03:54.547 CXX test/cpp_headers/jsonrpc.o 00:03:54.547 CXX test/cpp_headers/likely.o 00:03:54.809 CXX test/cpp_headers/log.o 00:03:54.809 CXX test/cpp_headers/lvol.o 00:03:54.809 CXX test/cpp_headers/memory.o 00:03:54.809 CXX test/cpp_headers/mmio.o 00:03:54.809 CXX test/cpp_headers/nbd.o 00:03:54.809 LINK pci_ut 00:03:54.809 CXX test/cpp_headers/notify.o 00:03:54.809 LINK nvme_compliance 00:03:54.809 CXX test/cpp_headers/nvme.o 00:03:54.809 CXX test/cpp_headers/nvme_intel.o 00:03:54.809 CXX test/cpp_headers/nvme_ocssd.o 00:03:54.809 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:54.809 CXX test/cpp_headers/nvme_spec.o 00:03:54.809 CXX test/cpp_headers/nvme_zns.o 00:03:54.809 CXX test/cpp_headers/nvmf_cmd.o 00:03:54.809 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:54.809 CXX test/cpp_headers/nvmf.o 00:03:54.809 CXX test/cpp_headers/nvmf_spec.o 00:03:54.809 CXX test/cpp_headers/nvmf_transport.o 00:03:54.809 CXX test/cpp_headers/opal.o 00:03:54.809 CXX test/cpp_headers/opal_spec.o 00:03:54.809 CXX test/cpp_headers/pci_ids.o 00:03:54.809 CXX test/cpp_headers/pipe.o 00:03:54.809 CXX test/cpp_headers/queue.o 00:03:54.809 CXX test/cpp_headers/reduce.o 00:03:54.809 LINK memory_ut 00:03:54.809 CXX test/cpp_headers/rpc.o 00:03:54.809 CXX test/cpp_headers/scheduler.o 00:03:54.809 CXX test/cpp_headers/scsi.o 00:03:54.809 CXX test/cpp_headers/scsi_spec.o 00:03:54.809 LINK spdk_bdev 00:03:54.809 CXX test/cpp_headers/sock.o 00:03:54.809 CXX test/cpp_headers/stdinc.o 00:03:54.809 CXX test/cpp_headers/string.o 00:03:54.809 CXX test/cpp_headers/trace.o 00:03:54.809 CXX test/cpp_headers/thread.o 00:03:54.809 CXX test/cpp_headers/trace_parser.o 00:03:54.809 CXX test/cpp_headers/tree.o 00:03:54.809 CXX test/cpp_headers/ublk.o 00:03:54.809 CXX test/cpp_headers/util.o 00:03:54.809 CXX test/cpp_headers/uuid.o 00:03:54.809 LINK fdp 00:03:55.070 CXX test/cpp_headers/version.o 00:03:55.070 CXX test/cpp_headers/vfio_user_pci.o 00:03:55.070 CXX test/cpp_headers/vfio_user_spec.o 00:03:55.070 CXX test/cpp_headers/vhost.o 00:03:55.070 CXX test/cpp_headers/vmd.o 00:03:55.070 CXX test/cpp_headers/xor.o 00:03:55.070 CXX test/cpp_headers/zipf.o 00:03:56.006 LINK cuse 00:03:56.006 LINK iscsi_fuzz 00:03:58.538 LINK esnap 00:03:58.798 00:03:58.798 real 0m37.736s 00:03:58.798 user 7m15.638s 00:03:58.798 sys 1m38.296s 00:03:58.798 16:56:55 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:58.798 16:56:55 -- common/autotest_common.sh@10 -- $ set +x 00:03:58.798 ************************************ 00:03:58.798 END TEST make 00:03:58.798 ************************************ 00:03:58.798 16:56:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:58.798 16:56:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:58.798 16:56:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:59.057 16:56:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:59.057 16:56:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:59.057 16:56:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:59.057 16:56:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:59.057 16:56:55 -- scripts/common.sh@335 -- # IFS=.-: 00:03:59.057 16:56:55 -- scripts/common.sh@335 -- # read -ra ver1 00:03:59.057 16:56:55 -- scripts/common.sh@336 -- # IFS=.-: 00:03:59.057 16:56:55 -- scripts/common.sh@336 -- # read -ra ver2 00:03:59.057 16:56:55 -- scripts/common.sh@337 -- # local 'op=<' 00:03:59.057 16:56:55 -- scripts/common.sh@339 -- # ver1_l=2 00:03:59.057 16:56:55 -- scripts/common.sh@340 -- # ver2_l=1 00:03:59.057 16:56:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:59.057 16:56:55 -- scripts/common.sh@343 -- # case "$op" in 00:03:59.057 16:56:55 -- scripts/common.sh@344 -- # : 1 00:03:59.057 16:56:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:59.057 16:56:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:59.057 16:56:55 -- scripts/common.sh@364 -- # decimal 1 00:03:59.057 16:56:55 -- scripts/common.sh@352 -- # local d=1 00:03:59.057 16:56:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:59.057 16:56:55 -- scripts/common.sh@354 -- # echo 1 00:03:59.057 16:56:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:59.057 16:56:55 -- scripts/common.sh@365 -- # decimal 2 00:03:59.057 16:56:55 -- scripts/common.sh@352 -- # local d=2 00:03:59.057 16:56:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:59.057 16:56:55 -- scripts/common.sh@354 -- # echo 2 00:03:59.057 16:56:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:59.057 16:56:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:59.057 16:56:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:59.057 16:56:55 -- scripts/common.sh@367 -- # return 0 00:03:59.057 16:56:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:59.057 16:56:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:59.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.057 --rc genhtml_branch_coverage=1 00:03:59.057 --rc genhtml_function_coverage=1 00:03:59.057 --rc genhtml_legend=1 00:03:59.057 --rc geninfo_all_blocks=1 00:03:59.057 --rc geninfo_unexecuted_blocks=1 00:03:59.057 00:03:59.057 ' 00:03:59.057 16:56:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:59.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.057 --rc genhtml_branch_coverage=1 00:03:59.057 --rc genhtml_function_coverage=1 00:03:59.057 --rc genhtml_legend=1 00:03:59.057 --rc geninfo_all_blocks=1 00:03:59.057 --rc geninfo_unexecuted_blocks=1 00:03:59.057 00:03:59.057 ' 00:03:59.057 16:56:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:59.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.057 --rc genhtml_branch_coverage=1 00:03:59.057 --rc genhtml_function_coverage=1 00:03:59.057 --rc genhtml_legend=1 00:03:59.057 --rc geninfo_all_blocks=1 00:03:59.057 --rc geninfo_unexecuted_blocks=1 00:03:59.057 00:03:59.057 ' 00:03:59.057 16:56:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:59.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.057 --rc genhtml_branch_coverage=1 00:03:59.057 --rc genhtml_function_coverage=1 00:03:59.057 --rc genhtml_legend=1 00:03:59.057 --rc geninfo_all_blocks=1 00:03:59.057 --rc geninfo_unexecuted_blocks=1 00:03:59.057 00:03:59.057 ' 00:03:59.057 16:56:55 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:59.057 16:56:55 -- nvmf/common.sh@7 -- # uname -s 00:03:59.057 16:56:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:59.057 16:56:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:59.057 16:56:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:59.057 16:56:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:59.057 16:56:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:59.057 16:56:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:59.057 16:56:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:59.057 16:56:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:59.057 16:56:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:59.057 16:56:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:59.057 16:56:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:59.057 16:56:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:59.057 16:56:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:59.057 16:56:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:59.057 16:56:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:59.057 16:56:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:59.057 16:56:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:59.057 16:56:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:59.057 16:56:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:59.057 16:56:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.057 16:56:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.057 16:56:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.057 16:56:55 -- paths/export.sh@5 -- # export PATH 00:03:59.057 16:56:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.057 16:56:55 -- nvmf/common.sh@46 -- # : 0 00:03:59.057 16:56:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:59.057 16:56:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:59.057 16:56:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:59.057 16:56:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:59.057 16:56:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:59.057 16:56:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:59.057 16:56:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:59.057 16:56:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:59.057 16:56:55 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:59.057 16:56:55 -- spdk/autotest.sh@32 -- # uname -s 00:03:59.057 16:56:55 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:59.057 16:56:55 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:59.057 16:56:55 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:59.057 16:56:55 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:59.057 16:56:55 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:59.057 16:56:55 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:59.057 16:56:55 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:59.057 16:56:55 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:59.057 16:56:55 -- spdk/autotest.sh@48 -- # udevadm_pid=1586366 00:03:59.057 16:56:55 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:59.057 16:56:55 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:59.057 16:56:55 -- spdk/autotest.sh@54 -- # echo 1586368 00:03:59.057 16:56:55 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:59.057 16:56:55 -- spdk/autotest.sh@56 -- # echo 1586369 00:03:59.057 16:56:55 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:59.057 16:56:55 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:59.057 16:56:55 -- spdk/autotest.sh@60 -- # echo 1586370 00:03:59.057 16:56:55 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:59.057 16:56:55 -- spdk/autotest.sh@62 -- # echo 1586371 00:03:59.057 16:56:55 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:59.057 16:56:55 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:59.057 16:56:55 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:59.057 16:56:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:59.057 16:56:55 -- common/autotest_common.sh@10 -- # set +x 00:03:59.057 16:56:55 -- spdk/autotest.sh@70 -- # create_test_list 00:03:59.057 16:56:55 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:59.057 16:56:55 -- common/autotest_common.sh@10 -- # set +x 00:03:59.057 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:59.057 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:59.057 16:56:55 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:59.057 16:56:55 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:59.057 16:56:55 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:59.057 16:56:55 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:59.057 16:56:55 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:59.057 16:56:55 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:59.057 16:56:55 -- common/autotest_common.sh@1450 -- # uname 00:03:59.057 16:56:55 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:59.057 16:56:55 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:59.057 16:56:55 -- common/autotest_common.sh@1470 -- # uname 00:03:59.057 16:56:55 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:59.057 16:56:55 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:59.057 16:56:55 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:59.057 lcov: LCOV version 1.15 00:03:59.058 16:56:55 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:20.977 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:20.977 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:20.977 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:20.977 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:20.977 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:20.977 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:35.849 16:57:31 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:35.849 16:57:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:35.849 16:57:31 -- common/autotest_common.sh@10 -- # set +x 00:04:35.849 16:57:31 -- spdk/autotest.sh@89 -- # rm -f 00:04:35.849 16:57:31 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:35.849 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:35.849 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:35.849 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:35.849 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:35.849 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:35.849 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:35.849 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:35.849 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:35.849 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:35.849 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:35.849 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:35.849 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:36.106 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:36.106 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:36.106 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:36.106 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:36.106 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:36.106 16:57:32 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:36.106 16:57:32 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:36.106 16:57:32 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:36.106 16:57:32 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:36.106 16:57:32 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:36.106 16:57:32 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:36.106 16:57:32 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:36.106 16:57:32 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:36.106 16:57:32 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:36.106 16:57:32 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:36.106 16:57:32 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:36.106 16:57:32 -- spdk/autotest.sh@108 -- # grep -v p 00:04:36.106 16:57:32 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:36.106 16:57:32 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:36.106 16:57:32 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:36.106 16:57:32 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:36.106 16:57:32 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:36.106 No valid GPT data, bailing 00:04:36.106 16:57:32 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:36.106 16:57:33 -- scripts/common.sh@393 -- # pt= 00:04:36.106 16:57:33 -- scripts/common.sh@394 -- # return 1 00:04:36.106 16:57:33 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:36.106 1+0 records in 00:04:36.106 1+0 records out 00:04:36.106 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00148074 s, 708 MB/s 00:04:36.106 16:57:33 -- spdk/autotest.sh@116 -- # sync 00:04:36.106 16:57:33 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:36.106 16:57:33 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:36.106 16:57:33 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:38.007 16:57:34 -- spdk/autotest.sh@122 -- # uname -s 00:04:38.007 16:57:34 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:38.007 16:57:34 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:38.007 16:57:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.007 16:57:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.007 16:57:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.007 ************************************ 00:04:38.007 START TEST setup.sh 00:04:38.007 ************************************ 00:04:38.007 16:57:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:38.007 * Looking for test storage... 00:04:38.007 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:38.007 16:57:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.007 16:57:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.007 16:57:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.007 16:57:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.007 16:57:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.007 16:57:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.007 16:57:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.007 16:57:34 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.007 16:57:34 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.007 16:57:34 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.007 16:57:34 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.007 16:57:34 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.007 16:57:34 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.007 16:57:34 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.007 16:57:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.007 16:57:34 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.007 16:57:34 -- scripts/common.sh@344 -- # : 1 00:04:38.007 16:57:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.007 16:57:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.007 16:57:34 -- scripts/common.sh@364 -- # decimal 1 00:04:38.007 16:57:34 -- scripts/common.sh@352 -- # local d=1 00:04:38.007 16:57:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.007 16:57:34 -- scripts/common.sh@354 -- # echo 1 00:04:38.007 16:57:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.007 16:57:34 -- scripts/common.sh@365 -- # decimal 2 00:04:38.007 16:57:34 -- scripts/common.sh@352 -- # local d=2 00:04:38.007 16:57:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.007 16:57:34 -- scripts/common.sh@354 -- # echo 2 00:04:38.007 16:57:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.007 16:57:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.007 16:57:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.007 16:57:34 -- scripts/common.sh@367 -- # return 0 00:04:38.007 16:57:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.007 16:57:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.007 --rc genhtml_branch_coverage=1 00:04:38.007 --rc genhtml_function_coverage=1 00:04:38.007 --rc genhtml_legend=1 00:04:38.007 --rc geninfo_all_blocks=1 00:04:38.007 --rc geninfo_unexecuted_blocks=1 00:04:38.008 00:04:38.008 ' 00:04:38.008 16:57:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.008 --rc genhtml_branch_coverage=1 00:04:38.008 --rc genhtml_function_coverage=1 00:04:38.008 --rc genhtml_legend=1 00:04:38.008 --rc geninfo_all_blocks=1 00:04:38.008 --rc geninfo_unexecuted_blocks=1 00:04:38.008 00:04:38.008 ' 00:04:38.008 16:57:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.008 --rc genhtml_branch_coverage=1 00:04:38.008 --rc genhtml_function_coverage=1 00:04:38.008 --rc genhtml_legend=1 00:04:38.008 --rc geninfo_all_blocks=1 00:04:38.008 --rc geninfo_unexecuted_blocks=1 00:04:38.008 00:04:38.008 ' 00:04:38.008 16:57:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.008 --rc genhtml_branch_coverage=1 00:04:38.008 --rc genhtml_function_coverage=1 00:04:38.008 --rc genhtml_legend=1 00:04:38.008 --rc geninfo_all_blocks=1 00:04:38.008 --rc geninfo_unexecuted_blocks=1 00:04:38.008 00:04:38.008 ' 00:04:38.008 16:57:34 -- setup/test-setup.sh@10 -- # uname -s 00:04:38.008 16:57:34 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:38.008 16:57:34 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:38.008 16:57:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.008 16:57:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.008 16:57:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.008 ************************************ 00:04:38.008 START TEST acl 00:04:38.008 ************************************ 00:04:38.008 16:57:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:38.008 * Looking for test storage... 00:04:38.008 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:38.008 16:57:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.008 16:57:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.008 16:57:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.268 16:57:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.268 16:57:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.268 16:57:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.268 16:57:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.268 16:57:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.268 16:57:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.268 16:57:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.268 16:57:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.268 16:57:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.268 16:57:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.268 16:57:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.268 16:57:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.268 16:57:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.268 16:57:35 -- scripts/common.sh@344 -- # : 1 00:04:38.268 16:57:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.268 16:57:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.268 16:57:35 -- scripts/common.sh@364 -- # decimal 1 00:04:38.268 16:57:35 -- scripts/common.sh@352 -- # local d=1 00:04:38.268 16:57:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.268 16:57:35 -- scripts/common.sh@354 -- # echo 1 00:04:38.268 16:57:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.268 16:57:35 -- scripts/common.sh@365 -- # decimal 2 00:04:38.268 16:57:35 -- scripts/common.sh@352 -- # local d=2 00:04:38.268 16:57:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.268 16:57:35 -- scripts/common.sh@354 -- # echo 2 00:04:38.268 16:57:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.268 16:57:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.268 16:57:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.268 16:57:35 -- scripts/common.sh@367 -- # return 0 00:04:38.268 16:57:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.268 16:57:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.268 --rc genhtml_branch_coverage=1 00:04:38.268 --rc genhtml_function_coverage=1 00:04:38.268 --rc genhtml_legend=1 00:04:38.268 --rc geninfo_all_blocks=1 00:04:38.268 --rc geninfo_unexecuted_blocks=1 00:04:38.268 00:04:38.268 ' 00:04:38.268 16:57:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.268 --rc genhtml_branch_coverage=1 00:04:38.268 --rc genhtml_function_coverage=1 00:04:38.268 --rc genhtml_legend=1 00:04:38.268 --rc geninfo_all_blocks=1 00:04:38.268 --rc geninfo_unexecuted_blocks=1 00:04:38.268 00:04:38.268 ' 00:04:38.269 16:57:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.269 --rc genhtml_branch_coverage=1 00:04:38.269 --rc genhtml_function_coverage=1 00:04:38.269 --rc genhtml_legend=1 00:04:38.269 --rc geninfo_all_blocks=1 00:04:38.269 --rc geninfo_unexecuted_blocks=1 00:04:38.269 00:04:38.269 ' 00:04:38.269 16:57:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.269 --rc genhtml_branch_coverage=1 00:04:38.269 --rc genhtml_function_coverage=1 00:04:38.269 --rc genhtml_legend=1 00:04:38.269 --rc geninfo_all_blocks=1 00:04:38.269 --rc geninfo_unexecuted_blocks=1 00:04:38.269 00:04:38.269 ' 00:04:38.269 16:57:35 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:38.269 16:57:35 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:38.269 16:57:35 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:38.269 16:57:35 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:38.269 16:57:35 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:38.269 16:57:35 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:38.269 16:57:35 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:38.269 16:57:35 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:38.269 16:57:35 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:38.269 16:57:35 -- setup/acl.sh@12 -- # devs=() 00:04:38.269 16:57:35 -- setup/acl.sh@12 -- # declare -a devs 00:04:38.269 16:57:35 -- setup/acl.sh@13 -- # drivers=() 00:04:38.269 16:57:35 -- setup/acl.sh@13 -- # declare -A drivers 00:04:38.269 16:57:35 -- setup/acl.sh@51 -- # setup reset 00:04:38.269 16:57:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:38.269 16:57:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:39.725 16:57:36 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:39.725 16:57:36 -- setup/acl.sh@16 -- # local dev driver 00:04:39.725 16:57:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:39.725 16:57:36 -- setup/acl.sh@15 -- # setup output status 00:04:39.725 16:57:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.725 16:57:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:41.103 Hugepages 00:04:41.103 node hugesize free / total 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 00:04:41.103 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # continue 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:41.103 16:57:37 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:41.103 16:57:37 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:41.103 16:57:37 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:41.103 16:57:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:41.103 16:57:37 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:41.103 16:57:37 -- setup/acl.sh@54 -- # run_test denied denied 00:04:41.103 16:57:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.103 16:57:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.103 16:57:37 -- common/autotest_common.sh@10 -- # set +x 00:04:41.103 ************************************ 00:04:41.103 START TEST denied 00:04:41.103 ************************************ 00:04:41.103 16:57:37 -- common/autotest_common.sh@1114 -- # denied 00:04:41.103 16:57:37 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:41.103 16:57:37 -- setup/acl.sh@38 -- # setup output config 00:04:41.103 16:57:37 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:41.103 16:57:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.103 16:57:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:42.478 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:42.478 16:57:39 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:42.478 16:57:39 -- setup/acl.sh@28 -- # local dev driver 00:04:42.478 16:57:39 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:42.478 16:57:39 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:42.478 16:57:39 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:42.478 16:57:39 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:42.478 16:57:39 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:42.478 16:57:39 -- setup/acl.sh@41 -- # setup reset 00:04:42.478 16:57:39 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:42.478 16:57:39 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:45.009 00:04:45.009 real 0m3.893s 00:04:45.009 user 0m1.128s 00:04:45.009 sys 0m1.907s 00:04:45.009 16:57:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.009 16:57:41 -- common/autotest_common.sh@10 -- # set +x 00:04:45.009 ************************************ 00:04:45.009 END TEST denied 00:04:45.009 ************************************ 00:04:45.009 16:57:41 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:45.009 16:57:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.009 16:57:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.009 16:57:41 -- common/autotest_common.sh@10 -- # set +x 00:04:45.009 ************************************ 00:04:45.009 START TEST allowed 00:04:45.009 ************************************ 00:04:45.009 16:57:41 -- common/autotest_common.sh@1114 -- # allowed 00:04:45.009 16:57:41 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:45.009 16:57:41 -- setup/acl.sh@45 -- # setup output config 00:04:45.009 16:57:41 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:45.009 16:57:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.009 16:57:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:47.543 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:47.543 16:57:44 -- setup/acl.sh@47 -- # verify 00:04:47.543 16:57:44 -- setup/acl.sh@28 -- # local dev driver 00:04:47.543 16:57:44 -- setup/acl.sh@48 -- # setup reset 00:04:47.543 16:57:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:47.543 16:57:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:48.922 00:04:48.922 real 0m3.924s 00:04:48.922 user 0m0.992s 00:04:48.922 sys 0m1.823s 00:04:48.922 16:57:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.922 16:57:45 -- common/autotest_common.sh@10 -- # set +x 00:04:48.922 ************************************ 00:04:48.922 END TEST allowed 00:04:48.922 ************************************ 00:04:48.922 00:04:48.922 real 0m10.801s 00:04:48.922 user 0m3.330s 00:04:48.922 sys 0m5.602s 00:04:48.922 16:57:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.922 16:57:45 -- common/autotest_common.sh@10 -- # set +x 00:04:48.922 ************************************ 00:04:48.922 END TEST acl 00:04:48.922 ************************************ 00:04:48.922 16:57:45 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:48.922 16:57:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.922 16:57:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.922 16:57:45 -- common/autotest_common.sh@10 -- # set +x 00:04:48.922 ************************************ 00:04:48.922 START TEST hugepages 00:04:48.922 ************************************ 00:04:48.922 16:57:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:48.922 * Looking for test storage... 00:04:48.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:48.922 16:57:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:48.922 16:57:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:48.922 16:57:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:48.922 16:57:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:48.922 16:57:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:48.922 16:57:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:48.922 16:57:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:48.922 16:57:45 -- scripts/common.sh@335 -- # IFS=.-: 00:04:48.922 16:57:45 -- scripts/common.sh@335 -- # read -ra ver1 00:04:48.922 16:57:45 -- scripts/common.sh@336 -- # IFS=.-: 00:04:48.922 16:57:45 -- scripts/common.sh@336 -- # read -ra ver2 00:04:48.922 16:57:45 -- scripts/common.sh@337 -- # local 'op=<' 00:04:48.923 16:57:45 -- scripts/common.sh@339 -- # ver1_l=2 00:04:48.923 16:57:45 -- scripts/common.sh@340 -- # ver2_l=1 00:04:48.923 16:57:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:48.923 16:57:45 -- scripts/common.sh@343 -- # case "$op" in 00:04:48.923 16:57:45 -- scripts/common.sh@344 -- # : 1 00:04:48.923 16:57:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:48.923 16:57:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:48.923 16:57:45 -- scripts/common.sh@364 -- # decimal 1 00:04:48.923 16:57:45 -- scripts/common.sh@352 -- # local d=1 00:04:48.923 16:57:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:48.923 16:57:45 -- scripts/common.sh@354 -- # echo 1 00:04:48.923 16:57:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:48.923 16:57:45 -- scripts/common.sh@365 -- # decimal 2 00:04:48.923 16:57:45 -- scripts/common.sh@352 -- # local d=2 00:04:48.923 16:57:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:48.923 16:57:45 -- scripts/common.sh@354 -- # echo 2 00:04:48.923 16:57:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:48.923 16:57:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:48.923 16:57:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:48.923 16:57:45 -- scripts/common.sh@367 -- # return 0 00:04:48.923 16:57:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:48.923 16:57:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:48.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.923 --rc genhtml_branch_coverage=1 00:04:48.923 --rc genhtml_function_coverage=1 00:04:48.923 --rc genhtml_legend=1 00:04:48.923 --rc geninfo_all_blocks=1 00:04:48.923 --rc geninfo_unexecuted_blocks=1 00:04:48.923 00:04:48.923 ' 00:04:48.923 16:57:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:48.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.923 --rc genhtml_branch_coverage=1 00:04:48.923 --rc genhtml_function_coverage=1 00:04:48.923 --rc genhtml_legend=1 00:04:48.923 --rc geninfo_all_blocks=1 00:04:48.923 --rc geninfo_unexecuted_blocks=1 00:04:48.923 00:04:48.923 ' 00:04:48.923 16:57:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:48.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.923 --rc genhtml_branch_coverage=1 00:04:48.923 --rc genhtml_function_coverage=1 00:04:48.923 --rc genhtml_legend=1 00:04:48.923 --rc geninfo_all_blocks=1 00:04:48.923 --rc geninfo_unexecuted_blocks=1 00:04:48.923 00:04:48.923 ' 00:04:48.923 16:57:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:48.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.923 --rc genhtml_branch_coverage=1 00:04:48.923 --rc genhtml_function_coverage=1 00:04:48.923 --rc genhtml_legend=1 00:04:48.923 --rc geninfo_all_blocks=1 00:04:48.923 --rc geninfo_unexecuted_blocks=1 00:04:48.923 00:04:48.923 ' 00:04:48.923 16:57:45 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:48.923 16:57:45 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:48.923 16:57:45 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:48.923 16:57:45 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:48.923 16:57:45 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:48.923 16:57:45 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:48.923 16:57:45 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:48.923 16:57:45 -- setup/common.sh@18 -- # local node= 00:04:48.923 16:57:45 -- setup/common.sh@19 -- # local var val 00:04:48.923 16:57:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.923 16:57:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.923 16:57:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.923 16:57:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.923 16:57:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.923 16:57:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41087880 kB' 'MemAvailable: 44861140 kB' 'Buffers: 2708 kB' 'Cached: 12727348 kB' 'SwapCached: 0 kB' 'Active: 9439268 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038788 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476664 kB' 'Mapped: 206380 kB' 'Shmem: 8565464 kB' 'KReclaimable: 204492 kB' 'Slab: 738088 kB' 'SReclaimable: 204492 kB' 'SUnreclaim: 533596 kB' 'KernelStack: 12880 kB' 'PageTables: 8476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 10109840 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.923 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.923 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.924 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.924 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # continue 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.925 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.925 16:57:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # continue 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.184 16:57:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.184 16:57:45 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:49.184 16:57:45 -- setup/common.sh@33 -- # echo 2048 00:04:49.184 16:57:45 -- setup/common.sh@33 -- # return 0 00:04:49.184 16:57:45 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:49.184 16:57:45 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:49.184 16:57:45 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:49.184 16:57:45 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:49.184 16:57:45 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:49.184 16:57:45 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:49.184 16:57:45 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:49.184 16:57:45 -- setup/hugepages.sh@207 -- # get_nodes 00:04:49.184 16:57:45 -- setup/hugepages.sh@27 -- # local node 00:04:49.184 16:57:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.184 16:57:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:49.184 16:57:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.184 16:57:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:49.184 16:57:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.184 16:57:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.185 16:57:45 -- setup/hugepages.sh@208 -- # clear_hp 00:04:49.185 16:57:45 -- setup/hugepages.sh@37 -- # local node hp 00:04:49.185 16:57:45 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.185 16:57:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.185 16:57:45 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.185 16:57:45 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.185 16:57:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.185 16:57:45 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.185 16:57:45 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:49.185 16:57:45 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:49.185 16:57:45 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:49.185 16:57:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.185 16:57:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.185 16:57:45 -- common/autotest_common.sh@10 -- # set +x 00:04:49.185 ************************************ 00:04:49.185 START TEST default_setup 00:04:49.185 ************************************ 00:04:49.185 16:57:45 -- common/autotest_common.sh@1114 -- # default_setup 00:04:49.185 16:57:45 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:49.185 16:57:45 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:49.185 16:57:45 -- setup/hugepages.sh@51 -- # shift 00:04:49.185 16:57:45 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:49.185 16:57:45 -- setup/hugepages.sh@52 -- # local node_ids 00:04:49.185 16:57:45 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:49.185 16:57:45 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:49.185 16:57:45 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:49.185 16:57:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.185 16:57:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:49.185 16:57:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.185 16:57:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.185 16:57:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.185 16:57:45 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:49.185 16:57:45 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:49.185 16:57:45 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:49.185 16:57:45 -- setup/hugepages.sh@73 -- # return 0 00:04:49.185 16:57:45 -- setup/hugepages.sh@137 -- # setup output 00:04:49.185 16:57:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.185 16:57:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.561 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:50.561 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:50.561 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:50.562 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:51.501 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:51.501 16:57:48 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:51.501 16:57:48 -- setup/hugepages.sh@89 -- # local node 00:04:51.501 16:57:48 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:51.501 16:57:48 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:51.501 16:57:48 -- setup/hugepages.sh@92 -- # local surp 00:04:51.501 16:57:48 -- setup/hugepages.sh@93 -- # local resv 00:04:51.501 16:57:48 -- setup/hugepages.sh@94 -- # local anon 00:04:51.501 16:57:48 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:51.501 16:57:48 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:51.501 16:57:48 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:51.501 16:57:48 -- setup/common.sh@18 -- # local node= 00:04:51.501 16:57:48 -- setup/common.sh@19 -- # local var val 00:04:51.501 16:57:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.501 16:57:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.501 16:57:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.501 16:57:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.501 16:57:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.501 16:57:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.501 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.501 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43211864 kB' 'MemAvailable: 46985116 kB' 'Buffers: 2708 kB' 'Cached: 12727444 kB' 'SwapCached: 0 kB' 'Active: 9441176 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040696 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478388 kB' 'Mapped: 206000 kB' 'Shmem: 8565560 kB' 'KReclaimable: 204476 kB' 'Slab: 737828 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533352 kB' 'KernelStack: 12960 kB' 'PageTables: 8756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116004 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.502 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.502 16:57:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.503 16:57:48 -- setup/common.sh@33 -- # echo 0 00:04:51.503 16:57:48 -- setup/common.sh@33 -- # return 0 00:04:51.503 16:57:48 -- setup/hugepages.sh@97 -- # anon=0 00:04:51.503 16:57:48 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:51.503 16:57:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.503 16:57:48 -- setup/common.sh@18 -- # local node= 00:04:51.503 16:57:48 -- setup/common.sh@19 -- # local var val 00:04:51.503 16:57:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.503 16:57:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.503 16:57:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.503 16:57:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.503 16:57:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.503 16:57:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43221500 kB' 'MemAvailable: 46994752 kB' 'Buffers: 2708 kB' 'Cached: 12727448 kB' 'SwapCached: 0 kB' 'Active: 9440576 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040096 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477824 kB' 'Mapped: 205980 kB' 'Shmem: 8565564 kB' 'KReclaimable: 204476 kB' 'Slab: 737852 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533376 kB' 'KernelStack: 12816 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116016 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.503 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.503 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.504 16:57:48 -- setup/common.sh@33 -- # echo 0 00:04:51.504 16:57:48 -- setup/common.sh@33 -- # return 0 00:04:51.504 16:57:48 -- setup/hugepages.sh@99 -- # surp=0 00:04:51.504 16:57:48 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:51.504 16:57:48 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:51.504 16:57:48 -- setup/common.sh@18 -- # local node= 00:04:51.504 16:57:48 -- setup/common.sh@19 -- # local var val 00:04:51.504 16:57:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.504 16:57:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.504 16:57:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.504 16:57:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.504 16:57:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.504 16:57:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43222020 kB' 'MemAvailable: 46995272 kB' 'Buffers: 2708 kB' 'Cached: 12727460 kB' 'SwapCached: 0 kB' 'Active: 9440264 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039784 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477436 kB' 'Mapped: 205900 kB' 'Shmem: 8565576 kB' 'KReclaimable: 204476 kB' 'Slab: 737808 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533332 kB' 'KernelStack: 12816 kB' 'PageTables: 8216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.504 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.504 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.505 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.505 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.505 16:57:48 -- setup/common.sh@33 -- # echo 0 00:04:51.505 16:57:48 -- setup/common.sh@33 -- # return 0 00:04:51.505 16:57:48 -- setup/hugepages.sh@100 -- # resv=0 00:04:51.505 16:57:48 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:51.505 nr_hugepages=1024 00:04:51.505 16:57:48 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:51.505 resv_hugepages=0 00:04:51.505 16:57:48 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:51.506 surplus_hugepages=0 00:04:51.506 16:57:48 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:51.506 anon_hugepages=0 00:04:51.506 16:57:48 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.506 16:57:48 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:51.506 16:57:48 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:51.506 16:57:48 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:51.506 16:57:48 -- setup/common.sh@18 -- # local node= 00:04:51.506 16:57:48 -- setup/common.sh@19 -- # local var val 00:04:51.506 16:57:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.506 16:57:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.506 16:57:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.506 16:57:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.506 16:57:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.506 16:57:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43222020 kB' 'MemAvailable: 46995272 kB' 'Buffers: 2708 kB' 'Cached: 12727476 kB' 'SwapCached: 0 kB' 'Active: 9440296 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039816 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477432 kB' 'Mapped: 205900 kB' 'Shmem: 8565592 kB' 'KReclaimable: 204476 kB' 'Slab: 737788 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533312 kB' 'KernelStack: 12816 kB' 'PageTables: 8216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.506 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.506 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.507 16:57:48 -- setup/common.sh@33 -- # echo 1024 00:04:51.507 16:57:48 -- setup/common.sh@33 -- # return 0 00:04:51.507 16:57:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.507 16:57:48 -- setup/hugepages.sh@112 -- # get_nodes 00:04:51.507 16:57:48 -- setup/hugepages.sh@27 -- # local node 00:04:51.507 16:57:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.507 16:57:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:51.507 16:57:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.507 16:57:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:51.507 16:57:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:51.507 16:57:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:51.507 16:57:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.507 16:57:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.507 16:57:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:51.507 16:57:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.507 16:57:48 -- setup/common.sh@18 -- # local node=0 00:04:51.507 16:57:48 -- setup/common.sh@19 -- # local var val 00:04:51.507 16:57:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.507 16:57:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.507 16:57:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:51.507 16:57:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:51.507 16:57:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.507 16:57:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26042548 kB' 'MemUsed: 6783308 kB' 'SwapCached: 0 kB' 'Active: 3227508 kB' 'Inactive: 177232 kB' 'Active(anon): 3070784 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078960 kB' 'Mapped: 73096 kB' 'AnonPages: 328948 kB' 'Shmem: 2745004 kB' 'KernelStack: 7112 kB' 'PageTables: 5128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 443060 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 320260 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.507 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.507 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # continue 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.508 16:57:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.508 16:57:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.508 16:57:48 -- setup/common.sh@33 -- # echo 0 00:04:51.508 16:57:48 -- setup/common.sh@33 -- # return 0 00:04:51.508 16:57:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.508 16:57:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.508 16:57:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.508 16:57:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.508 16:57:48 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:51.508 node0=1024 expecting 1024 00:04:51.508 16:57:48 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:51.508 00:04:51.508 real 0m2.464s 00:04:51.508 user 0m0.659s 00:04:51.508 sys 0m0.919s 00:04:51.508 16:57:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.508 16:57:48 -- common/autotest_common.sh@10 -- # set +x 00:04:51.508 ************************************ 00:04:51.508 END TEST default_setup 00:04:51.508 ************************************ 00:04:51.508 16:57:48 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:51.508 16:57:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.508 16:57:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.508 16:57:48 -- common/autotest_common.sh@10 -- # set +x 00:04:51.508 ************************************ 00:04:51.508 START TEST per_node_1G_alloc 00:04:51.508 ************************************ 00:04:51.508 16:57:48 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:51.508 16:57:48 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:51.508 16:57:48 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:51.508 16:57:48 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:51.508 16:57:48 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:51.508 16:57:48 -- setup/hugepages.sh@51 -- # shift 00:04:51.508 16:57:48 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:51.508 16:57:48 -- setup/hugepages.sh@52 -- # local node_ids 00:04:51.508 16:57:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:51.508 16:57:48 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:51.508 16:57:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:51.508 16:57:48 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:51.508 16:57:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:51.508 16:57:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:51.508 16:57:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:51.508 16:57:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:51.508 16:57:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:51.508 16:57:48 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:51.508 16:57:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:51.508 16:57:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:51.508 16:57:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:51.508 16:57:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:51.508 16:57:48 -- setup/hugepages.sh@73 -- # return 0 00:04:51.508 16:57:48 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:51.508 16:57:48 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:51.508 16:57:48 -- setup/hugepages.sh@146 -- # setup output 00:04:51.508 16:57:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.508 16:57:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:52.918 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.918 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:52.918 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.918 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.918 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.918 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.918 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.918 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.918 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.918 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.918 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.918 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.918 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.918 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.918 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.918 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.918 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.918 16:57:49 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:52.918 16:57:49 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:52.918 16:57:49 -- setup/hugepages.sh@89 -- # local node 00:04:52.918 16:57:49 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:52.918 16:57:49 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:52.918 16:57:49 -- setup/hugepages.sh@92 -- # local surp 00:04:52.919 16:57:49 -- setup/hugepages.sh@93 -- # local resv 00:04:52.919 16:57:49 -- setup/hugepages.sh@94 -- # local anon 00:04:52.919 16:57:49 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:52.919 16:57:49 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:52.919 16:57:49 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:52.919 16:57:49 -- setup/common.sh@18 -- # local node= 00:04:52.919 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:52.919 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.919 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.919 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.919 16:57:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.919 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.919 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43219968 kB' 'MemAvailable: 46993220 kB' 'Buffers: 2708 kB' 'Cached: 12727532 kB' 'SwapCached: 0 kB' 'Active: 9440596 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040116 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477692 kB' 'Mapped: 205936 kB' 'Shmem: 8565648 kB' 'KReclaimable: 204476 kB' 'Slab: 737776 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533300 kB' 'KernelStack: 12784 kB' 'PageTables: 8140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116352 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.919 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.919 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.920 16:57:49 -- setup/common.sh@33 -- # echo 0 00:04:52.920 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:52.920 16:57:49 -- setup/hugepages.sh@97 -- # anon=0 00:04:52.920 16:57:49 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:52.920 16:57:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.920 16:57:49 -- setup/common.sh@18 -- # local node= 00:04:52.920 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:52.920 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.920 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.920 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.920 16:57:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.920 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.920 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43232084 kB' 'MemAvailable: 47005336 kB' 'Buffers: 2708 kB' 'Cached: 12727532 kB' 'SwapCached: 0 kB' 'Active: 9441224 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040744 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478424 kB' 'Mapped: 205944 kB' 'Shmem: 8565648 kB' 'KReclaimable: 204476 kB' 'Slab: 737740 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533264 kB' 'KernelStack: 12800 kB' 'PageTables: 8196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.920 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.920 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.921 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.921 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.922 16:57:49 -- setup/common.sh@33 -- # echo 0 00:04:52.922 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:52.922 16:57:49 -- setup/hugepages.sh@99 -- # surp=0 00:04:52.922 16:57:49 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:52.922 16:57:49 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:52.922 16:57:49 -- setup/common.sh@18 -- # local node= 00:04:52.922 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:52.922 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.922 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.922 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.922 16:57:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.922 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.922 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43232872 kB' 'MemAvailable: 47006124 kB' 'Buffers: 2708 kB' 'Cached: 12727544 kB' 'SwapCached: 0 kB' 'Active: 9440480 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040000 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477648 kB' 'Mapped: 205908 kB' 'Shmem: 8565660 kB' 'KReclaimable: 204476 kB' 'Slab: 737840 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533364 kB' 'KernelStack: 12816 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.922 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.922 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.923 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.923 16:57:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.924 16:57:49 -- setup/common.sh@33 -- # echo 0 00:04:52.924 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:52.924 16:57:49 -- setup/hugepages.sh@100 -- # resv=0 00:04:52.924 16:57:49 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:52.924 nr_hugepages=1024 00:04:52.924 16:57:49 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:52.924 resv_hugepages=0 00:04:52.924 16:57:49 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:52.924 surplus_hugepages=0 00:04:52.924 16:57:49 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:52.924 anon_hugepages=0 00:04:52.924 16:57:49 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:52.924 16:57:49 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:52.924 16:57:49 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:52.924 16:57:49 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:52.924 16:57:49 -- setup/common.sh@18 -- # local node= 00:04:52.924 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:52.924 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.924 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.924 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.924 16:57:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.924 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.924 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43232116 kB' 'MemAvailable: 47005368 kB' 'Buffers: 2708 kB' 'Cached: 12727560 kB' 'SwapCached: 0 kB' 'Active: 9440496 kB' 'Inactive: 3764112 kB' 'Active(anon): 9040016 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477600 kB' 'Mapped: 205908 kB' 'Shmem: 8565676 kB' 'KReclaimable: 204476 kB' 'Slab: 737840 kB' 'SReclaimable: 204476 kB' 'SUnreclaim: 533364 kB' 'KernelStack: 12800 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116392 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.924 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.924 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.925 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.925 16:57:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.926 16:57:49 -- setup/common.sh@33 -- # echo 1024 00:04:52.926 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:52.926 16:57:49 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:52.926 16:57:49 -- setup/hugepages.sh@112 -- # get_nodes 00:04:52.926 16:57:49 -- setup/hugepages.sh@27 -- # local node 00:04:52.926 16:57:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.926 16:57:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:52.926 16:57:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.926 16:57:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:52.926 16:57:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:52.926 16:57:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:52.926 16:57:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.926 16:57:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.926 16:57:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:52.926 16:57:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.926 16:57:49 -- setup/common.sh@18 -- # local node=0 00:04:52.926 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:52.926 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.926 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.926 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:52.926 16:57:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:52.926 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.926 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27096968 kB' 'MemUsed: 5728888 kB' 'SwapCached: 0 kB' 'Active: 3227968 kB' 'Inactive: 177232 kB' 'Active(anon): 3071244 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078972 kB' 'Mapped: 73104 kB' 'AnonPages: 329440 kB' 'Shmem: 2745016 kB' 'KernelStack: 7128 kB' 'PageTables: 5192 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442908 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 320108 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.926 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.926 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # continue 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.927 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.927 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.927 16:57:49 -- setup/common.sh@33 -- # echo 0 00:04:52.927 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:52.927 16:57:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.927 16:57:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.927 16:57:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.187 16:57:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:53.187 16:57:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.187 16:57:49 -- setup/common.sh@18 -- # local node=1 00:04:53.187 16:57:49 -- setup/common.sh@19 -- # local var val 00:04:53.187 16:57:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.187 16:57:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.187 16:57:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:53.187 16:57:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:53.187 16:57:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.187 16:57:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16135148 kB' 'MemUsed: 11574644 kB' 'SwapCached: 0 kB' 'Active: 6212380 kB' 'Inactive: 3586880 kB' 'Active(anon): 5968624 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9651324 kB' 'Mapped: 132804 kB' 'AnonPages: 147976 kB' 'Shmem: 5820688 kB' 'KernelStack: 5672 kB' 'PageTables: 2984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81676 kB' 'Slab: 294932 kB' 'SReclaimable: 81676 kB' 'SUnreclaim: 213256 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.187 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.187 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # continue 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.188 16:57:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.188 16:57:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.188 16:57:49 -- setup/common.sh@33 -- # echo 0 00:04:53.188 16:57:49 -- setup/common.sh@33 -- # return 0 00:04:53.188 16:57:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.188 16:57:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.188 16:57:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.188 16:57:49 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:53.188 node0=512 expecting 512 00:04:53.188 16:57:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.188 16:57:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.188 16:57:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.188 16:57:49 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:53.188 node1=512 expecting 512 00:04:53.188 16:57:49 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:53.188 00:04:53.188 real 0m1.491s 00:04:53.188 user 0m0.592s 00:04:53.188 sys 0m0.866s 00:04:53.188 16:57:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.188 16:57:49 -- common/autotest_common.sh@10 -- # set +x 00:04:53.188 ************************************ 00:04:53.188 END TEST per_node_1G_alloc 00:04:53.188 ************************************ 00:04:53.188 16:57:49 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:53.188 16:57:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.188 16:57:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.188 16:57:49 -- common/autotest_common.sh@10 -- # set +x 00:04:53.188 ************************************ 00:04:53.188 START TEST even_2G_alloc 00:04:53.188 ************************************ 00:04:53.188 16:57:49 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:53.188 16:57:49 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:53.188 16:57:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:53.188 16:57:49 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:53.188 16:57:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:53.188 16:57:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:53.188 16:57:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:53.188 16:57:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:53.188 16:57:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:53.188 16:57:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:53.188 16:57:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:53.188 16:57:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:53.188 16:57:49 -- setup/hugepages.sh@83 -- # : 512 00:04:53.188 16:57:49 -- setup/hugepages.sh@84 -- # : 1 00:04:53.188 16:57:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:53.188 16:57:49 -- setup/hugepages.sh@83 -- # : 0 00:04:53.188 16:57:49 -- setup/hugepages.sh@84 -- # : 0 00:04:53.188 16:57:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:53.188 16:57:49 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:53.188 16:57:49 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:53.188 16:57:49 -- setup/hugepages.sh@153 -- # setup output 00:04:53.188 16:57:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.188 16:57:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:54.568 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:54.568 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:54.568 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:54.568 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:54.568 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:54.568 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:54.568 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:54.568 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:54.568 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:54.568 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:54.568 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:54.568 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:54.568 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:54.568 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:54.568 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:54.568 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:54.568 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:54.568 16:57:51 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:54.568 16:57:51 -- setup/hugepages.sh@89 -- # local node 00:04:54.568 16:57:51 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:54.568 16:57:51 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:54.568 16:57:51 -- setup/hugepages.sh@92 -- # local surp 00:04:54.568 16:57:51 -- setup/hugepages.sh@93 -- # local resv 00:04:54.568 16:57:51 -- setup/hugepages.sh@94 -- # local anon 00:04:54.568 16:57:51 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:54.568 16:57:51 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:54.568 16:57:51 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:54.568 16:57:51 -- setup/common.sh@18 -- # local node= 00:04:54.568 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.568 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.568 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.568 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.568 16:57:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.568 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.568 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.568 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.568 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.568 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43231280 kB' 'MemAvailable: 47004528 kB' 'Buffers: 2708 kB' 'Cached: 12727620 kB' 'SwapCached: 0 kB' 'Active: 9440012 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039532 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476928 kB' 'Mapped: 206016 kB' 'Shmem: 8565736 kB' 'KReclaimable: 204468 kB' 'Slab: 737884 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 533416 kB' 'KernelStack: 12800 kB' 'PageTables: 8132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10116748 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:54.568 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.568 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.568 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.568 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.568 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.568 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.568 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.569 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.569 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.570 16:57:51 -- setup/common.sh@33 -- # echo 0 00:04:54.570 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.570 16:57:51 -- setup/hugepages.sh@97 -- # anon=0 00:04:54.570 16:57:51 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:54.570 16:57:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.570 16:57:51 -- setup/common.sh@18 -- # local node= 00:04:54.570 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.570 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.570 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.570 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.570 16:57:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.570 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.570 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43235528 kB' 'MemAvailable: 47008776 kB' 'Buffers: 2708 kB' 'Cached: 12727624 kB' 'SwapCached: 0 kB' 'Active: 9438992 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038512 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475944 kB' 'Mapped: 205580 kB' 'Shmem: 8565740 kB' 'KReclaimable: 204468 kB' 'Slab: 737900 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 533432 kB' 'KernelStack: 12816 kB' 'PageTables: 8164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.570 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.570 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.571 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.571 16:57:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.572 16:57:51 -- setup/common.sh@33 -- # echo 0 00:04:54.572 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.572 16:57:51 -- setup/hugepages.sh@99 -- # surp=0 00:04:54.572 16:57:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:54.572 16:57:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:54.572 16:57:51 -- setup/common.sh@18 -- # local node= 00:04:54.572 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.572 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.572 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.572 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.572 16:57:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.572 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.572 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43235960 kB' 'MemAvailable: 47009208 kB' 'Buffers: 2708 kB' 'Cached: 12727636 kB' 'SwapCached: 0 kB' 'Active: 9437860 kB' 'Inactive: 3764112 kB' 'Active(anon): 9037380 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474780 kB' 'Mapped: 204832 kB' 'Shmem: 8565752 kB' 'KReclaimable: 204468 kB' 'Slab: 737832 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 533364 kB' 'KernelStack: 12784 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.572 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.572 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.573 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.573 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.573 16:57:51 -- setup/common.sh@33 -- # echo 0 00:04:54.573 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.573 16:57:51 -- setup/hugepages.sh@100 -- # resv=0 00:04:54.573 16:57:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:54.573 nr_hugepages=1024 00:04:54.573 16:57:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:54.573 resv_hugepages=0 00:04:54.573 16:57:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:54.573 surplus_hugepages=0 00:04:54.573 16:57:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:54.573 anon_hugepages=0 00:04:54.573 16:57:51 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:54.573 16:57:51 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:54.574 16:57:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:54.574 16:57:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:54.574 16:57:51 -- setup/common.sh@18 -- # local node= 00:04:54.574 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.574 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.574 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.574 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.574 16:57:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.574 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.574 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43235960 kB' 'MemAvailable: 47009208 kB' 'Buffers: 2708 kB' 'Cached: 12727648 kB' 'SwapCached: 0 kB' 'Active: 9437860 kB' 'Inactive: 3764112 kB' 'Active(anon): 9037380 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474784 kB' 'Mapped: 204832 kB' 'Shmem: 8565764 kB' 'KReclaimable: 204468 kB' 'Slab: 737832 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 533364 kB' 'KernelStack: 12784 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.574 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.574 16:57:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.575 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.575 16:57:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.576 16:57:51 -- setup/common.sh@33 -- # echo 1024 00:04:54.576 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.576 16:57:51 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:54.576 16:57:51 -- setup/hugepages.sh@112 -- # get_nodes 00:04:54.576 16:57:51 -- setup/hugepages.sh@27 -- # local node 00:04:54.576 16:57:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.576 16:57:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:54.576 16:57:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.576 16:57:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:54.576 16:57:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:54.576 16:57:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:54.576 16:57:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:54.576 16:57:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:54.576 16:57:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:54.576 16:57:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.576 16:57:51 -- setup/common.sh@18 -- # local node=0 00:04:54.576 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.576 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.576 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.576 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:54.576 16:57:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:54.576 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.576 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27106104 kB' 'MemUsed: 5719752 kB' 'SwapCached: 0 kB' 'Active: 3224860 kB' 'Inactive: 177232 kB' 'Active(anon): 3068136 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078976 kB' 'Mapped: 72104 kB' 'AnonPages: 326208 kB' 'Shmem: 2745020 kB' 'KernelStack: 7016 kB' 'PageTables: 4716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442984 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 320184 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.576 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.576 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@33 -- # echo 0 00:04:54.577 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.577 16:57:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:54.577 16:57:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:54.577 16:57:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:54.577 16:57:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:54.577 16:57:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.577 16:57:51 -- setup/common.sh@18 -- # local node=1 00:04:54.577 16:57:51 -- setup/common.sh@19 -- # local var val 00:04:54.577 16:57:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.577 16:57:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.577 16:57:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:54.577 16:57:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:54.577 16:57:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.577 16:57:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16130388 kB' 'MemUsed: 11579404 kB' 'SwapCached: 0 kB' 'Active: 6212984 kB' 'Inactive: 3586880 kB' 'Active(anon): 5969228 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9651408 kB' 'Mapped: 132728 kB' 'AnonPages: 148532 kB' 'Shmem: 5820772 kB' 'KernelStack: 5752 kB' 'PageTables: 3120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81668 kB' 'Slab: 294848 kB' 'SReclaimable: 81668 kB' 'SUnreclaim: 213180 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.577 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.577 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.578 16:57:51 -- setup/common.sh@32 -- # continue 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.578 16:57:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 16:57:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.579 16:57:51 -- setup/common.sh@33 -- # echo 0 00:04:54.579 16:57:51 -- setup/common.sh@33 -- # return 0 00:04:54.579 16:57:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:54.579 16:57:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:54.579 16:57:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:54.579 16:57:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:54.579 node0=512 expecting 512 00:04:54.579 16:57:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:54.579 16:57:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:54.579 16:57:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:54.579 16:57:51 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:54.579 node1=512 expecting 512 00:04:54.579 16:57:51 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:54.579 00:04:54.579 real 0m1.487s 00:04:54.579 user 0m0.613s 00:04:54.579 sys 0m0.838s 00:04:54.579 16:57:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.579 16:57:51 -- common/autotest_common.sh@10 -- # set +x 00:04:54.579 ************************************ 00:04:54.579 END TEST even_2G_alloc 00:04:54.579 ************************************ 00:04:54.579 16:57:51 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:54.579 16:57:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.579 16:57:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.579 16:57:51 -- common/autotest_common.sh@10 -- # set +x 00:04:54.579 ************************************ 00:04:54.579 START TEST odd_alloc 00:04:54.579 ************************************ 00:04:54.579 16:57:51 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:54.579 16:57:51 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:54.579 16:57:51 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:54.579 16:57:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:54.579 16:57:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:54.579 16:57:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:54.579 16:57:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:54.579 16:57:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:54.579 16:57:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:54.579 16:57:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:54.579 16:57:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:54.579 16:57:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:54.579 16:57:51 -- setup/hugepages.sh@83 -- # : 513 00:04:54.579 16:57:51 -- setup/hugepages.sh@84 -- # : 1 00:04:54.579 16:57:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:54.579 16:57:51 -- setup/hugepages.sh@83 -- # : 0 00:04:54.579 16:57:51 -- setup/hugepages.sh@84 -- # : 0 00:04:54.579 16:57:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:54.579 16:57:51 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:54.579 16:57:51 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:54.579 16:57:51 -- setup/hugepages.sh@160 -- # setup output 00:04:54.579 16:57:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:54.579 16:57:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:55.958 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.958 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:55.958 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.958 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.958 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.958 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.958 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.958 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.958 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.958 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.958 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.958 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.958 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.958 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.958 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.958 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.958 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.958 16:57:52 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:55.958 16:57:52 -- setup/hugepages.sh@89 -- # local node 00:04:55.958 16:57:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:55.958 16:57:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:55.958 16:57:52 -- setup/hugepages.sh@92 -- # local surp 00:04:55.958 16:57:52 -- setup/hugepages.sh@93 -- # local resv 00:04:55.958 16:57:52 -- setup/hugepages.sh@94 -- # local anon 00:04:55.958 16:57:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:55.958 16:57:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:55.958 16:57:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:55.958 16:57:52 -- setup/common.sh@18 -- # local node= 00:04:55.958 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.958 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.958 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.958 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.958 16:57:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.958 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.958 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43222324 kB' 'MemAvailable: 46995572 kB' 'Buffers: 2708 kB' 'Cached: 12727712 kB' 'SwapCached: 0 kB' 'Active: 9440340 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039860 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477268 kB' 'Mapped: 204884 kB' 'Shmem: 8565828 kB' 'KReclaimable: 204468 kB' 'Slab: 737332 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532864 kB' 'KernelStack: 13056 kB' 'PageTables: 8616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10107452 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198600 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.958 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.958 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.959 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.959 16:57:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.960 16:57:52 -- setup/common.sh@33 -- # echo 0 00:04:55.960 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.960 16:57:52 -- setup/hugepages.sh@97 -- # anon=0 00:04:55.960 16:57:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:55.960 16:57:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.960 16:57:52 -- setup/common.sh@18 -- # local node= 00:04:55.960 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.960 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.960 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.960 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.960 16:57:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.960 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.960 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43227016 kB' 'MemAvailable: 47000264 kB' 'Buffers: 2708 kB' 'Cached: 12727712 kB' 'SwapCached: 0 kB' 'Active: 9441976 kB' 'Inactive: 3764112 kB' 'Active(anon): 9041496 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478888 kB' 'Mapped: 204900 kB' 'Shmem: 8565828 kB' 'KReclaimable: 204468 kB' 'Slab: 737396 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532928 kB' 'KernelStack: 13168 kB' 'PageTables: 9676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10105708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198664 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.960 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.960 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.961 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.961 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.962 16:57:52 -- setup/common.sh@33 -- # echo 0 00:04:55.962 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.962 16:57:52 -- setup/hugepages.sh@99 -- # surp=0 00:04:55.962 16:57:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:55.962 16:57:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:55.962 16:57:52 -- setup/common.sh@18 -- # local node= 00:04:55.962 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.962 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.962 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.962 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.962 16:57:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.962 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.962 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43226460 kB' 'MemAvailable: 46999708 kB' 'Buffers: 2708 kB' 'Cached: 12727724 kB' 'SwapCached: 0 kB' 'Active: 9440424 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039944 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477296 kB' 'Mapped: 204848 kB' 'Shmem: 8565840 kB' 'KReclaimable: 204468 kB' 'Slab: 737380 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532912 kB' 'KernelStack: 13008 kB' 'PageTables: 8432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10103068 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.962 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.962 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.963 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.963 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.963 16:57:52 -- setup/common.sh@33 -- # echo 0 00:04:55.963 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.963 16:57:52 -- setup/hugepages.sh@100 -- # resv=0 00:04:55.963 16:57:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:55.963 nr_hugepages=1025 00:04:55.963 16:57:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:55.963 resv_hugepages=0 00:04:55.963 16:57:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:55.963 surplus_hugepages=0 00:04:55.963 16:57:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:55.963 anon_hugepages=0 00:04:55.963 16:57:52 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:55.963 16:57:52 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:55.963 16:57:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:55.964 16:57:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:55.964 16:57:52 -- setup/common.sh@18 -- # local node= 00:04:55.964 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.964 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.964 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.964 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.964 16:57:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.964 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.964 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43226148 kB' 'MemAvailable: 46999396 kB' 'Buffers: 2708 kB' 'Cached: 12727748 kB' 'SwapCached: 0 kB' 'Active: 9438456 kB' 'Inactive: 3764112 kB' 'Active(anon): 9037976 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475388 kB' 'Mapped: 204836 kB' 'Shmem: 8565864 kB' 'KReclaimable: 204468 kB' 'Slab: 737340 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532872 kB' 'KernelStack: 12784 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10103088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.964 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.964 16:57:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.965 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.965 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.965 16:57:52 -- setup/common.sh@33 -- # echo 1025 00:04:55.966 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.966 16:57:52 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:55.966 16:57:52 -- setup/hugepages.sh@112 -- # get_nodes 00:04:55.966 16:57:52 -- setup/hugepages.sh@27 -- # local node 00:04:55.966 16:57:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.966 16:57:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:55.966 16:57:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.966 16:57:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:55.966 16:57:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:55.966 16:57:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:55.966 16:57:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.966 16:57:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.966 16:57:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:55.966 16:57:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.966 16:57:52 -- setup/common.sh@18 -- # local node=0 00:04:55.966 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.966 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.966 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.966 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:55.966 16:57:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:55.966 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.966 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27096372 kB' 'MemUsed: 5729484 kB' 'SwapCached: 0 kB' 'Active: 3225696 kB' 'Inactive: 177232 kB' 'Active(anon): 3068972 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078980 kB' 'Mapped: 72108 kB' 'AnonPages: 327196 kB' 'Shmem: 2745024 kB' 'KernelStack: 7064 kB' 'PageTables: 4868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442616 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 319816 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.966 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.966 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@33 -- # echo 0 00:04:55.967 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.967 16:57:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.967 16:57:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.967 16:57:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.967 16:57:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:55.967 16:57:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.967 16:57:52 -- setup/common.sh@18 -- # local node=1 00:04:55.967 16:57:52 -- setup/common.sh@19 -- # local var val 00:04:55.967 16:57:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.967 16:57:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.967 16:57:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:55.967 16:57:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:55.967 16:57:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.967 16:57:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16129776 kB' 'MemUsed: 11580016 kB' 'SwapCached: 0 kB' 'Active: 6213188 kB' 'Inactive: 3586880 kB' 'Active(anon): 5969432 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9651504 kB' 'Mapped: 132728 kB' 'AnonPages: 148620 kB' 'Shmem: 5820868 kB' 'KernelStack: 5752 kB' 'PageTables: 3088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81668 kB' 'Slab: 294724 kB' 'SReclaimable: 81668 kB' 'SUnreclaim: 213056 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.967 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.967 16:57:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # continue 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.968 16:57:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.968 16:57:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.968 16:57:52 -- setup/common.sh@33 -- # echo 0 00:04:55.968 16:57:52 -- setup/common.sh@33 -- # return 0 00:04:55.968 16:57:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.968 16:57:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.968 16:57:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.968 16:57:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.968 16:57:52 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:55.968 node0=512 expecting 513 00:04:55.968 16:57:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.968 16:57:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.968 16:57:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.968 16:57:52 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:55.968 node1=513 expecting 512 00:04:55.968 16:57:52 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:55.968 00:04:55.968 real 0m1.430s 00:04:55.968 user 0m0.599s 00:04:55.968 sys 0m0.796s 00:04:55.969 16:57:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.969 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:04:55.969 ************************************ 00:04:55.969 END TEST odd_alloc 00:04:55.969 ************************************ 00:04:55.969 16:57:52 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:55.969 16:57:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.969 16:57:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.969 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:04:55.969 ************************************ 00:04:55.969 START TEST custom_alloc 00:04:55.969 ************************************ 00:04:55.969 16:57:52 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:55.969 16:57:52 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:55.969 16:57:52 -- setup/hugepages.sh@169 -- # local node 00:04:55.969 16:57:52 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:55.969 16:57:52 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:55.969 16:57:52 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:55.969 16:57:52 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:55.969 16:57:52 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:55.969 16:57:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.969 16:57:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:55.969 16:57:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.969 16:57:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:55.969 16:57:52 -- setup/hugepages.sh@83 -- # : 256 00:04:55.969 16:57:52 -- setup/hugepages.sh@84 -- # : 1 00:04:55.969 16:57:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:55.969 16:57:52 -- setup/hugepages.sh@83 -- # : 0 00:04:55.969 16:57:52 -- setup/hugepages.sh@84 -- # : 0 00:04:55.969 16:57:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:55.969 16:57:52 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:55.969 16:57:52 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:55.969 16:57:52 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:55.969 16:57:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.969 16:57:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:55.969 16:57:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.969 16:57:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.969 16:57:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:55.969 16:57:52 -- setup/hugepages.sh@78 -- # return 0 00:04:55.969 16:57:52 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:55.969 16:57:52 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:55.969 16:57:52 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:55.969 16:57:52 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:55.969 16:57:52 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:55.969 16:57:52 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.969 16:57:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:55.969 16:57:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.969 16:57:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.969 16:57:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:55.969 16:57:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.969 16:57:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:55.969 16:57:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.969 16:57:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:55.969 16:57:52 -- setup/hugepages.sh@78 -- # return 0 00:04:55.969 16:57:52 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:55.969 16:57:52 -- setup/hugepages.sh@187 -- # setup output 00:04:55.969 16:57:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.969 16:57:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:57.347 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:57.347 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:57.347 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:57.347 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:57.347 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:57.347 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:57.347 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:57.347 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:57.347 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:57.347 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:57.347 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:57.347 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:57.347 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:57.347 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:57.347 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:57.347 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:57.347 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:57.347 16:57:54 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:57.347 16:57:54 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:57.347 16:57:54 -- setup/hugepages.sh@89 -- # local node 00:04:57.347 16:57:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:57.347 16:57:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:57.347 16:57:54 -- setup/hugepages.sh@92 -- # local surp 00:04:57.347 16:57:54 -- setup/hugepages.sh@93 -- # local resv 00:04:57.347 16:57:54 -- setup/hugepages.sh@94 -- # local anon 00:04:57.347 16:57:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:57.347 16:57:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:57.347 16:57:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:57.347 16:57:54 -- setup/common.sh@18 -- # local node= 00:04:57.347 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.347 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.347 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.347 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.347 16:57:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.347 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.347 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42185644 kB' 'MemAvailable: 45958892 kB' 'Buffers: 2708 kB' 'Cached: 12727808 kB' 'SwapCached: 0 kB' 'Active: 9439064 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038584 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475884 kB' 'Mapped: 204960 kB' 'Shmem: 8565924 kB' 'KReclaimable: 204468 kB' 'Slab: 737264 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532796 kB' 'KernelStack: 12784 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10103628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.347 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.347 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.348 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.348 16:57:54 -- setup/common.sh@33 -- # echo 0 00:04:57.348 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.348 16:57:54 -- setup/hugepages.sh@97 -- # anon=0 00:04:57.348 16:57:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:57.348 16:57:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:57.348 16:57:54 -- setup/common.sh@18 -- # local node= 00:04:57.348 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.348 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.348 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.348 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.348 16:57:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.348 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.348 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.348 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42186392 kB' 'MemAvailable: 45959640 kB' 'Buffers: 2708 kB' 'Cached: 12727812 kB' 'SwapCached: 0 kB' 'Active: 9439008 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038528 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475868 kB' 'Mapped: 204920 kB' 'Shmem: 8565928 kB' 'KReclaimable: 204468 kB' 'Slab: 737280 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532812 kB' 'KernelStack: 12832 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10103640 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.349 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.349 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.611 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.611 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.612 16:57:54 -- setup/common.sh@33 -- # echo 0 00:04:57.612 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.612 16:57:54 -- setup/hugepages.sh@99 -- # surp=0 00:04:57.612 16:57:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:57.612 16:57:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:57.612 16:57:54 -- setup/common.sh@18 -- # local node= 00:04:57.612 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.612 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.612 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.612 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.612 16:57:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.612 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.612 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42186736 kB' 'MemAvailable: 45959984 kB' 'Buffers: 2708 kB' 'Cached: 12727816 kB' 'SwapCached: 0 kB' 'Active: 9438536 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038056 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475360 kB' 'Mapped: 204844 kB' 'Shmem: 8565932 kB' 'KReclaimable: 204468 kB' 'Slab: 737240 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532772 kB' 'KernelStack: 12816 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10103656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.612 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.612 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.613 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.613 16:57:54 -- setup/common.sh@33 -- # echo 0 00:04:57.613 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.613 16:57:54 -- setup/hugepages.sh@100 -- # resv=0 00:04:57.613 16:57:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:57.613 nr_hugepages=1536 00:04:57.613 16:57:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:57.613 resv_hugepages=0 00:04:57.613 16:57:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:57.613 surplus_hugepages=0 00:04:57.613 16:57:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:57.613 anon_hugepages=0 00:04:57.613 16:57:54 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:57.613 16:57:54 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:57.613 16:57:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:57.613 16:57:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:57.613 16:57:54 -- setup/common.sh@18 -- # local node= 00:04:57.613 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.613 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.613 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.613 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.613 16:57:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.613 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.613 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.613 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42187452 kB' 'MemAvailable: 45960700 kB' 'Buffers: 2708 kB' 'Cached: 12727836 kB' 'SwapCached: 0 kB' 'Active: 9438872 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038392 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475676 kB' 'Mapped: 204844 kB' 'Shmem: 8565952 kB' 'KReclaimable: 204468 kB' 'Slab: 737240 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532772 kB' 'KernelStack: 12832 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10103672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.614 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.614 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.615 16:57:54 -- setup/common.sh@33 -- # echo 1536 00:04:57.615 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.615 16:57:54 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:57.615 16:57:54 -- setup/hugepages.sh@112 -- # get_nodes 00:04:57.615 16:57:54 -- setup/hugepages.sh@27 -- # local node 00:04:57.615 16:57:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:57.615 16:57:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:57.615 16:57:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:57.615 16:57:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:57.615 16:57:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:57.615 16:57:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:57.615 16:57:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:57.615 16:57:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:57.615 16:57:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:57.615 16:57:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:57.615 16:57:54 -- setup/common.sh@18 -- # local node=0 00:04:57.615 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.615 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.615 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.615 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:57.615 16:57:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:57.615 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.615 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27107360 kB' 'MemUsed: 5718496 kB' 'SwapCached: 0 kB' 'Active: 3225756 kB' 'Inactive: 177232 kB' 'Active(anon): 3069032 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078980 kB' 'Mapped: 72116 kB' 'AnonPages: 327128 kB' 'Shmem: 2745024 kB' 'KernelStack: 7048 kB' 'PageTables: 4772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442548 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 319748 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.615 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.615 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@33 -- # echo 0 00:04:57.616 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.616 16:57:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:57.616 16:57:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:57.616 16:57:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:57.616 16:57:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:57.616 16:57:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:57.616 16:57:54 -- setup/common.sh@18 -- # local node=1 00:04:57.616 16:57:54 -- setup/common.sh@19 -- # local var val 00:04:57.616 16:57:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.616 16:57:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.616 16:57:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:57.616 16:57:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:57.616 16:57:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.616 16:57:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15080720 kB' 'MemUsed: 12629072 kB' 'SwapCached: 0 kB' 'Active: 6213184 kB' 'Inactive: 3586880 kB' 'Active(anon): 5969428 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9651592 kB' 'Mapped: 132728 kB' 'AnonPages: 148552 kB' 'Shmem: 5820956 kB' 'KernelStack: 5784 kB' 'PageTables: 3136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81668 kB' 'Slab: 294692 kB' 'SReclaimable: 81668 kB' 'SUnreclaim: 213024 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.616 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.616 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # continue 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.617 16:57:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.617 16:57:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.617 16:57:54 -- setup/common.sh@33 -- # echo 0 00:04:57.617 16:57:54 -- setup/common.sh@33 -- # return 0 00:04:57.617 16:57:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:57.617 16:57:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:57.617 16:57:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:57.617 16:57:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:57.617 16:57:54 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:57.617 node0=512 expecting 512 00:04:57.617 16:57:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:57.617 16:57:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:57.617 16:57:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:57.617 16:57:54 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:57.617 node1=1024 expecting 1024 00:04:57.617 16:57:54 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:57.617 00:04:57.617 real 0m1.525s 00:04:57.617 user 0m0.609s 00:04:57.617 sys 0m0.880s 00:04:57.617 16:57:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.617 16:57:54 -- common/autotest_common.sh@10 -- # set +x 00:04:57.617 ************************************ 00:04:57.617 END TEST custom_alloc 00:04:57.617 ************************************ 00:04:57.617 16:57:54 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:57.617 16:57:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.617 16:57:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.617 16:57:54 -- common/autotest_common.sh@10 -- # set +x 00:04:57.617 ************************************ 00:04:57.617 START TEST no_shrink_alloc 00:04:57.617 ************************************ 00:04:57.617 16:57:54 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:57.617 16:57:54 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:57.617 16:57:54 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:57.617 16:57:54 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:57.617 16:57:54 -- setup/hugepages.sh@51 -- # shift 00:04:57.617 16:57:54 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:57.617 16:57:54 -- setup/hugepages.sh@52 -- # local node_ids 00:04:57.617 16:57:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:57.617 16:57:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:57.617 16:57:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:57.617 16:57:54 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:57.617 16:57:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:57.617 16:57:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:57.617 16:57:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:57.617 16:57:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:57.617 16:57:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:57.617 16:57:54 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:57.617 16:57:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:57.617 16:57:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:57.617 16:57:54 -- setup/hugepages.sh@73 -- # return 0 00:04:57.617 16:57:54 -- setup/hugepages.sh@198 -- # setup output 00:04:57.617 16:57:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:57.617 16:57:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:58.996 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:58.996 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:58.996 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:58.996 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:58.996 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:58.996 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:58.996 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:58.996 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:58.996 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:58.997 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:58.997 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:58.997 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:58.997 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:58.997 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:58.997 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:58.997 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:58.997 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:58.997 16:57:55 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:58.997 16:57:55 -- setup/hugepages.sh@89 -- # local node 00:04:58.997 16:57:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:58.997 16:57:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:58.997 16:57:55 -- setup/hugepages.sh@92 -- # local surp 00:04:58.997 16:57:55 -- setup/hugepages.sh@93 -- # local resv 00:04:58.997 16:57:55 -- setup/hugepages.sh@94 -- # local anon 00:04:58.997 16:57:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:58.997 16:57:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:58.997 16:57:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:58.997 16:57:55 -- setup/common.sh@18 -- # local node= 00:04:58.997 16:57:55 -- setup/common.sh@19 -- # local var val 00:04:58.997 16:57:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.997 16:57:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.997 16:57:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.997 16:57:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.997 16:57:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.997 16:57:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43213376 kB' 'MemAvailable: 46986624 kB' 'Buffers: 2708 kB' 'Cached: 12727900 kB' 'SwapCached: 0 kB' 'Active: 9444520 kB' 'Inactive: 3764112 kB' 'Active(anon): 9044040 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481196 kB' 'Mapped: 205724 kB' 'Shmem: 8566016 kB' 'KReclaimable: 204468 kB' 'Slab: 736988 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532520 kB' 'KernelStack: 12832 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10109972 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.997 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.997 16:57:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.998 16:57:55 -- setup/common.sh@33 -- # echo 0 00:04:58.998 16:57:55 -- setup/common.sh@33 -- # return 0 00:04:58.998 16:57:55 -- setup/hugepages.sh@97 -- # anon=0 00:04:58.998 16:57:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:58.998 16:57:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:58.998 16:57:55 -- setup/common.sh@18 -- # local node= 00:04:58.998 16:57:55 -- setup/common.sh@19 -- # local var val 00:04:58.998 16:57:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.998 16:57:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.998 16:57:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.998 16:57:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.998 16:57:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.998 16:57:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43219296 kB' 'MemAvailable: 46992544 kB' 'Buffers: 2708 kB' 'Cached: 12727900 kB' 'SwapCached: 0 kB' 'Active: 9439352 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038872 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476096 kB' 'Mapped: 205268 kB' 'Shmem: 8566016 kB' 'KReclaimable: 204468 kB' 'Slab: 736972 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532504 kB' 'KernelStack: 12880 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.998 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.998 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.999 16:57:55 -- setup/common.sh@33 -- # echo 0 00:04:58.999 16:57:55 -- setup/common.sh@33 -- # return 0 00:04:58.999 16:57:55 -- setup/hugepages.sh@99 -- # surp=0 00:04:58.999 16:57:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:58.999 16:57:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:58.999 16:57:55 -- setup/common.sh@18 -- # local node= 00:04:58.999 16:57:55 -- setup/common.sh@19 -- # local var val 00:04:58.999 16:57:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.999 16:57:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.999 16:57:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.999 16:57:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.999 16:57:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.999 16:57:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43219920 kB' 'MemAvailable: 46993168 kB' 'Buffers: 2708 kB' 'Cached: 12727916 kB' 'SwapCached: 0 kB' 'Active: 9438964 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038484 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475760 kB' 'Mapped: 204852 kB' 'Shmem: 8566032 kB' 'KReclaimable: 204468 kB' 'Slab: 736964 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532496 kB' 'KernelStack: 12864 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.999 16:57:55 -- setup/common.sh@32 -- # continue 00:04:58.999 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.000 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.000 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.001 16:57:55 -- setup/common.sh@33 -- # echo 0 00:04:59.001 16:57:55 -- setup/common.sh@33 -- # return 0 00:04:59.001 16:57:55 -- setup/hugepages.sh@100 -- # resv=0 00:04:59.001 16:57:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:59.001 nr_hugepages=1024 00:04:59.001 16:57:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:59.001 resv_hugepages=0 00:04:59.001 16:57:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:59.001 surplus_hugepages=0 00:04:59.001 16:57:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:59.001 anon_hugepages=0 00:04:59.001 16:57:55 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:59.001 16:57:55 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:59.001 16:57:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:59.001 16:57:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:59.001 16:57:55 -- setup/common.sh@18 -- # local node= 00:04:59.001 16:57:55 -- setup/common.sh@19 -- # local var val 00:04:59.001 16:57:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.001 16:57:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.001 16:57:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:59.001 16:57:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:59.001 16:57:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.001 16:57:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43220256 kB' 'MemAvailable: 46993504 kB' 'Buffers: 2708 kB' 'Cached: 12727928 kB' 'SwapCached: 0 kB' 'Active: 9439020 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038540 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475768 kB' 'Mapped: 204852 kB' 'Shmem: 8566044 kB' 'KReclaimable: 204468 kB' 'Slab: 736964 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532496 kB' 'KernelStack: 12864 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.001 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.001 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.002 16:57:55 -- setup/common.sh@33 -- # echo 1024 00:04:59.002 16:57:55 -- setup/common.sh@33 -- # return 0 00:04:59.002 16:57:55 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:59.002 16:57:55 -- setup/hugepages.sh@112 -- # get_nodes 00:04:59.002 16:57:55 -- setup/hugepages.sh@27 -- # local node 00:04:59.002 16:57:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:59.002 16:57:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:59.002 16:57:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:59.002 16:57:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:59.002 16:57:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:59.002 16:57:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:59.002 16:57:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:59.002 16:57:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:59.002 16:57:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:59.002 16:57:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:59.002 16:57:55 -- setup/common.sh@18 -- # local node=0 00:04:59.002 16:57:55 -- setup/common.sh@19 -- # local var val 00:04:59.002 16:57:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.002 16:57:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.002 16:57:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:59.002 16:57:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:59.002 16:57:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.002 16:57:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26036424 kB' 'MemUsed: 6789432 kB' 'SwapCached: 0 kB' 'Active: 3225424 kB' 'Inactive: 177232 kB' 'Active(anon): 3068700 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3078988 kB' 'Mapped: 72124 kB' 'AnonPages: 326764 kB' 'Shmem: 2745032 kB' 'KernelStack: 7032 kB' 'PageTables: 4724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442388 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 319588 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.002 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.002 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # continue 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.003 16:57:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.003 16:57:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.003 16:57:55 -- setup/common.sh@33 -- # echo 0 00:04:59.003 16:57:55 -- setup/common.sh@33 -- # return 0 00:04:59.003 16:57:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:59.003 16:57:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:59.003 16:57:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:59.003 16:57:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:59.003 16:57:55 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:59.003 node0=1024 expecting 1024 00:04:59.003 16:57:55 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:59.003 16:57:55 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:59.003 16:57:55 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:59.003 16:57:55 -- setup/hugepages.sh@202 -- # setup output 00:04:59.003 16:57:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:59.003 16:57:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:00.382 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:00.382 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:00.382 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:00.382 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:00.382 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:00.382 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:00.382 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:00.382 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:00.382 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:00.382 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:00.382 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:00.382 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:00.382 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:00.382 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:00.382 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:00.382 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:00.382 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:00.382 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:05:00.382 16:57:57 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:05:00.382 16:57:57 -- setup/hugepages.sh@89 -- # local node 00:05:00.382 16:57:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:00.382 16:57:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:00.382 16:57:57 -- setup/hugepages.sh@92 -- # local surp 00:05:00.382 16:57:57 -- setup/hugepages.sh@93 -- # local resv 00:05:00.382 16:57:57 -- setup/hugepages.sh@94 -- # local anon 00:05:00.382 16:57:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:00.382 16:57:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:00.382 16:57:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:00.382 16:57:57 -- setup/common.sh@18 -- # local node= 00:05:00.382 16:57:57 -- setup/common.sh@19 -- # local var val 00:05:00.382 16:57:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.382 16:57:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.382 16:57:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.382 16:57:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.382 16:57:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.382 16:57:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.382 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.382 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43215708 kB' 'MemAvailable: 46988956 kB' 'Buffers: 2708 kB' 'Cached: 12727976 kB' 'SwapCached: 0 kB' 'Active: 9440220 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039740 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476540 kB' 'Mapped: 204904 kB' 'Shmem: 8566092 kB' 'KReclaimable: 204468 kB' 'Slab: 737244 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532776 kB' 'KernelStack: 12944 kB' 'PageTables: 8120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.383 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.383 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.384 16:57:57 -- setup/common.sh@33 -- # echo 0 00:05:00.384 16:57:57 -- setup/common.sh@33 -- # return 0 00:05:00.384 16:57:57 -- setup/hugepages.sh@97 -- # anon=0 00:05:00.384 16:57:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:00.384 16:57:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:00.384 16:57:57 -- setup/common.sh@18 -- # local node= 00:05:00.384 16:57:57 -- setup/common.sh@19 -- # local var val 00:05:00.384 16:57:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.384 16:57:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.384 16:57:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.384 16:57:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.384 16:57:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.384 16:57:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43218700 kB' 'MemAvailable: 46991948 kB' 'Buffers: 2708 kB' 'Cached: 12727980 kB' 'SwapCached: 0 kB' 'Active: 9440244 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039764 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476964 kB' 'Mapped: 204872 kB' 'Shmem: 8566096 kB' 'KReclaimable: 204468 kB' 'Slab: 737236 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532768 kB' 'KernelStack: 12912 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.384 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.384 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.385 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.385 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.386 16:57:57 -- setup/common.sh@33 -- # echo 0 00:05:00.386 16:57:57 -- setup/common.sh@33 -- # return 0 00:05:00.386 16:57:57 -- setup/hugepages.sh@99 -- # surp=0 00:05:00.386 16:57:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:00.386 16:57:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:00.386 16:57:57 -- setup/common.sh@18 -- # local node= 00:05:00.386 16:57:57 -- setup/common.sh@19 -- # local var val 00:05:00.386 16:57:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.386 16:57:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.386 16:57:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.386 16:57:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.386 16:57:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.386 16:57:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43219080 kB' 'MemAvailable: 46992328 kB' 'Buffers: 2708 kB' 'Cached: 12727996 kB' 'SwapCached: 0 kB' 'Active: 9439256 kB' 'Inactive: 3764112 kB' 'Active(anon): 9038776 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475856 kB' 'Mapped: 204792 kB' 'Shmem: 8566112 kB' 'KReclaimable: 204468 kB' 'Slab: 737188 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532720 kB' 'KernelStack: 12864 kB' 'PageTables: 7792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10103852 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.386 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.386 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.387 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.387 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.388 16:57:57 -- setup/common.sh@33 -- # echo 0 00:05:00.388 16:57:57 -- setup/common.sh@33 -- # return 0 00:05:00.388 16:57:57 -- setup/hugepages.sh@100 -- # resv=0 00:05:00.388 16:57:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:00.388 nr_hugepages=1024 00:05:00.388 16:57:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:00.388 resv_hugepages=0 00:05:00.388 16:57:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:00.388 surplus_hugepages=0 00:05:00.388 16:57:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:00.388 anon_hugepages=0 00:05:00.388 16:57:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:00.388 16:57:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:00.388 16:57:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:00.388 16:57:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:00.388 16:57:57 -- setup/common.sh@18 -- # local node= 00:05:00.388 16:57:57 -- setup/common.sh@19 -- # local var val 00:05:00.388 16:57:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.388 16:57:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.388 16:57:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.388 16:57:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.388 16:57:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.388 16:57:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43219656 kB' 'MemAvailable: 46992904 kB' 'Buffers: 2708 kB' 'Cached: 12728012 kB' 'SwapCached: 0 kB' 'Active: 9439924 kB' 'Inactive: 3764112 kB' 'Active(anon): 9039444 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476516 kB' 'Mapped: 204856 kB' 'Shmem: 8566128 kB' 'KReclaimable: 204468 kB' 'Slab: 737188 kB' 'SReclaimable: 204468 kB' 'SUnreclaim: 532720 kB' 'KernelStack: 12896 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10107168 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2039388 kB' 'DirectMap2M: 14657536 kB' 'DirectMap1G: 53477376 kB' 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.388 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.388 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.389 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.389 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.390 16:57:57 -- setup/common.sh@33 -- # echo 1024 00:05:00.390 16:57:57 -- setup/common.sh@33 -- # return 0 00:05:00.390 16:57:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:00.390 16:57:57 -- setup/hugepages.sh@112 -- # get_nodes 00:05:00.390 16:57:57 -- setup/hugepages.sh@27 -- # local node 00:05:00.390 16:57:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:00.390 16:57:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:00.390 16:57:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:00.390 16:57:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:00.390 16:57:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:00.390 16:57:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:00.390 16:57:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:00.390 16:57:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:00.390 16:57:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:00.390 16:57:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:00.390 16:57:57 -- setup/common.sh@18 -- # local node=0 00:05:00.390 16:57:57 -- setup/common.sh@19 -- # local var val 00:05:00.390 16:57:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.390 16:57:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.390 16:57:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:00.390 16:57:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:00.390 16:57:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.390 16:57:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26044652 kB' 'MemUsed: 6781204 kB' 'SwapCached: 0 kB' 'Active: 3225868 kB' 'Inactive: 177232 kB' 'Active(anon): 3069144 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3079036 kB' 'Mapped: 72128 kB' 'AnonPages: 327160 kB' 'Shmem: 2745080 kB' 'KernelStack: 7032 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122800 kB' 'Slab: 442572 kB' 'SReclaimable: 122800 kB' 'SUnreclaim: 319772 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.390 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.390 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # continue 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.391 16:57:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.391 16:57:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.391 16:57:57 -- setup/common.sh@33 -- # echo 0 00:05:00.391 16:57:57 -- setup/common.sh@33 -- # return 0 00:05:00.391 16:57:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:00.391 16:57:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:00.391 16:57:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:00.391 16:57:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:00.391 16:57:57 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:00.391 node0=1024 expecting 1024 00:05:00.392 16:57:57 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:00.392 00:05:00.392 real 0m2.786s 00:05:00.392 user 0m1.108s 00:05:00.392 sys 0m1.605s 00:05:00.392 16:57:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.392 16:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:00.392 ************************************ 00:05:00.392 END TEST no_shrink_alloc 00:05:00.392 ************************************ 00:05:00.392 16:57:57 -- setup/hugepages.sh@217 -- # clear_hp 00:05:00.392 16:57:57 -- setup/hugepages.sh@37 -- # local node hp 00:05:00.392 16:57:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:00.392 16:57:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:00.392 16:57:57 -- setup/hugepages.sh@41 -- # echo 0 00:05:00.392 16:57:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:00.392 16:57:57 -- setup/hugepages.sh@41 -- # echo 0 00:05:00.392 16:57:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:00.392 16:57:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:00.392 16:57:57 -- setup/hugepages.sh@41 -- # echo 0 00:05:00.392 16:57:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:00.392 16:57:57 -- setup/hugepages.sh@41 -- # echo 0 00:05:00.392 16:57:57 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:00.392 16:57:57 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:00.392 00:05:00.392 real 0m11.539s 00:05:00.392 user 0m4.372s 00:05:00.392 sys 0m6.103s 00:05:00.392 16:57:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.392 16:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:00.392 ************************************ 00:05:00.392 END TEST hugepages 00:05:00.392 ************************************ 00:05:00.392 16:57:57 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:00.392 16:57:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:00.392 16:57:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.392 16:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:00.392 ************************************ 00:05:00.392 START TEST driver 00:05:00.392 ************************************ 00:05:00.392 16:57:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:00.392 * Looking for test storage... 00:05:00.392 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:00.392 16:57:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:00.392 16:57:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:00.650 16:57:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:00.650 16:57:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:00.650 16:57:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:00.650 16:57:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:00.650 16:57:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:00.650 16:57:57 -- scripts/common.sh@335 -- # IFS=.-: 00:05:00.650 16:57:57 -- scripts/common.sh@335 -- # read -ra ver1 00:05:00.650 16:57:57 -- scripts/common.sh@336 -- # IFS=.-: 00:05:00.650 16:57:57 -- scripts/common.sh@336 -- # read -ra ver2 00:05:00.650 16:57:57 -- scripts/common.sh@337 -- # local 'op=<' 00:05:00.650 16:57:57 -- scripts/common.sh@339 -- # ver1_l=2 00:05:00.650 16:57:57 -- scripts/common.sh@340 -- # ver2_l=1 00:05:00.650 16:57:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:00.650 16:57:57 -- scripts/common.sh@343 -- # case "$op" in 00:05:00.650 16:57:57 -- scripts/common.sh@344 -- # : 1 00:05:00.650 16:57:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:00.650 16:57:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:00.650 16:57:57 -- scripts/common.sh@364 -- # decimal 1 00:05:00.650 16:57:57 -- scripts/common.sh@352 -- # local d=1 00:05:00.650 16:57:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:00.650 16:57:57 -- scripts/common.sh@354 -- # echo 1 00:05:00.650 16:57:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:00.650 16:57:57 -- scripts/common.sh@365 -- # decimal 2 00:05:00.650 16:57:57 -- scripts/common.sh@352 -- # local d=2 00:05:00.650 16:57:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:00.650 16:57:57 -- scripts/common.sh@354 -- # echo 2 00:05:00.650 16:57:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:00.650 16:57:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:00.650 16:57:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:00.650 16:57:57 -- scripts/common.sh@367 -- # return 0 00:05:00.650 16:57:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:00.650 16:57:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:00.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.650 --rc genhtml_branch_coverage=1 00:05:00.650 --rc genhtml_function_coverage=1 00:05:00.650 --rc genhtml_legend=1 00:05:00.650 --rc geninfo_all_blocks=1 00:05:00.650 --rc geninfo_unexecuted_blocks=1 00:05:00.650 00:05:00.650 ' 00:05:00.650 16:57:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:00.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.650 --rc genhtml_branch_coverage=1 00:05:00.650 --rc genhtml_function_coverage=1 00:05:00.650 --rc genhtml_legend=1 00:05:00.650 --rc geninfo_all_blocks=1 00:05:00.650 --rc geninfo_unexecuted_blocks=1 00:05:00.650 00:05:00.650 ' 00:05:00.650 16:57:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:00.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.650 --rc genhtml_branch_coverage=1 00:05:00.650 --rc genhtml_function_coverage=1 00:05:00.650 --rc genhtml_legend=1 00:05:00.650 --rc geninfo_all_blocks=1 00:05:00.651 --rc geninfo_unexecuted_blocks=1 00:05:00.651 00:05:00.651 ' 00:05:00.651 16:57:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:00.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.651 --rc genhtml_branch_coverage=1 00:05:00.651 --rc genhtml_function_coverage=1 00:05:00.651 --rc genhtml_legend=1 00:05:00.651 --rc geninfo_all_blocks=1 00:05:00.651 --rc geninfo_unexecuted_blocks=1 00:05:00.651 00:05:00.651 ' 00:05:00.651 16:57:57 -- setup/driver.sh@68 -- # setup reset 00:05:00.651 16:57:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:00.651 16:57:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:03.186 16:57:59 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:05:03.186 16:57:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.186 16:57:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.186 16:57:59 -- common/autotest_common.sh@10 -- # set +x 00:05:03.186 ************************************ 00:05:03.186 START TEST guess_driver 00:05:03.186 ************************************ 00:05:03.186 16:57:59 -- common/autotest_common.sh@1114 -- # guess_driver 00:05:03.186 16:57:59 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:05:03.186 16:57:59 -- setup/driver.sh@47 -- # local fail=0 00:05:03.186 16:57:59 -- setup/driver.sh@49 -- # pick_driver 00:05:03.186 16:57:59 -- setup/driver.sh@36 -- # vfio 00:05:03.186 16:57:59 -- setup/driver.sh@21 -- # local iommu_grups 00:05:03.186 16:57:59 -- setup/driver.sh@22 -- # local unsafe_vfio 00:05:03.186 16:57:59 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:05:03.186 16:57:59 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:05:03.186 16:57:59 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:05:03.186 16:57:59 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:05:03.186 16:57:59 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:05:03.186 16:57:59 -- setup/driver.sh@14 -- # mod vfio_pci 00:05:03.186 16:57:59 -- setup/driver.sh@12 -- # dep vfio_pci 00:05:03.186 16:57:59 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:05:03.186 16:57:59 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:05:03.186 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:05:03.186 16:57:59 -- setup/driver.sh@30 -- # return 0 00:05:03.186 16:57:59 -- setup/driver.sh@37 -- # echo vfio-pci 00:05:03.186 16:57:59 -- setup/driver.sh@49 -- # driver=vfio-pci 00:05:03.186 16:57:59 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:05:03.186 16:57:59 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:05:03.186 Looking for driver=vfio-pci 00:05:03.186 16:57:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:03.186 16:57:59 -- setup/driver.sh@45 -- # setup output config 00:05:03.186 16:57:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:03.186 16:57:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.564 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.564 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.564 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:04.565 16:58:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:04.565 16:58:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:04.565 16:58:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:05.504 16:58:02 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:05.505 16:58:02 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:05.505 16:58:02 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:05.505 16:58:02 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:05.505 16:58:02 -- setup/driver.sh@65 -- # setup reset 00:05:05.505 16:58:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:05.505 16:58:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:08.088 00:05:08.088 real 0m4.860s 00:05:08.088 user 0m1.149s 00:05:08.088 sys 0m1.920s 00:05:08.088 16:58:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.088 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:08.088 ************************************ 00:05:08.088 END TEST guess_driver 00:05:08.088 ************************************ 00:05:08.088 00:05:08.088 real 0m7.497s 00:05:08.088 user 0m1.789s 00:05:08.088 sys 0m3.006s 00:05:08.088 16:58:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.088 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:08.088 ************************************ 00:05:08.088 END TEST driver 00:05:08.088 ************************************ 00:05:08.088 16:58:04 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:08.088 16:58:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.088 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:08.088 ************************************ 00:05:08.088 START TEST devices 00:05:08.088 ************************************ 00:05:08.088 16:58:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:08.088 * Looking for test storage... 00:05:08.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:08.088 16:58:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:08.088 16:58:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:08.088 16:58:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:08.088 16:58:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:08.088 16:58:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:08.088 16:58:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:08.088 16:58:04 -- scripts/common.sh@335 -- # IFS=.-: 00:05:08.088 16:58:04 -- scripts/common.sh@335 -- # read -ra ver1 00:05:08.088 16:58:04 -- scripts/common.sh@336 -- # IFS=.-: 00:05:08.088 16:58:04 -- scripts/common.sh@336 -- # read -ra ver2 00:05:08.088 16:58:04 -- scripts/common.sh@337 -- # local 'op=<' 00:05:08.088 16:58:04 -- scripts/common.sh@339 -- # ver1_l=2 00:05:08.088 16:58:04 -- scripts/common.sh@340 -- # ver2_l=1 00:05:08.088 16:58:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:08.088 16:58:04 -- scripts/common.sh@343 -- # case "$op" in 00:05:08.088 16:58:04 -- scripts/common.sh@344 -- # : 1 00:05:08.088 16:58:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:08.088 16:58:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:08.088 16:58:04 -- scripts/common.sh@364 -- # decimal 1 00:05:08.088 16:58:04 -- scripts/common.sh@352 -- # local d=1 00:05:08.088 16:58:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:08.088 16:58:04 -- scripts/common.sh@354 -- # echo 1 00:05:08.088 16:58:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:08.088 16:58:04 -- scripts/common.sh@365 -- # decimal 2 00:05:08.088 16:58:04 -- scripts/common.sh@352 -- # local d=2 00:05:08.088 16:58:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:08.088 16:58:04 -- scripts/common.sh@354 -- # echo 2 00:05:08.088 16:58:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:08.088 16:58:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:08.088 16:58:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:08.088 16:58:04 -- scripts/common.sh@367 -- # return 0 00:05:08.088 16:58:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:08.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.088 --rc genhtml_branch_coverage=1 00:05:08.088 --rc genhtml_function_coverage=1 00:05:08.088 --rc genhtml_legend=1 00:05:08.088 --rc geninfo_all_blocks=1 00:05:08.088 --rc geninfo_unexecuted_blocks=1 00:05:08.088 00:05:08.088 ' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:08.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.088 --rc genhtml_branch_coverage=1 00:05:08.088 --rc genhtml_function_coverage=1 00:05:08.088 --rc genhtml_legend=1 00:05:08.088 --rc geninfo_all_blocks=1 00:05:08.088 --rc geninfo_unexecuted_blocks=1 00:05:08.088 00:05:08.088 ' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:08.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.088 --rc genhtml_branch_coverage=1 00:05:08.088 --rc genhtml_function_coverage=1 00:05:08.088 --rc genhtml_legend=1 00:05:08.088 --rc geninfo_all_blocks=1 00:05:08.088 --rc geninfo_unexecuted_blocks=1 00:05:08.088 00:05:08.088 ' 00:05:08.088 16:58:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:08.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.088 --rc genhtml_branch_coverage=1 00:05:08.088 --rc genhtml_function_coverage=1 00:05:08.088 --rc genhtml_legend=1 00:05:08.088 --rc geninfo_all_blocks=1 00:05:08.088 --rc geninfo_unexecuted_blocks=1 00:05:08.088 00:05:08.088 ' 00:05:08.088 16:58:04 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:08.088 16:58:04 -- setup/devices.sh@192 -- # setup reset 00:05:08.088 16:58:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:08.088 16:58:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:09.494 16:58:06 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:09.494 16:58:06 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:09.494 16:58:06 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:09.494 16:58:06 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:09.494 16:58:06 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:09.494 16:58:06 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:09.494 16:58:06 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:09.494 16:58:06 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:09.494 16:58:06 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:09.494 16:58:06 -- setup/devices.sh@196 -- # blocks=() 00:05:09.494 16:58:06 -- setup/devices.sh@196 -- # declare -a blocks 00:05:09.494 16:58:06 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:09.494 16:58:06 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:09.494 16:58:06 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:09.494 16:58:06 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:09.494 16:58:06 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:09.494 16:58:06 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:09.494 16:58:06 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:09.494 16:58:06 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:09.494 16:58:06 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:09.494 16:58:06 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:09.494 16:58:06 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:09.494 No valid GPT data, bailing 00:05:09.753 16:58:06 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:09.753 16:58:06 -- scripts/common.sh@393 -- # pt= 00:05:09.753 16:58:06 -- scripts/common.sh@394 -- # return 1 00:05:09.753 16:58:06 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:09.753 16:58:06 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:09.753 16:58:06 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:09.753 16:58:06 -- setup/common.sh@80 -- # echo 1000204886016 00:05:09.753 16:58:06 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:09.753 16:58:06 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:09.753 16:58:06 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:09.753 16:58:06 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:09.753 16:58:06 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:09.753 16:58:06 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:09.753 16:58:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.753 16:58:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.753 16:58:06 -- common/autotest_common.sh@10 -- # set +x 00:05:09.753 ************************************ 00:05:09.753 START TEST nvme_mount 00:05:09.753 ************************************ 00:05:09.753 16:58:06 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:09.753 16:58:06 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:09.753 16:58:06 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:09.753 16:58:06 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.754 16:58:06 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.754 16:58:06 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:09.754 16:58:06 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:09.754 16:58:06 -- setup/common.sh@40 -- # local part_no=1 00:05:09.754 16:58:06 -- setup/common.sh@41 -- # local size=1073741824 00:05:09.754 16:58:06 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:09.754 16:58:06 -- setup/common.sh@44 -- # parts=() 00:05:09.754 16:58:06 -- setup/common.sh@44 -- # local parts 00:05:09.754 16:58:06 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:09.754 16:58:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:09.754 16:58:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:09.754 16:58:06 -- setup/common.sh@46 -- # (( part++ )) 00:05:09.754 16:58:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:09.754 16:58:06 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:09.754 16:58:06 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:09.754 16:58:06 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:10.690 Creating new GPT entries in memory. 00:05:10.690 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:10.690 other utilities. 00:05:10.690 16:58:07 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:10.690 16:58:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:10.690 16:58:07 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:10.690 16:58:07 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:10.690 16:58:07 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:11.626 Creating new GPT entries in memory. 00:05:11.626 The operation has completed successfully. 00:05:11.626 16:58:08 -- setup/common.sh@57 -- # (( part++ )) 00:05:11.626 16:58:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:11.626 16:58:08 -- setup/common.sh@62 -- # wait 1607331 00:05:11.626 16:58:08 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.626 16:58:08 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:11.626 16:58:08 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.626 16:58:08 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:11.626 16:58:08 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:11.885 16:58:08 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.885 16:58:08 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:11.885 16:58:08 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:11.885 16:58:08 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:11.885 16:58:08 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.885 16:58:08 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:11.885 16:58:08 -- setup/devices.sh@53 -- # local found=0 00:05:11.885 16:58:08 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:11.885 16:58:08 -- setup/devices.sh@56 -- # : 00:05:11.885 16:58:08 -- setup/devices.sh@59 -- # local pci status 00:05:11.885 16:58:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.885 16:58:08 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:11.885 16:58:08 -- setup/devices.sh@47 -- # setup output config 00:05:11.885 16:58:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:11.885 16:58:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:12.823 16:58:09 -- setup/devices.sh@63 -- # found=1 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.823 16:58:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.823 16:58:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.082 16:58:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:13.082 16:58:09 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:13.082 16:58:09 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.082 16:58:09 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:13.082 16:58:09 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:13.082 16:58:09 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:13.082 16:58:09 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.083 16:58:09 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.083 16:58:09 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:13.083 16:58:09 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:13.083 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:13.083 16:58:09 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:13.083 16:58:09 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:13.342 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:13.342 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:13.342 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:13.342 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:13.342 16:58:10 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:13.342 16:58:10 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:13.342 16:58:10 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.342 16:58:10 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:13.342 16:58:10 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:13.342 16:58:10 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.342 16:58:10 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:13.342 16:58:10 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:13.342 16:58:10 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:13.342 16:58:10 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:13.342 16:58:10 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:13.342 16:58:10 -- setup/devices.sh@53 -- # local found=0 00:05:13.342 16:58:10 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:13.342 16:58:10 -- setup/devices.sh@56 -- # : 00:05:13.342 16:58:10 -- setup/devices.sh@59 -- # local pci status 00:05:13.342 16:58:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.342 16:58:10 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:13.342 16:58:10 -- setup/devices.sh@47 -- # setup output config 00:05:13.342 16:58:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:13.342 16:58:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:14.278 16:58:11 -- setup/devices.sh@63 -- # found=1 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.278 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.278 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:14.537 16:58:11 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:14.537 16:58:11 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:14.537 16:58:11 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:14.537 16:58:11 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:14.537 16:58:11 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:14.537 16:58:11 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:14.537 16:58:11 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:14.537 16:58:11 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:14.537 16:58:11 -- setup/devices.sh@50 -- # local mount_point= 00:05:14.537 16:58:11 -- setup/devices.sh@51 -- # local test_file= 00:05:14.537 16:58:11 -- setup/devices.sh@53 -- # local found=0 00:05:14.537 16:58:11 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:14.537 16:58:11 -- setup/devices.sh@59 -- # local pci status 00:05:14.537 16:58:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.537 16:58:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:14.537 16:58:11 -- setup/devices.sh@47 -- # setup output config 00:05:14.537 16:58:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:14.537 16:58:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:15.910 16:58:12 -- setup/devices.sh@63 -- # found=1 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.910 16:58:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:15.910 16:58:12 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:15.910 16:58:12 -- setup/devices.sh@68 -- # return 0 00:05:15.910 16:58:12 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:15.910 16:58:12 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:15.910 16:58:12 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:15.910 16:58:12 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:15.910 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:15.910 00:05:15.910 real 0m6.296s 00:05:15.910 user 0m1.393s 00:05:15.910 sys 0m2.498s 00:05:15.910 16:58:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:15.910 16:58:12 -- common/autotest_common.sh@10 -- # set +x 00:05:15.910 ************************************ 00:05:15.910 END TEST nvme_mount 00:05:15.910 ************************************ 00:05:15.910 16:58:12 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:15.910 16:58:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.910 16:58:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.910 16:58:12 -- common/autotest_common.sh@10 -- # set +x 00:05:15.910 ************************************ 00:05:15.910 START TEST dm_mount 00:05:15.910 ************************************ 00:05:15.910 16:58:12 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:15.910 16:58:12 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:15.910 16:58:12 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:15.910 16:58:12 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:15.911 16:58:12 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:15.911 16:58:12 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:15.911 16:58:12 -- setup/common.sh@40 -- # local part_no=2 00:05:15.911 16:58:12 -- setup/common.sh@41 -- # local size=1073741824 00:05:15.911 16:58:12 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:15.911 16:58:12 -- setup/common.sh@44 -- # parts=() 00:05:15.911 16:58:12 -- setup/common.sh@44 -- # local parts 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:15.911 16:58:12 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part++ )) 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:15.911 16:58:12 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part++ )) 00:05:15.911 16:58:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:15.911 16:58:12 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:15.911 16:58:12 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:15.911 16:58:12 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:16.847 Creating new GPT entries in memory. 00:05:16.847 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:16.847 other utilities. 00:05:16.847 16:58:13 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:16.847 16:58:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:16.847 16:58:13 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:16.847 16:58:13 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:16.847 16:58:13 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:18.224 Creating new GPT entries in memory. 00:05:18.224 The operation has completed successfully. 00:05:18.224 16:58:14 -- setup/common.sh@57 -- # (( part++ )) 00:05:18.224 16:58:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:18.224 16:58:14 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:18.224 16:58:14 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:18.224 16:58:14 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:19.161 The operation has completed successfully. 00:05:19.161 16:58:15 -- setup/common.sh@57 -- # (( part++ )) 00:05:19.161 16:58:15 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:19.161 16:58:15 -- setup/common.sh@62 -- # wait 1609786 00:05:19.161 16:58:15 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:19.161 16:58:15 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:19.161 16:58:15 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:19.161 16:58:15 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:19.161 16:58:15 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:19.161 16:58:15 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:19.161 16:58:15 -- setup/devices.sh@161 -- # break 00:05:19.161 16:58:15 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:19.161 16:58:15 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:19.161 16:58:15 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:19.162 16:58:15 -- setup/devices.sh@166 -- # dm=dm-0 00:05:19.162 16:58:15 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:19.162 16:58:15 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:19.162 16:58:15 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:19.162 16:58:15 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:19.162 16:58:15 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:19.162 16:58:15 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:19.162 16:58:15 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:19.162 16:58:15 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:19.162 16:58:15 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:19.162 16:58:15 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:19.162 16:58:15 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:19.162 16:58:15 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:19.162 16:58:15 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:19.162 16:58:15 -- setup/devices.sh@53 -- # local found=0 00:05:19.162 16:58:15 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:19.162 16:58:15 -- setup/devices.sh@56 -- # : 00:05:19.162 16:58:15 -- setup/devices.sh@59 -- # local pci status 00:05:19.162 16:58:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:19.162 16:58:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:19.162 16:58:15 -- setup/devices.sh@47 -- # setup output config 00:05:19.162 16:58:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:19.162 16:58:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:20.100 16:58:17 -- setup/devices.sh@63 -- # found=1 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.100 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.100 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:20.359 16:58:17 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:20.359 16:58:17 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:20.359 16:58:17 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:20.359 16:58:17 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:20.359 16:58:17 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:20.359 16:58:17 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:20.359 16:58:17 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:20.359 16:58:17 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:20.359 16:58:17 -- setup/devices.sh@50 -- # local mount_point= 00:05:20.359 16:58:17 -- setup/devices.sh@51 -- # local test_file= 00:05:20.359 16:58:17 -- setup/devices.sh@53 -- # local found=0 00:05:20.359 16:58:17 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:20.359 16:58:17 -- setup/devices.sh@59 -- # local pci status 00:05:20.359 16:58:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.359 16:58:17 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:20.359 16:58:17 -- setup/devices.sh@47 -- # setup output config 00:05:20.359 16:58:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:20.359 16:58:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:21.736 16:58:18 -- setup/devices.sh@63 -- # found=1 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.736 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.736 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.737 16:58:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:21.737 16:58:18 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:21.737 16:58:18 -- setup/devices.sh@68 -- # return 0 00:05:21.737 16:58:18 -- setup/devices.sh@187 -- # cleanup_dm 00:05:21.737 16:58:18 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:21.737 16:58:18 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:21.737 16:58:18 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:21.737 16:58:18 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:21.737 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:21.737 16:58:18 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:21.737 00:05:21.737 real 0m5.855s 00:05:21.737 user 0m0.971s 00:05:21.737 sys 0m1.759s 00:05:21.737 16:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.737 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:21.737 ************************************ 00:05:21.737 END TEST dm_mount 00:05:21.737 ************************************ 00:05:21.737 16:58:18 -- setup/devices.sh@1 -- # cleanup 00:05:21.737 16:58:18 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:21.737 16:58:18 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:21.737 16:58:18 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:21.737 16:58:18 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:21.737 16:58:18 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:21.996 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:21.996 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:21.996 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:21.996 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:21.996 16:58:18 -- setup/devices.sh@12 -- # cleanup_dm 00:05:21.996 16:58:18 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:21.996 16:58:18 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:21.996 16:58:18 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:21.996 16:58:18 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:21.996 16:58:18 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:21.996 16:58:18 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:21.996 00:05:21.996 real 0m14.139s 00:05:21.996 user 0m3.081s 00:05:21.996 sys 0m5.296s 00:05:21.996 16:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.996 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:21.996 ************************************ 00:05:21.996 END TEST devices 00:05:21.996 ************************************ 00:05:22.255 00:05:22.255 real 0m44.216s 00:05:22.255 user 0m12.704s 00:05:22.255 sys 0m20.139s 00:05:22.255 16:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.255 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:22.255 ************************************ 00:05:22.255 END TEST setup.sh 00:05:22.255 ************************************ 00:05:22.255 16:58:18 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:23.189 Hugepages 00:05:23.189 node hugesize free / total 00:05:23.189 node0 1048576kB 0 / 0 00:05:23.189 node0 2048kB 2048 / 2048 00:05:23.189 node1 1048576kB 0 / 0 00:05:23.189 node1 2048kB 0 / 0 00:05:23.189 00:05:23.189 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:23.189 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:23.189 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:23.189 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:23.448 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:23.448 16:58:20 -- spdk/autotest.sh@128 -- # uname -s 00:05:23.448 16:58:20 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:23.448 16:58:20 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:23.448 16:58:20 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:24.383 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:24.642 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:24.642 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:25.583 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:25.583 16:58:22 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:26.963 16:58:23 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:26.963 16:58:23 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:26.963 16:58:23 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:26.963 16:58:23 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:26.963 16:58:23 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:26.963 16:58:23 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:26.963 16:58:23 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:26.963 16:58:23 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:26.963 16:58:23 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:26.963 16:58:23 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:26.963 16:58:23 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:26.963 16:58:23 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:27.898 Waiting for block devices as requested 00:05:27.898 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:28.156 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:28.156 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:28.156 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:28.156 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:28.415 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:28.415 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:28.415 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:28.416 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:28.674 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:28.674 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:28.674 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:28.674 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:28.933 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:28.933 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:28.933 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:28.933 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:29.192 16:58:25 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:29.192 16:58:25 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:29.192 16:58:25 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:29.192 16:58:25 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:29.192 16:58:25 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:29.192 16:58:25 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:29.192 16:58:25 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:29.192 16:58:25 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:29.192 16:58:25 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:29.192 16:58:25 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:29.192 16:58:25 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:29.192 16:58:25 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:29.192 16:58:25 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:29.192 16:58:25 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:29.192 16:58:25 -- common/autotest_common.sh@1552 -- # continue 00:05:29.192 16:58:25 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:29.192 16:58:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:29.192 16:58:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.192 16:58:26 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:29.192 16:58:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:29.192 16:58:26 -- common/autotest_common.sh@10 -- # set +x 00:05:29.192 16:58:26 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:30.566 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:30.566 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:30.566 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:31.503 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:31.503 16:58:28 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:31.503 16:58:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:31.503 16:58:28 -- common/autotest_common.sh@10 -- # set +x 00:05:31.503 16:58:28 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:31.503 16:58:28 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:31.503 16:58:28 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:31.503 16:58:28 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:31.503 16:58:28 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:31.503 16:58:28 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:31.503 16:58:28 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:31.503 16:58:28 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:31.503 16:58:28 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:31.503 16:58:28 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:31.503 16:58:28 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:31.762 16:58:28 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:31.762 16:58:28 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:31.762 16:58:28 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:31.762 16:58:28 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:31.762 16:58:28 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:31.762 16:58:28 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:31.762 16:58:28 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:31.762 16:58:28 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:31.762 16:58:28 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:31.762 16:58:28 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1615106 00:05:31.762 16:58:28 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:31.762 16:58:28 -- common/autotest_common.sh@1593 -- # waitforlisten 1615106 00:05:31.762 16:58:28 -- common/autotest_common.sh@829 -- # '[' -z 1615106 ']' 00:05:31.762 16:58:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:31.762 16:58:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.762 16:58:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:31.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:31.762 16:58:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.762 16:58:28 -- common/autotest_common.sh@10 -- # set +x 00:05:31.762 [2024-11-27 16:58:28.543613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:31.762 [2024-11-27 16:58:28.543682] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1615106 ] 00:05:31.762 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.762 [2024-11-27 16:58:28.604448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.762 [2024-11-27 16:58:28.692642] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.762 [2024-11-27 16:58:28.692837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.708 16:58:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.708 16:58:29 -- common/autotest_common.sh@862 -- # return 0 00:05:32.708 16:58:29 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:32.708 16:58:29 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:32.708 16:58:29 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:35.995 nvme0n1 00:05:35.995 16:58:32 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:35.995 [2024-11-27 16:58:32.808045] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:35.995 [2024-11-27 16:58:32.808097] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:35.995 request: 00:05:35.995 { 00:05:35.995 "nvme_ctrlr_name": "nvme0", 00:05:35.995 "password": "test", 00:05:35.995 "method": "bdev_nvme_opal_revert", 00:05:35.995 "req_id": 1 00:05:35.995 } 00:05:35.995 Got JSON-RPC error response 00:05:35.995 response: 00:05:35.995 { 00:05:35.995 "code": -32603, 00:05:35.995 "message": "Internal error" 00:05:35.995 } 00:05:35.995 16:58:32 -- common/autotest_common.sh@1599 -- # true 00:05:35.995 16:58:32 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:35.995 16:58:32 -- common/autotest_common.sh@1603 -- # killprocess 1615106 00:05:35.995 16:58:32 -- common/autotest_common.sh@936 -- # '[' -z 1615106 ']' 00:05:35.995 16:58:32 -- common/autotest_common.sh@940 -- # kill -0 1615106 00:05:35.995 16:58:32 -- common/autotest_common.sh@941 -- # uname 00:05:35.995 16:58:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.995 16:58:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1615106 00:05:35.995 16:58:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.995 16:58:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.995 16:58:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1615106' 00:05:35.995 killing process with pid 1615106 00:05:35.995 16:58:32 -- common/autotest_common.sh@955 -- # kill 1615106 00:05:35.995 16:58:32 -- common/autotest_common.sh@960 -- # wait 1615106 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.995 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:35.996 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:36.256 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:37.742 16:58:34 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:37.742 16:58:34 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:37.742 16:58:34 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:37.742 16:58:34 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:37.742 16:58:34 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:37.742 16:58:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:37.742 16:58:34 -- common/autotest_common.sh@10 -- # set +x 00:05:37.742 16:58:34 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:37.742 16:58:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.742 16:58:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.742 16:58:34 -- common/autotest_common.sh@10 -- # set +x 00:05:37.742 ************************************ 00:05:37.742 START TEST env 00:05:37.742 ************************************ 00:05:37.742 16:58:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:38.002 * Looking for test storage... 00:05:38.002 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:38.002 16:58:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:38.002 16:58:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:38.002 16:58:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:38.002 16:58:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:38.002 16:58:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:38.002 16:58:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:38.002 16:58:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:38.002 16:58:34 -- scripts/common.sh@335 -- # IFS=.-: 00:05:38.002 16:58:34 -- scripts/common.sh@335 -- # read -ra ver1 00:05:38.002 16:58:34 -- scripts/common.sh@336 -- # IFS=.-: 00:05:38.002 16:58:34 -- scripts/common.sh@336 -- # read -ra ver2 00:05:38.002 16:58:34 -- scripts/common.sh@337 -- # local 'op=<' 00:05:38.002 16:58:34 -- scripts/common.sh@339 -- # ver1_l=2 00:05:38.002 16:58:34 -- scripts/common.sh@340 -- # ver2_l=1 00:05:38.002 16:58:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:38.002 16:58:34 -- scripts/common.sh@343 -- # case "$op" in 00:05:38.002 16:58:34 -- scripts/common.sh@344 -- # : 1 00:05:38.002 16:58:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:38.002 16:58:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:38.002 16:58:34 -- scripts/common.sh@364 -- # decimal 1 00:05:38.002 16:58:34 -- scripts/common.sh@352 -- # local d=1 00:05:38.002 16:58:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:38.002 16:58:34 -- scripts/common.sh@354 -- # echo 1 00:05:38.002 16:58:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:38.002 16:58:34 -- scripts/common.sh@365 -- # decimal 2 00:05:38.002 16:58:34 -- scripts/common.sh@352 -- # local d=2 00:05:38.002 16:58:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:38.002 16:58:34 -- scripts/common.sh@354 -- # echo 2 00:05:38.002 16:58:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:38.002 16:58:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:38.002 16:58:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:38.002 16:58:34 -- scripts/common.sh@367 -- # return 0 00:05:38.003 16:58:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:38.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.003 --rc genhtml_branch_coverage=1 00:05:38.003 --rc genhtml_function_coverage=1 00:05:38.003 --rc genhtml_legend=1 00:05:38.003 --rc geninfo_all_blocks=1 00:05:38.003 --rc geninfo_unexecuted_blocks=1 00:05:38.003 00:05:38.003 ' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:38.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.003 --rc genhtml_branch_coverage=1 00:05:38.003 --rc genhtml_function_coverage=1 00:05:38.003 --rc genhtml_legend=1 00:05:38.003 --rc geninfo_all_blocks=1 00:05:38.003 --rc geninfo_unexecuted_blocks=1 00:05:38.003 00:05:38.003 ' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:38.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.003 --rc genhtml_branch_coverage=1 00:05:38.003 --rc genhtml_function_coverage=1 00:05:38.003 --rc genhtml_legend=1 00:05:38.003 --rc geninfo_all_blocks=1 00:05:38.003 --rc geninfo_unexecuted_blocks=1 00:05:38.003 00:05:38.003 ' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:38.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.003 --rc genhtml_branch_coverage=1 00:05:38.003 --rc genhtml_function_coverage=1 00:05:38.003 --rc genhtml_legend=1 00:05:38.003 --rc geninfo_all_blocks=1 00:05:38.003 --rc geninfo_unexecuted_blocks=1 00:05:38.003 00:05:38.003 ' 00:05:38.003 16:58:34 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:38.003 16:58:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.003 16:58:34 -- common/autotest_common.sh@10 -- # set +x 00:05:38.003 ************************************ 00:05:38.003 START TEST env_memory 00:05:38.003 ************************************ 00:05:38.003 16:58:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:38.003 00:05:38.003 00:05:38.003 CUnit - A unit testing framework for C - Version 2.1-3 00:05:38.003 http://cunit.sourceforge.net/ 00:05:38.003 00:05:38.003 00:05:38.003 Suite: memory 00:05:38.003 Test: alloc and free memory map ...[2024-11-27 16:58:34.781925] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:38.003 passed 00:05:38.003 Test: mem map translation ...[2024-11-27 16:58:34.802533] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:38.003 [2024-11-27 16:58:34.802556] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:38.003 [2024-11-27 16:58:34.802598] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:38.003 [2024-11-27 16:58:34.802611] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:38.003 passed 00:05:38.003 Test: mem map registration ...[2024-11-27 16:58:34.844240] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:38.003 [2024-11-27 16:58:34.844265] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:38.003 passed 00:05:38.003 Test: mem map adjacent registrations ...passed 00:05:38.003 00:05:38.003 Run Summary: Type Total Ran Passed Failed Inactive 00:05:38.003 suites 1 1 n/a 0 0 00:05:38.003 tests 4 4 4 0 0 00:05:38.003 asserts 152 152 152 0 n/a 00:05:38.003 00:05:38.003 Elapsed time = 0.145 seconds 00:05:38.003 00:05:38.003 real 0m0.152s 00:05:38.003 user 0m0.141s 00:05:38.003 sys 0m0.011s 00:05:38.003 16:58:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.003 16:58:34 -- common/autotest_common.sh@10 -- # set +x 00:05:38.003 ************************************ 00:05:38.003 END TEST env_memory 00:05:38.003 ************************************ 00:05:38.003 16:58:34 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:38.003 16:58:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.003 16:58:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.003 16:58:34 -- common/autotest_common.sh@10 -- # set +x 00:05:38.003 ************************************ 00:05:38.003 START TEST env_vtophys 00:05:38.003 ************************************ 00:05:38.003 16:58:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:38.003 EAL: lib.eal log level changed from notice to debug 00:05:38.003 EAL: Detected lcore 0 as core 0 on socket 0 00:05:38.003 EAL: Detected lcore 1 as core 1 on socket 0 00:05:38.003 EAL: Detected lcore 2 as core 2 on socket 0 00:05:38.003 EAL: Detected lcore 3 as core 3 on socket 0 00:05:38.003 EAL: Detected lcore 4 as core 4 on socket 0 00:05:38.003 EAL: Detected lcore 5 as core 5 on socket 0 00:05:38.003 EAL: Detected lcore 6 as core 8 on socket 0 00:05:38.003 EAL: Detected lcore 7 as core 9 on socket 0 00:05:38.003 EAL: Detected lcore 8 as core 10 on socket 0 00:05:38.003 EAL: Detected lcore 9 as core 11 on socket 0 00:05:38.003 EAL: Detected lcore 10 as core 12 on socket 0 00:05:38.003 EAL: Detected lcore 11 as core 13 on socket 0 00:05:38.003 EAL: Detected lcore 12 as core 0 on socket 1 00:05:38.003 EAL: Detected lcore 13 as core 1 on socket 1 00:05:38.003 EAL: Detected lcore 14 as core 2 on socket 1 00:05:38.003 EAL: Detected lcore 15 as core 3 on socket 1 00:05:38.003 EAL: Detected lcore 16 as core 4 on socket 1 00:05:38.003 EAL: Detected lcore 17 as core 5 on socket 1 00:05:38.003 EAL: Detected lcore 18 as core 8 on socket 1 00:05:38.003 EAL: Detected lcore 19 as core 9 on socket 1 00:05:38.003 EAL: Detected lcore 20 as core 10 on socket 1 00:05:38.003 EAL: Detected lcore 21 as core 11 on socket 1 00:05:38.003 EAL: Detected lcore 22 as core 12 on socket 1 00:05:38.003 EAL: Detected lcore 23 as core 13 on socket 1 00:05:38.003 EAL: Detected lcore 24 as core 0 on socket 0 00:05:38.003 EAL: Detected lcore 25 as core 1 on socket 0 00:05:38.003 EAL: Detected lcore 26 as core 2 on socket 0 00:05:38.003 EAL: Detected lcore 27 as core 3 on socket 0 00:05:38.003 EAL: Detected lcore 28 as core 4 on socket 0 00:05:38.003 EAL: Detected lcore 29 as core 5 on socket 0 00:05:38.003 EAL: Detected lcore 30 as core 8 on socket 0 00:05:38.003 EAL: Detected lcore 31 as core 9 on socket 0 00:05:38.003 EAL: Detected lcore 32 as core 10 on socket 0 00:05:38.003 EAL: Detected lcore 33 as core 11 on socket 0 00:05:38.003 EAL: Detected lcore 34 as core 12 on socket 0 00:05:38.003 EAL: Detected lcore 35 as core 13 on socket 0 00:05:38.003 EAL: Detected lcore 36 as core 0 on socket 1 00:05:38.003 EAL: Detected lcore 37 as core 1 on socket 1 00:05:38.003 EAL: Detected lcore 38 as core 2 on socket 1 00:05:38.003 EAL: Detected lcore 39 as core 3 on socket 1 00:05:38.003 EAL: Detected lcore 40 as core 4 on socket 1 00:05:38.003 EAL: Detected lcore 41 as core 5 on socket 1 00:05:38.003 EAL: Detected lcore 42 as core 8 on socket 1 00:05:38.003 EAL: Detected lcore 43 as core 9 on socket 1 00:05:38.003 EAL: Detected lcore 44 as core 10 on socket 1 00:05:38.003 EAL: Detected lcore 45 as core 11 on socket 1 00:05:38.003 EAL: Detected lcore 46 as core 12 on socket 1 00:05:38.003 EAL: Detected lcore 47 as core 13 on socket 1 00:05:38.263 EAL: Maximum logical cores by configuration: 128 00:05:38.263 EAL: Detected CPU lcores: 48 00:05:38.263 EAL: Detected NUMA nodes: 2 00:05:38.263 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:38.263 EAL: Detected shared linkage of DPDK 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:38.263 EAL: Registered [vdev] bus. 00:05:38.263 EAL: bus.vdev log level changed from disabled to notice 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:38.263 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:38.263 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:38.263 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:38.263 EAL: No shared files mode enabled, IPC will be disabled 00:05:38.263 EAL: No shared files mode enabled, IPC is disabled 00:05:38.263 EAL: Bus pci wants IOVA as 'DC' 00:05:38.263 EAL: Bus vdev wants IOVA as 'DC' 00:05:38.263 EAL: Buses did not request a specific IOVA mode. 00:05:38.263 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:38.263 EAL: Selected IOVA mode 'VA' 00:05:38.263 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.263 EAL: Probing VFIO support... 00:05:38.263 EAL: IOMMU type 1 (Type 1) is supported 00:05:38.263 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:38.263 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:38.264 EAL: VFIO support initialized 00:05:38.264 EAL: Ask a virtual area of 0x2e000 bytes 00:05:38.264 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:38.264 EAL: Setting up physically contiguous memory... 00:05:38.264 EAL: Setting maximum number of open files to 524288 00:05:38.264 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:38.264 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:38.264 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:38.264 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:38.264 EAL: Ask a virtual area of 0x61000 bytes 00:05:38.264 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:38.264 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:38.264 EAL: Ask a virtual area of 0x400000000 bytes 00:05:38.264 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:38.264 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:38.264 EAL: Hugepages will be freed exactly as allocated. 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: TSC frequency is ~2700000 KHz 00:05:38.264 EAL: Main lcore 0 is ready (tid=7f1493bd6a00;cpuset=[0]) 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 0 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 2MB 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:38.264 EAL: Mem event callback 'spdk:(nil)' registered 00:05:38.264 00:05:38.264 00:05:38.264 CUnit - A unit testing framework for C - Version 2.1-3 00:05:38.264 http://cunit.sourceforge.net/ 00:05:38.264 00:05:38.264 00:05:38.264 Suite: components_suite 00:05:38.264 Test: vtophys_malloc_test ...passed 00:05:38.264 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 4MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 4MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 6MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 6MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 10MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 10MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 18MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 18MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 34MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 34MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was expanded by 66MB 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.264 EAL: No shared files mode enabled, IPC is disabled 00:05:38.264 EAL: Heap on socket 0 was shrunk by 66MB 00:05:38.264 EAL: Trying to obtain current memory policy. 00:05:38.264 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.264 EAL: Restoring previous memory policy: 4 00:05:38.264 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.264 EAL: request: mp_malloc_sync 00:05:38.265 EAL: No shared files mode enabled, IPC is disabled 00:05:38.265 EAL: Heap on socket 0 was expanded by 130MB 00:05:38.265 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.265 EAL: request: mp_malloc_sync 00:05:38.265 EAL: No shared files mode enabled, IPC is disabled 00:05:38.265 EAL: Heap on socket 0 was shrunk by 130MB 00:05:38.265 EAL: Trying to obtain current memory policy. 00:05:38.265 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.523 EAL: Restoring previous memory policy: 4 00:05:38.523 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.523 EAL: request: mp_malloc_sync 00:05:38.523 EAL: No shared files mode enabled, IPC is disabled 00:05:38.523 EAL: Heap on socket 0 was expanded by 258MB 00:05:38.523 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.523 EAL: request: mp_malloc_sync 00:05:38.523 EAL: No shared files mode enabled, IPC is disabled 00:05:38.523 EAL: Heap on socket 0 was shrunk by 258MB 00:05:38.523 EAL: Trying to obtain current memory policy. 00:05:38.523 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:38.782 EAL: Restoring previous memory policy: 4 00:05:38.782 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.782 EAL: request: mp_malloc_sync 00:05:38.782 EAL: No shared files mode enabled, IPC is disabled 00:05:38.782 EAL: Heap on socket 0 was expanded by 514MB 00:05:38.782 EAL: Calling mem event callback 'spdk:(nil)' 00:05:38.782 EAL: request: mp_malloc_sync 00:05:38.782 EAL: No shared files mode enabled, IPC is disabled 00:05:38.782 EAL: Heap on socket 0 was shrunk by 514MB 00:05:38.782 EAL: Trying to obtain current memory policy. 00:05:38.782 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:39.351 EAL: Restoring previous memory policy: 4 00:05:39.351 EAL: Calling mem event callback 'spdk:(nil)' 00:05:39.351 EAL: request: mp_malloc_sync 00:05:39.351 EAL: No shared files mode enabled, IPC is disabled 00:05:39.351 EAL: Heap on socket 0 was expanded by 1026MB 00:05:39.351 EAL: Calling mem event callback 'spdk:(nil)' 00:05:39.610 EAL: request: mp_malloc_sync 00:05:39.610 EAL: No shared files mode enabled, IPC is disabled 00:05:39.610 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:39.610 passed 00:05:39.610 00:05:39.610 Run Summary: Type Total Ran Passed Failed Inactive 00:05:39.610 suites 1 1 n/a 0 0 00:05:39.610 tests 2 2 2 0 0 00:05:39.610 asserts 497 497 497 0 n/a 00:05:39.610 00:05:39.610 Elapsed time = 1.386 seconds 00:05:39.610 EAL: Calling mem event callback 'spdk:(nil)' 00:05:39.610 EAL: request: mp_malloc_sync 00:05:39.610 EAL: No shared files mode enabled, IPC is disabled 00:05:39.610 EAL: Heap on socket 0 was shrunk by 2MB 00:05:39.610 EAL: No shared files mode enabled, IPC is disabled 00:05:39.610 EAL: No shared files mode enabled, IPC is disabled 00:05:39.610 EAL: No shared files mode enabled, IPC is disabled 00:05:39.610 00:05:39.610 real 0m1.505s 00:05:39.610 user 0m0.866s 00:05:39.610 sys 0m0.603s 00:05:39.610 16:58:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.610 16:58:36 -- common/autotest_common.sh@10 -- # set +x 00:05:39.610 ************************************ 00:05:39.610 END TEST env_vtophys 00:05:39.610 ************************************ 00:05:39.610 16:58:36 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:39.610 16:58:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.610 16:58:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.610 16:58:36 -- common/autotest_common.sh@10 -- # set +x 00:05:39.610 ************************************ 00:05:39.610 START TEST env_pci 00:05:39.610 ************************************ 00:05:39.610 16:58:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:39.610 00:05:39.610 00:05:39.610 CUnit - A unit testing framework for C - Version 2.1-3 00:05:39.610 http://cunit.sourceforge.net/ 00:05:39.610 00:05:39.610 00:05:39.610 Suite: pci 00:05:39.610 Test: pci_hook ...[2024-11-27 16:58:36.475857] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1616153 has claimed it 00:05:39.610 EAL: Cannot find device (10000:00:01.0) 00:05:39.610 EAL: Failed to attach device on primary process 00:05:39.610 passed 00:05:39.610 00:05:39.610 Run Summary: Type Total Ran Passed Failed Inactive 00:05:39.610 suites 1 1 n/a 0 0 00:05:39.610 tests 1 1 1 0 0 00:05:39.610 asserts 25 25 25 0 n/a 00:05:39.610 00:05:39.610 Elapsed time = 0.022 seconds 00:05:39.610 00:05:39.610 real 0m0.035s 00:05:39.610 user 0m0.011s 00:05:39.610 sys 0m0.024s 00:05:39.610 16:58:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.610 16:58:36 -- common/autotest_common.sh@10 -- # set +x 00:05:39.610 ************************************ 00:05:39.610 END TEST env_pci 00:05:39.610 ************************************ 00:05:39.610 16:58:36 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:39.610 16:58:36 -- env/env.sh@15 -- # uname 00:05:39.610 16:58:36 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:39.610 16:58:36 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:39.610 16:58:36 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:39.610 16:58:36 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:39.610 16:58:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.610 16:58:36 -- common/autotest_common.sh@10 -- # set +x 00:05:39.610 ************************************ 00:05:39.610 START TEST env_dpdk_post_init 00:05:39.610 ************************************ 00:05:39.610 16:58:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:39.610 EAL: Detected CPU lcores: 48 00:05:39.610 EAL: Detected NUMA nodes: 2 00:05:39.610 EAL: Detected shared linkage of DPDK 00:05:39.610 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:39.869 EAL: Selected IOVA mode 'VA' 00:05:39.869 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.869 EAL: VFIO support initialized 00:05:39.869 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:39.869 EAL: Using IOMMU type 1 (Type 1) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:39.869 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:39.870 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:39.870 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:39.870 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:39.870 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:40.129 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:40.697 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:43.980 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:43.980 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:43.980 Starting DPDK initialization... 00:05:43.980 Starting SPDK post initialization... 00:05:43.980 SPDK NVMe probe 00:05:43.980 Attaching to 0000:88:00.0 00:05:43.980 Attached to 0000:88:00.0 00:05:43.980 Cleaning up... 00:05:43.980 00:05:43.980 real 0m4.385s 00:05:43.980 user 0m3.272s 00:05:43.980 sys 0m0.163s 00:05:43.980 16:58:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.980 16:58:40 -- common/autotest_common.sh@10 -- # set +x 00:05:43.980 ************************************ 00:05:43.980 END TEST env_dpdk_post_init 00:05:43.980 ************************************ 00:05:44.238 16:58:40 -- env/env.sh@26 -- # uname 00:05:44.238 16:58:40 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:44.238 16:58:40 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:44.238 16:58:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.238 16:58:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.238 16:58:40 -- common/autotest_common.sh@10 -- # set +x 00:05:44.238 ************************************ 00:05:44.238 START TEST env_mem_callbacks 00:05:44.238 ************************************ 00:05:44.238 16:58:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:44.238 EAL: Detected CPU lcores: 48 00:05:44.238 EAL: Detected NUMA nodes: 2 00:05:44.238 EAL: Detected shared linkage of DPDK 00:05:44.238 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:44.238 EAL: Selected IOVA mode 'VA' 00:05:44.238 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.238 EAL: VFIO support initialized 00:05:44.238 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:44.238 00:05:44.238 00:05:44.238 CUnit - A unit testing framework for C - Version 2.1-3 00:05:44.238 http://cunit.sourceforge.net/ 00:05:44.238 00:05:44.238 00:05:44.238 Suite: memory 00:05:44.238 Test: test ... 00:05:44.238 register 0x200000200000 2097152 00:05:44.238 malloc 3145728 00:05:44.238 register 0x200000400000 4194304 00:05:44.238 buf 0x200000500000 len 3145728 PASSED 00:05:44.239 malloc 64 00:05:44.239 buf 0x2000004fff40 len 64 PASSED 00:05:44.239 malloc 4194304 00:05:44.239 register 0x200000800000 6291456 00:05:44.239 buf 0x200000a00000 len 4194304 PASSED 00:05:44.239 free 0x200000500000 3145728 00:05:44.239 free 0x2000004fff40 64 00:05:44.239 unregister 0x200000400000 4194304 PASSED 00:05:44.239 free 0x200000a00000 4194304 00:05:44.239 unregister 0x200000800000 6291456 PASSED 00:05:44.239 malloc 8388608 00:05:44.239 register 0x200000400000 10485760 00:05:44.239 buf 0x200000600000 len 8388608 PASSED 00:05:44.239 free 0x200000600000 8388608 00:05:44.239 unregister 0x200000400000 10485760 PASSED 00:05:44.239 passed 00:05:44.239 00:05:44.239 Run Summary: Type Total Ran Passed Failed Inactive 00:05:44.239 suites 1 1 n/a 0 0 00:05:44.239 tests 1 1 1 0 0 00:05:44.239 asserts 15 15 15 0 n/a 00:05:44.239 00:05:44.239 Elapsed time = 0.006 seconds 00:05:44.239 00:05:44.239 real 0m0.049s 00:05:44.239 user 0m0.014s 00:05:44.239 sys 0m0.035s 00:05:44.239 16:58:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.239 16:58:40 -- common/autotest_common.sh@10 -- # set +x 00:05:44.239 ************************************ 00:05:44.239 END TEST env_mem_callbacks 00:05:44.239 ************************************ 00:05:44.239 00:05:44.239 real 0m6.400s 00:05:44.239 user 0m4.442s 00:05:44.239 sys 0m1.002s 00:05:44.239 16:58:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.239 16:58:41 -- common/autotest_common.sh@10 -- # set +x 00:05:44.239 ************************************ 00:05:44.239 END TEST env 00:05:44.239 ************************************ 00:05:44.239 16:58:41 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:44.239 16:58:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.239 16:58:41 -- common/autotest_common.sh@10 -- # set +x 00:05:44.239 ************************************ 00:05:44.239 START TEST rpc 00:05:44.239 ************************************ 00:05:44.239 16:58:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:44.239 * Looking for test storage... 00:05:44.239 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:44.239 16:58:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:44.239 16:58:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:44.239 16:58:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:44.239 16:58:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:44.239 16:58:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:44.239 16:58:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:44.239 16:58:41 -- scripts/common.sh@335 -- # IFS=.-: 00:05:44.239 16:58:41 -- scripts/common.sh@335 -- # read -ra ver1 00:05:44.239 16:58:41 -- scripts/common.sh@336 -- # IFS=.-: 00:05:44.239 16:58:41 -- scripts/common.sh@336 -- # read -ra ver2 00:05:44.239 16:58:41 -- scripts/common.sh@337 -- # local 'op=<' 00:05:44.239 16:58:41 -- scripts/common.sh@339 -- # ver1_l=2 00:05:44.239 16:58:41 -- scripts/common.sh@340 -- # ver2_l=1 00:05:44.239 16:58:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:44.239 16:58:41 -- scripts/common.sh@343 -- # case "$op" in 00:05:44.239 16:58:41 -- scripts/common.sh@344 -- # : 1 00:05:44.239 16:58:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:44.239 16:58:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:44.239 16:58:41 -- scripts/common.sh@364 -- # decimal 1 00:05:44.239 16:58:41 -- scripts/common.sh@352 -- # local d=1 00:05:44.239 16:58:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:44.239 16:58:41 -- scripts/common.sh@354 -- # echo 1 00:05:44.239 16:58:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:44.239 16:58:41 -- scripts/common.sh@365 -- # decimal 2 00:05:44.239 16:58:41 -- scripts/common.sh@352 -- # local d=2 00:05:44.239 16:58:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:44.239 16:58:41 -- scripts/common.sh@354 -- # echo 2 00:05:44.239 16:58:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:44.239 16:58:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:44.239 16:58:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:44.239 16:58:41 -- scripts/common.sh@367 -- # return 0 00:05:44.239 16:58:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:44.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.239 --rc genhtml_branch_coverage=1 00:05:44.239 --rc genhtml_function_coverage=1 00:05:44.239 --rc genhtml_legend=1 00:05:44.239 --rc geninfo_all_blocks=1 00:05:44.239 --rc geninfo_unexecuted_blocks=1 00:05:44.239 00:05:44.239 ' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:44.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.239 --rc genhtml_branch_coverage=1 00:05:44.239 --rc genhtml_function_coverage=1 00:05:44.239 --rc genhtml_legend=1 00:05:44.239 --rc geninfo_all_blocks=1 00:05:44.239 --rc geninfo_unexecuted_blocks=1 00:05:44.239 00:05:44.239 ' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:44.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.239 --rc genhtml_branch_coverage=1 00:05:44.239 --rc genhtml_function_coverage=1 00:05:44.239 --rc genhtml_legend=1 00:05:44.239 --rc geninfo_all_blocks=1 00:05:44.239 --rc geninfo_unexecuted_blocks=1 00:05:44.239 00:05:44.239 ' 00:05:44.239 16:58:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:44.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.239 --rc genhtml_branch_coverage=1 00:05:44.239 --rc genhtml_function_coverage=1 00:05:44.239 --rc genhtml_legend=1 00:05:44.239 --rc geninfo_all_blocks=1 00:05:44.239 --rc geninfo_unexecuted_blocks=1 00:05:44.239 00:05:44.239 ' 00:05:44.239 16:58:41 -- rpc/rpc.sh@65 -- # spdk_pid=1616825 00:05:44.239 16:58:41 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:44.239 16:58:41 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:44.239 16:58:41 -- rpc/rpc.sh@67 -- # waitforlisten 1616825 00:05:44.239 16:58:41 -- common/autotest_common.sh@829 -- # '[' -z 1616825 ']' 00:05:44.239 16:58:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.239 16:58:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:44.239 16:58:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.239 16:58:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:44.239 16:58:41 -- common/autotest_common.sh@10 -- # set +x 00:05:44.498 [2024-11-27 16:58:41.228800] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:44.498 [2024-11-27 16:58:41.228893] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1616825 ] 00:05:44.498 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.498 [2024-11-27 16:58:41.287827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.498 [2024-11-27 16:58:41.374464] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:44.498 [2024-11-27 16:58:41.374634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:44.498 [2024-11-27 16:58:41.374653] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1616825' to capture a snapshot of events at runtime. 00:05:44.498 [2024-11-27 16:58:41.374665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1616825 for offline analysis/debug. 00:05:44.498 [2024-11-27 16:58:41.374701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.435 16:58:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:45.435 16:58:42 -- common/autotest_common.sh@862 -- # return 0 00:05:45.435 16:58:42 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:45.435 16:58:42 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:45.435 16:58:42 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:45.435 16:58:42 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:45.435 16:58:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.435 16:58:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 ************************************ 00:05:45.435 START TEST rpc_integrity 00:05:45.435 ************************************ 00:05:45.435 16:58:42 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:45.435 16:58:42 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:45.435 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.435 16:58:42 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:45.435 16:58:42 -- rpc/rpc.sh@13 -- # jq length 00:05:45.435 16:58:42 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:45.435 16:58:42 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:45.435 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.435 16:58:42 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:45.435 16:58:42 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:45.435 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.435 16:58:42 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:45.435 { 00:05:45.435 "name": "Malloc0", 00:05:45.435 "aliases": [ 00:05:45.435 "d9a8a39d-0fa9-45c7-8183-7238661954d8" 00:05:45.435 ], 00:05:45.435 "product_name": "Malloc disk", 00:05:45.435 "block_size": 512, 00:05:45.435 "num_blocks": 16384, 00:05:45.435 "uuid": "d9a8a39d-0fa9-45c7-8183-7238661954d8", 00:05:45.435 "assigned_rate_limits": { 00:05:45.435 "rw_ios_per_sec": 0, 00:05:45.435 "rw_mbytes_per_sec": 0, 00:05:45.435 "r_mbytes_per_sec": 0, 00:05:45.435 "w_mbytes_per_sec": 0 00:05:45.435 }, 00:05:45.435 "claimed": false, 00:05:45.435 "zoned": false, 00:05:45.435 "supported_io_types": { 00:05:45.435 "read": true, 00:05:45.435 "write": true, 00:05:45.435 "unmap": true, 00:05:45.435 "write_zeroes": true, 00:05:45.435 "flush": true, 00:05:45.435 "reset": true, 00:05:45.435 "compare": false, 00:05:45.435 "compare_and_write": false, 00:05:45.435 "abort": true, 00:05:45.435 "nvme_admin": false, 00:05:45.435 "nvme_io": false 00:05:45.435 }, 00:05:45.435 "memory_domains": [ 00:05:45.435 { 00:05:45.435 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:45.435 "dma_device_type": 2 00:05:45.435 } 00:05:45.435 ], 00:05:45.435 "driver_specific": {} 00:05:45.435 } 00:05:45.435 ]' 00:05:45.435 16:58:42 -- rpc/rpc.sh@17 -- # jq length 00:05:45.435 16:58:42 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:45.435 16:58:42 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:45.435 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 [2024-11-27 16:58:42.302955] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:45.435 [2024-11-27 16:58:42.303003] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:45.435 [2024-11-27 16:58:42.303029] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1cb0b20 00:05:45.435 [2024-11-27 16:58:42.303044] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:45.435 [2024-11-27 16:58:42.304495] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:45.435 [2024-11-27 16:58:42.304534] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:45.435 Passthru0 00:05:45.435 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.435 16:58:42 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:45.435 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.435 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.435 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.435 16:58:42 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:45.435 { 00:05:45.435 "name": "Malloc0", 00:05:45.435 "aliases": [ 00:05:45.435 "d9a8a39d-0fa9-45c7-8183-7238661954d8" 00:05:45.435 ], 00:05:45.435 "product_name": "Malloc disk", 00:05:45.435 "block_size": 512, 00:05:45.435 "num_blocks": 16384, 00:05:45.435 "uuid": "d9a8a39d-0fa9-45c7-8183-7238661954d8", 00:05:45.435 "assigned_rate_limits": { 00:05:45.435 "rw_ios_per_sec": 0, 00:05:45.435 "rw_mbytes_per_sec": 0, 00:05:45.435 "r_mbytes_per_sec": 0, 00:05:45.435 "w_mbytes_per_sec": 0 00:05:45.435 }, 00:05:45.435 "claimed": true, 00:05:45.435 "claim_type": "exclusive_write", 00:05:45.435 "zoned": false, 00:05:45.435 "supported_io_types": { 00:05:45.435 "read": true, 00:05:45.435 "write": true, 00:05:45.435 "unmap": true, 00:05:45.435 "write_zeroes": true, 00:05:45.435 "flush": true, 00:05:45.435 "reset": true, 00:05:45.435 "compare": false, 00:05:45.435 "compare_and_write": false, 00:05:45.435 "abort": true, 00:05:45.435 "nvme_admin": false, 00:05:45.435 "nvme_io": false 00:05:45.435 }, 00:05:45.435 "memory_domains": [ 00:05:45.435 { 00:05:45.435 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:45.435 "dma_device_type": 2 00:05:45.435 } 00:05:45.435 ], 00:05:45.435 "driver_specific": {} 00:05:45.435 }, 00:05:45.435 { 00:05:45.435 "name": "Passthru0", 00:05:45.435 "aliases": [ 00:05:45.435 "6efd009f-dd96-539e-aca0-9a7be18acd30" 00:05:45.435 ], 00:05:45.435 "product_name": "passthru", 00:05:45.435 "block_size": 512, 00:05:45.435 "num_blocks": 16384, 00:05:45.435 "uuid": "6efd009f-dd96-539e-aca0-9a7be18acd30", 00:05:45.435 "assigned_rate_limits": { 00:05:45.435 "rw_ios_per_sec": 0, 00:05:45.435 "rw_mbytes_per_sec": 0, 00:05:45.435 "r_mbytes_per_sec": 0, 00:05:45.435 "w_mbytes_per_sec": 0 00:05:45.435 }, 00:05:45.435 "claimed": false, 00:05:45.435 "zoned": false, 00:05:45.435 "supported_io_types": { 00:05:45.436 "read": true, 00:05:45.436 "write": true, 00:05:45.436 "unmap": true, 00:05:45.436 "write_zeroes": true, 00:05:45.436 "flush": true, 00:05:45.436 "reset": true, 00:05:45.436 "compare": false, 00:05:45.436 "compare_and_write": false, 00:05:45.436 "abort": true, 00:05:45.436 "nvme_admin": false, 00:05:45.436 "nvme_io": false 00:05:45.436 }, 00:05:45.436 "memory_domains": [ 00:05:45.436 { 00:05:45.436 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:45.436 "dma_device_type": 2 00:05:45.436 } 00:05:45.436 ], 00:05:45.436 "driver_specific": { 00:05:45.436 "passthru": { 00:05:45.436 "name": "Passthru0", 00:05:45.436 "base_bdev_name": "Malloc0" 00:05:45.436 } 00:05:45.436 } 00:05:45.436 } 00:05:45.436 ]' 00:05:45.436 16:58:42 -- rpc/rpc.sh@21 -- # jq length 00:05:45.436 16:58:42 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:45.436 16:58:42 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:45.436 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.436 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.436 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.436 16:58:42 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:45.436 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.436 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.436 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.436 16:58:42 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:45.436 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.436 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.436 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.436 16:58:42 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:45.694 16:58:42 -- rpc/rpc.sh@26 -- # jq length 00:05:45.694 16:58:42 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:45.694 00:05:45.694 real 0m0.227s 00:05:45.694 user 0m0.149s 00:05:45.694 sys 0m0.022s 00:05:45.694 16:58:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.694 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.694 ************************************ 00:05:45.694 END TEST rpc_integrity 00:05:45.694 ************************************ 00:05:45.694 16:58:42 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:45.694 16:58:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.694 16:58:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.694 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.694 ************************************ 00:05:45.694 START TEST rpc_plugins 00:05:45.694 ************************************ 00:05:45.694 16:58:42 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:45.694 16:58:42 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:45.694 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.694 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.694 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.694 16:58:42 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:45.694 16:58:42 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:45.694 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.694 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.694 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.694 16:58:42 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:45.694 { 00:05:45.694 "name": "Malloc1", 00:05:45.694 "aliases": [ 00:05:45.694 "81bd0527-cdd6-4788-965d-8365d70105f1" 00:05:45.694 ], 00:05:45.694 "product_name": "Malloc disk", 00:05:45.694 "block_size": 4096, 00:05:45.694 "num_blocks": 256, 00:05:45.694 "uuid": "81bd0527-cdd6-4788-965d-8365d70105f1", 00:05:45.694 "assigned_rate_limits": { 00:05:45.694 "rw_ios_per_sec": 0, 00:05:45.694 "rw_mbytes_per_sec": 0, 00:05:45.694 "r_mbytes_per_sec": 0, 00:05:45.694 "w_mbytes_per_sec": 0 00:05:45.694 }, 00:05:45.694 "claimed": false, 00:05:45.694 "zoned": false, 00:05:45.694 "supported_io_types": { 00:05:45.694 "read": true, 00:05:45.694 "write": true, 00:05:45.694 "unmap": true, 00:05:45.694 "write_zeroes": true, 00:05:45.694 "flush": true, 00:05:45.694 "reset": true, 00:05:45.694 "compare": false, 00:05:45.694 "compare_and_write": false, 00:05:45.694 "abort": true, 00:05:45.694 "nvme_admin": false, 00:05:45.694 "nvme_io": false 00:05:45.694 }, 00:05:45.694 "memory_domains": [ 00:05:45.694 { 00:05:45.694 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:45.694 "dma_device_type": 2 00:05:45.694 } 00:05:45.694 ], 00:05:45.694 "driver_specific": {} 00:05:45.694 } 00:05:45.694 ]' 00:05:45.694 16:58:42 -- rpc/rpc.sh@32 -- # jq length 00:05:45.694 16:58:42 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:45.694 16:58:42 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:45.694 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.695 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.695 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.695 16:58:42 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:45.695 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.695 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.695 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.695 16:58:42 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:45.695 16:58:42 -- rpc/rpc.sh@36 -- # jq length 00:05:45.695 16:58:42 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:45.695 00:05:45.695 real 0m0.111s 00:05:45.695 user 0m0.075s 00:05:45.695 sys 0m0.008s 00:05:45.695 16:58:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.695 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.695 ************************************ 00:05:45.695 END TEST rpc_plugins 00:05:45.695 ************************************ 00:05:45.695 16:58:42 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:45.695 16:58:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.695 16:58:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.695 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.695 ************************************ 00:05:45.695 START TEST rpc_trace_cmd_test 00:05:45.695 ************************************ 00:05:45.695 16:58:42 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:45.695 16:58:42 -- rpc/rpc.sh@40 -- # local info 00:05:45.695 16:58:42 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:45.695 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.695 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.695 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.695 16:58:42 -- rpc/rpc.sh@42 -- # info='{ 00:05:45.695 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1616825", 00:05:45.695 "tpoint_group_mask": "0x8", 00:05:45.695 "iscsi_conn": { 00:05:45.695 "mask": "0x2", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "scsi": { 00:05:45.695 "mask": "0x4", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "bdev": { 00:05:45.695 "mask": "0x8", 00:05:45.695 "tpoint_mask": "0xffffffffffffffff" 00:05:45.695 }, 00:05:45.695 "nvmf_rdma": { 00:05:45.695 "mask": "0x10", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "nvmf_tcp": { 00:05:45.695 "mask": "0x20", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "ftl": { 00:05:45.695 "mask": "0x40", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "blobfs": { 00:05:45.695 "mask": "0x80", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "dsa": { 00:05:45.695 "mask": "0x200", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "thread": { 00:05:45.695 "mask": "0x400", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "nvme_pcie": { 00:05:45.695 "mask": "0x800", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "iaa": { 00:05:45.695 "mask": "0x1000", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "nvme_tcp": { 00:05:45.695 "mask": "0x2000", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 }, 00:05:45.695 "bdev_nvme": { 00:05:45.695 "mask": "0x4000", 00:05:45.695 "tpoint_mask": "0x0" 00:05:45.695 } 00:05:45.695 }' 00:05:45.695 16:58:42 -- rpc/rpc.sh@43 -- # jq length 00:05:45.695 16:58:42 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:45.695 16:58:42 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:45.953 16:58:42 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:45.953 16:58:42 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:45.953 16:58:42 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:45.953 16:58:42 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:45.953 16:58:42 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:45.953 16:58:42 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:45.953 16:58:42 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:45.953 00:05:45.953 real 0m0.195s 00:05:45.953 user 0m0.175s 00:05:45.953 sys 0m0.014s 00:05:45.953 16:58:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.953 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.953 ************************************ 00:05:45.953 END TEST rpc_trace_cmd_test 00:05:45.953 ************************************ 00:05:45.953 16:58:42 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:45.953 16:58:42 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:45.953 16:58:42 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:45.953 16:58:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.953 16:58:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.953 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.953 ************************************ 00:05:45.953 START TEST rpc_daemon_integrity 00:05:45.953 ************************************ 00:05:45.953 16:58:42 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:45.953 16:58:42 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:45.953 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.953 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.953 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.953 16:58:42 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:45.953 16:58:42 -- rpc/rpc.sh@13 -- # jq length 00:05:45.953 16:58:42 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:45.953 16:58:42 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:45.953 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.953 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.953 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.953 16:58:42 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:45.953 16:58:42 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:45.953 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:45.954 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:45.954 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.954 16:58:42 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:45.954 { 00:05:45.954 "name": "Malloc2", 00:05:45.954 "aliases": [ 00:05:45.954 "9a273b6d-9183-4a14-8b27-3a640c9a1dbc" 00:05:45.954 ], 00:05:45.954 "product_name": "Malloc disk", 00:05:45.954 "block_size": 512, 00:05:45.954 "num_blocks": 16384, 00:05:45.954 "uuid": "9a273b6d-9183-4a14-8b27-3a640c9a1dbc", 00:05:45.954 "assigned_rate_limits": { 00:05:45.954 "rw_ios_per_sec": 0, 00:05:45.954 "rw_mbytes_per_sec": 0, 00:05:45.954 "r_mbytes_per_sec": 0, 00:05:45.954 "w_mbytes_per_sec": 0 00:05:45.954 }, 00:05:45.954 "claimed": false, 00:05:45.954 "zoned": false, 00:05:45.954 "supported_io_types": { 00:05:45.954 "read": true, 00:05:45.954 "write": true, 00:05:45.954 "unmap": true, 00:05:45.954 "write_zeroes": true, 00:05:45.954 "flush": true, 00:05:45.954 "reset": true, 00:05:45.954 "compare": false, 00:05:45.954 "compare_and_write": false, 00:05:45.954 "abort": true, 00:05:45.954 "nvme_admin": false, 00:05:45.954 "nvme_io": false 00:05:45.954 }, 00:05:45.954 "memory_domains": [ 00:05:45.954 { 00:05:45.954 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:45.954 "dma_device_type": 2 00:05:45.954 } 00:05:45.954 ], 00:05:45.954 "driver_specific": {} 00:05:45.954 } 00:05:45.954 ]' 00:05:45.954 16:58:42 -- rpc/rpc.sh@17 -- # jq length 00:05:46.212 16:58:42 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:46.212 16:58:42 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:46.212 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:46.212 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 [2024-11-27 16:58:42.916690] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:46.212 [2024-11-27 16:58:42.916731] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:46.212 [2024-11-27 16:58:42.916759] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1cafec0 00:05:46.212 [2024-11-27 16:58:42.916773] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:46.212 [2024-11-27 16:58:42.918119] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:46.212 [2024-11-27 16:58:42.918149] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:46.212 Passthru0 00:05:46.212 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:46.212 16:58:42 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:46.212 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:46.212 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:46.212 16:58:42 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:46.212 { 00:05:46.212 "name": "Malloc2", 00:05:46.212 "aliases": [ 00:05:46.212 "9a273b6d-9183-4a14-8b27-3a640c9a1dbc" 00:05:46.212 ], 00:05:46.212 "product_name": "Malloc disk", 00:05:46.212 "block_size": 512, 00:05:46.212 "num_blocks": 16384, 00:05:46.212 "uuid": "9a273b6d-9183-4a14-8b27-3a640c9a1dbc", 00:05:46.212 "assigned_rate_limits": { 00:05:46.212 "rw_ios_per_sec": 0, 00:05:46.212 "rw_mbytes_per_sec": 0, 00:05:46.212 "r_mbytes_per_sec": 0, 00:05:46.212 "w_mbytes_per_sec": 0 00:05:46.212 }, 00:05:46.212 "claimed": true, 00:05:46.212 "claim_type": "exclusive_write", 00:05:46.212 "zoned": false, 00:05:46.212 "supported_io_types": { 00:05:46.212 "read": true, 00:05:46.212 "write": true, 00:05:46.212 "unmap": true, 00:05:46.212 "write_zeroes": true, 00:05:46.212 "flush": true, 00:05:46.212 "reset": true, 00:05:46.212 "compare": false, 00:05:46.212 "compare_and_write": false, 00:05:46.212 "abort": true, 00:05:46.212 "nvme_admin": false, 00:05:46.212 "nvme_io": false 00:05:46.212 }, 00:05:46.212 "memory_domains": [ 00:05:46.212 { 00:05:46.212 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:46.212 "dma_device_type": 2 00:05:46.212 } 00:05:46.212 ], 00:05:46.212 "driver_specific": {} 00:05:46.212 }, 00:05:46.212 { 00:05:46.212 "name": "Passthru0", 00:05:46.212 "aliases": [ 00:05:46.212 "17201a28-b39c-54d9-a7ee-544b25423af6" 00:05:46.212 ], 00:05:46.212 "product_name": "passthru", 00:05:46.212 "block_size": 512, 00:05:46.212 "num_blocks": 16384, 00:05:46.212 "uuid": "17201a28-b39c-54d9-a7ee-544b25423af6", 00:05:46.212 "assigned_rate_limits": { 00:05:46.212 "rw_ios_per_sec": 0, 00:05:46.212 "rw_mbytes_per_sec": 0, 00:05:46.212 "r_mbytes_per_sec": 0, 00:05:46.212 "w_mbytes_per_sec": 0 00:05:46.212 }, 00:05:46.212 "claimed": false, 00:05:46.212 "zoned": false, 00:05:46.212 "supported_io_types": { 00:05:46.212 "read": true, 00:05:46.212 "write": true, 00:05:46.212 "unmap": true, 00:05:46.212 "write_zeroes": true, 00:05:46.212 "flush": true, 00:05:46.212 "reset": true, 00:05:46.212 "compare": false, 00:05:46.212 "compare_and_write": false, 00:05:46.212 "abort": true, 00:05:46.212 "nvme_admin": false, 00:05:46.212 "nvme_io": false 00:05:46.212 }, 00:05:46.212 "memory_domains": [ 00:05:46.212 { 00:05:46.212 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:46.212 "dma_device_type": 2 00:05:46.212 } 00:05:46.212 ], 00:05:46.212 "driver_specific": { 00:05:46.212 "passthru": { 00:05:46.212 "name": "Passthru0", 00:05:46.212 "base_bdev_name": "Malloc2" 00:05:46.212 } 00:05:46.212 } 00:05:46.212 } 00:05:46.212 ]' 00:05:46.212 16:58:42 -- rpc/rpc.sh@21 -- # jq length 00:05:46.212 16:58:42 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:46.212 16:58:42 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:46.212 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:46.212 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:46.212 16:58:42 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:46.212 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:46.212 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:46.212 16:58:42 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:46.212 16:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:46.212 16:58:42 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 16:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:46.212 16:58:42 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:46.212 16:58:42 -- rpc/rpc.sh@26 -- # jq length 00:05:46.212 16:58:43 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:46.212 00:05:46.212 real 0m0.226s 00:05:46.212 user 0m0.153s 00:05:46.212 sys 0m0.020s 00:05:46.212 16:58:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.212 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.212 ************************************ 00:05:46.212 END TEST rpc_daemon_integrity 00:05:46.212 ************************************ 00:05:46.212 16:58:43 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:46.212 16:58:43 -- rpc/rpc.sh@84 -- # killprocess 1616825 00:05:46.212 16:58:43 -- common/autotest_common.sh@936 -- # '[' -z 1616825 ']' 00:05:46.212 16:58:43 -- common/autotest_common.sh@940 -- # kill -0 1616825 00:05:46.212 16:58:43 -- common/autotest_common.sh@941 -- # uname 00:05:46.212 16:58:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:46.212 16:58:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1616825 00:05:46.212 16:58:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:46.212 16:58:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:46.212 16:58:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1616825' 00:05:46.212 killing process with pid 1616825 00:05:46.212 16:58:43 -- common/autotest_common.sh@955 -- # kill 1616825 00:05:46.212 16:58:43 -- common/autotest_common.sh@960 -- # wait 1616825 00:05:46.778 00:05:46.778 real 0m2.452s 00:05:46.778 user 0m3.125s 00:05:46.778 sys 0m0.586s 00:05:46.778 16:58:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.778 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.778 ************************************ 00:05:46.778 END TEST rpc 00:05:46.778 ************************************ 00:05:46.778 16:58:43 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:46.778 16:58:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.778 16:58:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.778 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.778 ************************************ 00:05:46.778 START TEST rpc_client 00:05:46.778 ************************************ 00:05:46.778 16:58:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:46.778 * Looking for test storage... 00:05:46.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:46.778 16:58:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:46.778 16:58:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:46.778 16:58:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:46.778 16:58:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:46.778 16:58:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:46.778 16:58:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:46.778 16:58:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:46.778 16:58:43 -- scripts/common.sh@335 -- # IFS=.-: 00:05:46.778 16:58:43 -- scripts/common.sh@335 -- # read -ra ver1 00:05:46.778 16:58:43 -- scripts/common.sh@336 -- # IFS=.-: 00:05:46.778 16:58:43 -- scripts/common.sh@336 -- # read -ra ver2 00:05:46.778 16:58:43 -- scripts/common.sh@337 -- # local 'op=<' 00:05:46.778 16:58:43 -- scripts/common.sh@339 -- # ver1_l=2 00:05:46.778 16:58:43 -- scripts/common.sh@340 -- # ver2_l=1 00:05:46.778 16:58:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:46.778 16:58:43 -- scripts/common.sh@343 -- # case "$op" in 00:05:46.778 16:58:43 -- scripts/common.sh@344 -- # : 1 00:05:46.778 16:58:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:46.778 16:58:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:46.778 16:58:43 -- scripts/common.sh@364 -- # decimal 1 00:05:46.778 16:58:43 -- scripts/common.sh@352 -- # local d=1 00:05:46.778 16:58:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:46.778 16:58:43 -- scripts/common.sh@354 -- # echo 1 00:05:46.778 16:58:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:46.778 16:58:43 -- scripts/common.sh@365 -- # decimal 2 00:05:46.778 16:58:43 -- scripts/common.sh@352 -- # local d=2 00:05:46.778 16:58:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:46.778 16:58:43 -- scripts/common.sh@354 -- # echo 2 00:05:46.778 16:58:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:46.778 16:58:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:46.778 16:58:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:46.778 16:58:43 -- scripts/common.sh@367 -- # return 0 00:05:46.778 16:58:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:46.778 16:58:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.778 --rc genhtml_branch_coverage=1 00:05:46.778 --rc genhtml_function_coverage=1 00:05:46.778 --rc genhtml_legend=1 00:05:46.778 --rc geninfo_all_blocks=1 00:05:46.778 --rc geninfo_unexecuted_blocks=1 00:05:46.778 00:05:46.778 ' 00:05:46.778 16:58:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.778 --rc genhtml_branch_coverage=1 00:05:46.778 --rc genhtml_function_coverage=1 00:05:46.778 --rc genhtml_legend=1 00:05:46.778 --rc geninfo_all_blocks=1 00:05:46.778 --rc geninfo_unexecuted_blocks=1 00:05:46.778 00:05:46.778 ' 00:05:46.778 16:58:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.778 --rc genhtml_branch_coverage=1 00:05:46.778 --rc genhtml_function_coverage=1 00:05:46.778 --rc genhtml_legend=1 00:05:46.778 --rc geninfo_all_blocks=1 00:05:46.778 --rc geninfo_unexecuted_blocks=1 00:05:46.778 00:05:46.779 ' 00:05:46.779 16:58:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:46.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.779 --rc genhtml_branch_coverage=1 00:05:46.779 --rc genhtml_function_coverage=1 00:05:46.779 --rc genhtml_legend=1 00:05:46.779 --rc geninfo_all_blocks=1 00:05:46.779 --rc geninfo_unexecuted_blocks=1 00:05:46.779 00:05:46.779 ' 00:05:46.779 16:58:43 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:46.779 OK 00:05:46.779 16:58:43 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:46.779 00:05:46.779 real 0m0.153s 00:05:46.779 user 0m0.107s 00:05:46.779 sys 0m0.055s 00:05:46.779 16:58:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.779 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.779 ************************************ 00:05:46.779 END TEST rpc_client 00:05:46.779 ************************************ 00:05:46.779 16:58:43 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:46.779 16:58:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.779 16:58:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.779 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.779 ************************************ 00:05:46.779 START TEST json_config 00:05:46.779 ************************************ 00:05:46.779 16:58:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:47.037 16:58:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:47.037 16:58:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:47.037 16:58:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:47.037 16:58:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:47.037 16:58:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:47.037 16:58:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:47.037 16:58:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:47.037 16:58:43 -- scripts/common.sh@335 -- # IFS=.-: 00:05:47.037 16:58:43 -- scripts/common.sh@335 -- # read -ra ver1 00:05:47.037 16:58:43 -- scripts/common.sh@336 -- # IFS=.-: 00:05:47.037 16:58:43 -- scripts/common.sh@336 -- # read -ra ver2 00:05:47.037 16:58:43 -- scripts/common.sh@337 -- # local 'op=<' 00:05:47.037 16:58:43 -- scripts/common.sh@339 -- # ver1_l=2 00:05:47.037 16:58:43 -- scripts/common.sh@340 -- # ver2_l=1 00:05:47.037 16:58:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:47.037 16:58:43 -- scripts/common.sh@343 -- # case "$op" in 00:05:47.037 16:58:43 -- scripts/common.sh@344 -- # : 1 00:05:47.037 16:58:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:47.038 16:58:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:47.038 16:58:43 -- scripts/common.sh@364 -- # decimal 1 00:05:47.038 16:58:43 -- scripts/common.sh@352 -- # local d=1 00:05:47.038 16:58:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:47.038 16:58:43 -- scripts/common.sh@354 -- # echo 1 00:05:47.038 16:58:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:47.038 16:58:43 -- scripts/common.sh@365 -- # decimal 2 00:05:47.038 16:58:43 -- scripts/common.sh@352 -- # local d=2 00:05:47.038 16:58:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:47.038 16:58:43 -- scripts/common.sh@354 -- # echo 2 00:05:47.038 16:58:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:47.038 16:58:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:47.038 16:58:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:47.038 16:58:43 -- scripts/common.sh@367 -- # return 0 00:05:47.038 16:58:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:47.038 16:58:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:47.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.038 --rc genhtml_branch_coverage=1 00:05:47.038 --rc genhtml_function_coverage=1 00:05:47.038 --rc genhtml_legend=1 00:05:47.038 --rc geninfo_all_blocks=1 00:05:47.038 --rc geninfo_unexecuted_blocks=1 00:05:47.038 00:05:47.038 ' 00:05:47.038 16:58:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:47.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.038 --rc genhtml_branch_coverage=1 00:05:47.038 --rc genhtml_function_coverage=1 00:05:47.038 --rc genhtml_legend=1 00:05:47.038 --rc geninfo_all_blocks=1 00:05:47.038 --rc geninfo_unexecuted_blocks=1 00:05:47.038 00:05:47.038 ' 00:05:47.038 16:58:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:47.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.038 --rc genhtml_branch_coverage=1 00:05:47.038 --rc genhtml_function_coverage=1 00:05:47.038 --rc genhtml_legend=1 00:05:47.038 --rc geninfo_all_blocks=1 00:05:47.038 --rc geninfo_unexecuted_blocks=1 00:05:47.038 00:05:47.038 ' 00:05:47.038 16:58:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:47.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.038 --rc genhtml_branch_coverage=1 00:05:47.038 --rc genhtml_function_coverage=1 00:05:47.038 --rc genhtml_legend=1 00:05:47.038 --rc geninfo_all_blocks=1 00:05:47.038 --rc geninfo_unexecuted_blocks=1 00:05:47.038 00:05:47.038 ' 00:05:47.038 16:58:43 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:47.038 16:58:43 -- nvmf/common.sh@7 -- # uname -s 00:05:47.038 16:58:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:47.038 16:58:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:47.038 16:58:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:47.038 16:58:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:47.038 16:58:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:47.038 16:58:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:47.038 16:58:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:47.038 16:58:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:47.038 16:58:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:47.038 16:58:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:47.038 16:58:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:47.038 16:58:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:47.038 16:58:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:47.038 16:58:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:47.038 16:58:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:47.038 16:58:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:47.038 16:58:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:47.038 16:58:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:47.038 16:58:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:47.038 16:58:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:47.038 16:58:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:47.038 16:58:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:47.038 16:58:43 -- paths/export.sh@5 -- # export PATH 00:05:47.038 16:58:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:47.038 16:58:43 -- nvmf/common.sh@46 -- # : 0 00:05:47.038 16:58:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:47.038 16:58:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:47.038 16:58:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:47.038 16:58:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:47.038 16:58:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:47.038 16:58:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:47.038 16:58:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:47.038 16:58:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:47.038 16:58:43 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:47.038 16:58:43 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:47.038 16:58:43 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:47.038 16:58:43 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:47.038 16:58:43 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:47.038 16:58:43 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:47.038 16:58:43 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:47.038 16:58:43 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:47.038 16:58:43 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:47.038 16:58:43 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:47.038 16:58:43 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:47.038 16:58:43 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:47.038 INFO: JSON configuration test init 00:05:47.038 16:58:43 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:47.038 16:58:43 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:47.038 16:58:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:47.038 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:47.038 16:58:43 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:47.038 16:58:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:47.038 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:47.038 16:58:43 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:47.038 16:58:43 -- json_config/json_config.sh@98 -- # local app=target 00:05:47.038 16:58:43 -- json_config/json_config.sh@99 -- # shift 00:05:47.038 16:58:43 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:47.038 16:58:43 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:47.038 16:58:43 -- json_config/json_config.sh@111 -- # app_pid[$app]=1617327 00:05:47.038 16:58:43 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:47.038 16:58:43 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:47.038 Waiting for target to run... 00:05:47.038 16:58:43 -- json_config/json_config.sh@114 -- # waitforlisten 1617327 /var/tmp/spdk_tgt.sock 00:05:47.038 16:58:43 -- common/autotest_common.sh@829 -- # '[' -z 1617327 ']' 00:05:47.038 16:58:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:47.038 16:58:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:47.038 16:58:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:47.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:47.038 16:58:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:47.038 16:58:43 -- common/autotest_common.sh@10 -- # set +x 00:05:47.038 [2024-11-27 16:58:43.885726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:47.038 [2024-11-27 16:58:43.885822] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1617327 ] 00:05:47.038 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.605 [2024-11-27 16:58:44.367629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.605 [2024-11-27 16:58:44.447481] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:47.605 [2024-11-27 16:58:44.447688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.170 16:58:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:48.170 16:58:44 -- common/autotest_common.sh@862 -- # return 0 00:05:48.170 16:58:44 -- json_config/json_config.sh@115 -- # echo '' 00:05:48.170 00:05:48.170 16:58:44 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:48.170 16:58:44 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:48.170 16:58:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:48.170 16:58:44 -- common/autotest_common.sh@10 -- # set +x 00:05:48.170 16:58:44 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:48.170 16:58:44 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:48.170 16:58:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.170 16:58:44 -- common/autotest_common.sh@10 -- # set +x 00:05:48.170 16:58:44 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:48.170 16:58:44 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:48.170 16:58:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:51.454 16:58:48 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:51.454 16:58:48 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:51.454 16:58:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:51.454 16:58:48 -- common/autotest_common.sh@10 -- # set +x 00:05:51.454 16:58:48 -- json_config/json_config.sh@48 -- # local ret=0 00:05:51.454 16:58:48 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:51.454 16:58:48 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:51.454 16:58:48 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:51.454 16:58:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:51.454 16:58:48 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:51.454 16:58:48 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:51.454 16:58:48 -- json_config/json_config.sh@51 -- # local get_types 00:05:51.454 16:58:48 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:51.454 16:58:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:51.454 16:58:48 -- common/autotest_common.sh@10 -- # set +x 00:05:51.454 16:58:48 -- json_config/json_config.sh@58 -- # return 0 00:05:51.454 16:58:48 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:51.454 16:58:48 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:51.454 16:58:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:51.454 16:58:48 -- common/autotest_common.sh@10 -- # set +x 00:05:51.454 16:58:48 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:51.454 16:58:48 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:51.454 16:58:48 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:51.454 16:58:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:51.713 MallocForNvmf0 00:05:51.713 16:58:48 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:51.713 16:58:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:51.971 MallocForNvmf1 00:05:51.971 16:58:48 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:51.971 16:58:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:52.229 [2024-11-27 16:58:49.040719] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:52.229 16:58:49 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:52.229 16:58:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:52.491 16:58:49 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:52.491 16:58:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:52.748 16:58:49 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:52.748 16:58:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:53.006 16:58:49 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:53.006 16:58:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:53.263 [2024-11-27 16:58:50.044190] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:53.263 16:58:50 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:53.263 16:58:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:53.263 16:58:50 -- common/autotest_common.sh@10 -- # set +x 00:05:53.263 16:58:50 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:53.263 16:58:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:53.263 16:58:50 -- common/autotest_common.sh@10 -- # set +x 00:05:53.263 16:58:50 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:53.263 16:58:50 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:53.263 16:58:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:53.521 MallocBdevForConfigChangeCheck 00:05:53.521 16:58:50 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:53.521 16:58:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:53.521 16:58:50 -- common/autotest_common.sh@10 -- # set +x 00:05:53.521 16:58:50 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:53.521 16:58:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:54.089 16:58:50 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:54.089 INFO: shutting down applications... 00:05:54.089 16:58:50 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:54.089 16:58:50 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:54.089 16:58:50 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:54.089 16:58:50 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:55.988 Calling clear_iscsi_subsystem 00:05:55.988 Calling clear_nvmf_subsystem 00:05:55.988 Calling clear_nbd_subsystem 00:05:55.988 Calling clear_ublk_subsystem 00:05:55.988 Calling clear_vhost_blk_subsystem 00:05:55.988 Calling clear_vhost_scsi_subsystem 00:05:55.988 Calling clear_scheduler_subsystem 00:05:55.988 Calling clear_bdev_subsystem 00:05:55.988 Calling clear_accel_subsystem 00:05:55.988 Calling clear_vmd_subsystem 00:05:55.988 Calling clear_sock_subsystem 00:05:55.988 Calling clear_iobuf_subsystem 00:05:55.988 16:58:52 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:55.988 16:58:52 -- json_config/json_config.sh@396 -- # count=100 00:05:55.988 16:58:52 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:55.988 16:58:52 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:55.988 16:58:52 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:55.988 16:58:52 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:55.988 16:58:52 -- json_config/json_config.sh@398 -- # break 00:05:55.988 16:58:52 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:55.988 16:58:52 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:55.988 16:58:52 -- json_config/json_config.sh@120 -- # local app=target 00:05:55.988 16:58:52 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:55.988 16:58:52 -- json_config/json_config.sh@124 -- # [[ -n 1617327 ]] 00:05:55.988 16:58:52 -- json_config/json_config.sh@127 -- # kill -SIGINT 1617327 00:05:55.988 16:58:52 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:55.988 16:58:52 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:55.988 16:58:52 -- json_config/json_config.sh@130 -- # kill -0 1617327 00:05:55.988 16:58:52 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:56.555 16:58:53 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:56.555 16:58:53 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:56.555 16:58:53 -- json_config/json_config.sh@130 -- # kill -0 1617327 00:05:56.555 16:58:53 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:56.555 16:58:53 -- json_config/json_config.sh@132 -- # break 00:05:56.555 16:58:53 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:56.555 16:58:53 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:56.555 SPDK target shutdown done 00:05:56.555 16:58:53 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:56.555 INFO: relaunching applications... 00:05:56.555 16:58:53 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.555 16:58:53 -- json_config/json_config.sh@98 -- # local app=target 00:05:56.555 16:58:53 -- json_config/json_config.sh@99 -- # shift 00:05:56.555 16:58:53 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:56.555 16:58:53 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:56.555 16:58:53 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:56.555 16:58:53 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:56.555 16:58:53 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:56.555 16:58:53 -- json_config/json_config.sh@111 -- # app_pid[$app]=1618673 00:05:56.555 16:58:53 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.555 16:58:53 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:56.555 Waiting for target to run... 00:05:56.555 16:58:53 -- json_config/json_config.sh@114 -- # waitforlisten 1618673 /var/tmp/spdk_tgt.sock 00:05:56.555 16:58:53 -- common/autotest_common.sh@829 -- # '[' -z 1618673 ']' 00:05:56.555 16:58:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:56.555 16:58:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.555 16:58:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:56.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:56.555 16:58:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.555 16:58:53 -- common/autotest_common.sh@10 -- # set +x 00:05:56.555 [2024-11-27 16:58:53.376340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:56.555 [2024-11-27 16:58:53.376424] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1618673 ] 00:05:56.555 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.814 [2024-11-27 16:58:53.741740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.072 [2024-11-27 16:58:53.804039] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:57.072 [2024-11-27 16:58:53.804226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.383 [2024-11-27 16:58:56.825361] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:00.383 [2024-11-27 16:58:56.857863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:00.641 16:58:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:00.641 16:58:57 -- common/autotest_common.sh@862 -- # return 0 00:06:00.641 16:58:57 -- json_config/json_config.sh@115 -- # echo '' 00:06:00.641 00:06:00.641 16:58:57 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:06:00.641 16:58:57 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:00.641 INFO: Checking if target configuration is the same... 00:06:00.641 16:58:57 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:00.641 16:58:57 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:06:00.641 16:58:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:00.641 + '[' 2 -ne 2 ']' 00:06:00.641 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:00.641 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:00.641 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:00.641 +++ basename /dev/fd/62 00:06:00.641 ++ mktemp /tmp/62.XXX 00:06:00.641 + tmp_file_1=/tmp/62.RUK 00:06:00.641 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:00.641 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:00.641 + tmp_file_2=/tmp/spdk_tgt_config.json.e0C 00:06:00.641 + ret=0 00:06:00.641 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:01.208 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:01.208 + diff -u /tmp/62.RUK /tmp/spdk_tgt_config.json.e0C 00:06:01.208 + echo 'INFO: JSON config files are the same' 00:06:01.208 INFO: JSON config files are the same 00:06:01.208 + rm /tmp/62.RUK /tmp/spdk_tgt_config.json.e0C 00:06:01.208 + exit 0 00:06:01.208 16:58:57 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:06:01.208 16:58:57 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:01.208 INFO: changing configuration and checking if this can be detected... 00:06:01.208 16:58:57 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:01.208 16:58:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:01.466 16:58:58 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:01.466 16:58:58 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:06:01.466 16:58:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:01.466 + '[' 2 -ne 2 ']' 00:06:01.466 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:01.466 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:01.466 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:01.466 +++ basename /dev/fd/62 00:06:01.466 ++ mktemp /tmp/62.XXX 00:06:01.466 + tmp_file_1=/tmp/62.Hga 00:06:01.466 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:01.466 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:01.466 + tmp_file_2=/tmp/spdk_tgt_config.json.TQc 00:06:01.466 + ret=0 00:06:01.466 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:01.725 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:01.725 + diff -u /tmp/62.Hga /tmp/spdk_tgt_config.json.TQc 00:06:01.725 + ret=1 00:06:01.725 + echo '=== Start of file: /tmp/62.Hga ===' 00:06:01.725 + cat /tmp/62.Hga 00:06:01.725 + echo '=== End of file: /tmp/62.Hga ===' 00:06:01.725 + echo '' 00:06:01.725 + echo '=== Start of file: /tmp/spdk_tgt_config.json.TQc ===' 00:06:01.725 + cat /tmp/spdk_tgt_config.json.TQc 00:06:01.725 + echo '=== End of file: /tmp/spdk_tgt_config.json.TQc ===' 00:06:01.725 + echo '' 00:06:01.725 + rm /tmp/62.Hga /tmp/spdk_tgt_config.json.TQc 00:06:01.725 + exit 1 00:06:01.725 16:58:58 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:06:01.725 INFO: configuration change detected. 00:06:01.725 16:58:58 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:06:01.725 16:58:58 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:06:01.725 16:58:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:01.725 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:06:01.725 16:58:58 -- json_config/json_config.sh@360 -- # local ret=0 00:06:01.725 16:58:58 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:06:01.725 16:58:58 -- json_config/json_config.sh@370 -- # [[ -n 1618673 ]] 00:06:01.725 16:58:58 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:06:01.725 16:58:58 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:06:01.725 16:58:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:01.725 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:06:01.725 16:58:58 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:06:01.725 16:58:58 -- json_config/json_config.sh@246 -- # uname -s 00:06:01.725 16:58:58 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:06:01.725 16:58:58 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:06:01.725 16:58:58 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:06:01.725 16:58:58 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:06:01.725 16:58:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:01.725 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:06:01.725 16:58:58 -- json_config/json_config.sh@376 -- # killprocess 1618673 00:06:01.725 16:58:58 -- common/autotest_common.sh@936 -- # '[' -z 1618673 ']' 00:06:01.725 16:58:58 -- common/autotest_common.sh@940 -- # kill -0 1618673 00:06:01.725 16:58:58 -- common/autotest_common.sh@941 -- # uname 00:06:01.725 16:58:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:01.725 16:58:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1618673 00:06:01.984 16:58:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:01.984 16:58:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:01.984 16:58:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1618673' 00:06:01.984 killing process with pid 1618673 00:06:01.984 16:58:58 -- common/autotest_common.sh@955 -- # kill 1618673 00:06:01.984 16:58:58 -- common/autotest_common.sh@960 -- # wait 1618673 00:06:03.356 16:59:00 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:03.356 16:59:00 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:06:03.356 16:59:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:03.356 16:59:00 -- common/autotest_common.sh@10 -- # set +x 00:06:03.356 16:59:00 -- json_config/json_config.sh@381 -- # return 0 00:06:03.356 16:59:00 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:06:03.356 INFO: Success 00:06:03.356 00:06:03.356 real 0m16.595s 00:06:03.356 user 0m19.263s 00:06:03.356 sys 0m2.151s 00:06:03.356 16:59:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.356 16:59:00 -- common/autotest_common.sh@10 -- # set +x 00:06:03.356 ************************************ 00:06:03.356 END TEST json_config 00:06:03.356 ************************************ 00:06:03.615 16:59:00 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:03.615 16:59:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.615 16:59:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.615 16:59:00 -- common/autotest_common.sh@10 -- # set +x 00:06:03.615 ************************************ 00:06:03.615 START TEST json_config_extra_key 00:06:03.615 ************************************ 00:06:03.615 16:59:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:03.615 16:59:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:03.615 16:59:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:03.615 16:59:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:03.615 16:59:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:03.615 16:59:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:03.615 16:59:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:03.615 16:59:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:03.615 16:59:00 -- scripts/common.sh@335 -- # IFS=.-: 00:06:03.615 16:59:00 -- scripts/common.sh@335 -- # read -ra ver1 00:06:03.615 16:59:00 -- scripts/common.sh@336 -- # IFS=.-: 00:06:03.615 16:59:00 -- scripts/common.sh@336 -- # read -ra ver2 00:06:03.615 16:59:00 -- scripts/common.sh@337 -- # local 'op=<' 00:06:03.615 16:59:00 -- scripts/common.sh@339 -- # ver1_l=2 00:06:03.615 16:59:00 -- scripts/common.sh@340 -- # ver2_l=1 00:06:03.615 16:59:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:03.615 16:59:00 -- scripts/common.sh@343 -- # case "$op" in 00:06:03.615 16:59:00 -- scripts/common.sh@344 -- # : 1 00:06:03.615 16:59:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:03.615 16:59:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:03.615 16:59:00 -- scripts/common.sh@364 -- # decimal 1 00:06:03.615 16:59:00 -- scripts/common.sh@352 -- # local d=1 00:06:03.615 16:59:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:03.615 16:59:00 -- scripts/common.sh@354 -- # echo 1 00:06:03.615 16:59:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:03.615 16:59:00 -- scripts/common.sh@365 -- # decimal 2 00:06:03.615 16:59:00 -- scripts/common.sh@352 -- # local d=2 00:06:03.615 16:59:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:03.615 16:59:00 -- scripts/common.sh@354 -- # echo 2 00:06:03.615 16:59:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:03.615 16:59:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:03.615 16:59:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:03.615 16:59:00 -- scripts/common.sh@367 -- # return 0 00:06:03.615 16:59:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:03.615 16:59:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:03.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.615 --rc genhtml_branch_coverage=1 00:06:03.616 --rc genhtml_function_coverage=1 00:06:03.616 --rc genhtml_legend=1 00:06:03.616 --rc geninfo_all_blocks=1 00:06:03.616 --rc geninfo_unexecuted_blocks=1 00:06:03.616 00:06:03.616 ' 00:06:03.616 16:59:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.616 --rc genhtml_branch_coverage=1 00:06:03.616 --rc genhtml_function_coverage=1 00:06:03.616 --rc genhtml_legend=1 00:06:03.616 --rc geninfo_all_blocks=1 00:06:03.616 --rc geninfo_unexecuted_blocks=1 00:06:03.616 00:06:03.616 ' 00:06:03.616 16:59:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.616 --rc genhtml_branch_coverage=1 00:06:03.616 --rc genhtml_function_coverage=1 00:06:03.616 --rc genhtml_legend=1 00:06:03.616 --rc geninfo_all_blocks=1 00:06:03.616 --rc geninfo_unexecuted_blocks=1 00:06:03.616 00:06:03.616 ' 00:06:03.616 16:59:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.616 --rc genhtml_branch_coverage=1 00:06:03.616 --rc genhtml_function_coverage=1 00:06:03.616 --rc genhtml_legend=1 00:06:03.616 --rc geninfo_all_blocks=1 00:06:03.616 --rc geninfo_unexecuted_blocks=1 00:06:03.616 00:06:03.616 ' 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:03.616 16:59:00 -- nvmf/common.sh@7 -- # uname -s 00:06:03.616 16:59:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:03.616 16:59:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:03.616 16:59:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:03.616 16:59:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:03.616 16:59:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:03.616 16:59:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:03.616 16:59:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:03.616 16:59:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:03.616 16:59:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:03.616 16:59:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:03.616 16:59:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:03.616 16:59:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:03.616 16:59:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:03.616 16:59:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:03.616 16:59:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:03.616 16:59:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:03.616 16:59:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:03.616 16:59:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:03.616 16:59:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:03.616 16:59:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:03.616 16:59:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:03.616 16:59:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:03.616 16:59:00 -- paths/export.sh@5 -- # export PATH 00:06:03.616 16:59:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:03.616 16:59:00 -- nvmf/common.sh@46 -- # : 0 00:06:03.616 16:59:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:03.616 16:59:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:03.616 16:59:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:03.616 16:59:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:03.616 16:59:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:03.616 16:59:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:03.616 16:59:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:03.616 16:59:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:06:03.616 INFO: launching applications... 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@25 -- # shift 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1619621 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:06:03.616 Waiting for target to run... 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1619621 /var/tmp/spdk_tgt.sock 00:06:03.616 16:59:00 -- common/autotest_common.sh@829 -- # '[' -z 1619621 ']' 00:06:03.616 16:59:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:03.616 16:59:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.616 16:59:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:03.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:03.616 16:59:00 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:03.616 16:59:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.616 16:59:00 -- common/autotest_common.sh@10 -- # set +x 00:06:03.616 [2024-11-27 16:59:00.508704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:03.616 [2024-11-27 16:59:00.508801] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1619621 ] 00:06:03.616 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.185 [2024-11-27 16:59:01.010008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.185 [2024-11-27 16:59:01.085478] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:04.185 [2024-11-27 16:59:01.085684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.751 16:59:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.751 16:59:01 -- common/autotest_common.sh@862 -- # return 0 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:06:04.751 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:06:04.751 INFO: shutting down applications... 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1619621 ]] 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1619621 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1619621 00:06:04.751 16:59:01 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1619621 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:05.320 SPDK target shutdown done 00:06:05.320 16:59:01 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:05.320 Success 00:06:05.320 00:06:05.320 real 0m1.651s 00:06:05.320 user 0m1.482s 00:06:05.320 sys 0m0.590s 00:06:05.320 16:59:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.320 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.320 ************************************ 00:06:05.320 END TEST json_config_extra_key 00:06:05.320 ************************************ 00:06:05.320 16:59:01 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:05.320 16:59:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.320 16:59:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.320 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.320 ************************************ 00:06:05.320 START TEST alias_rpc 00:06:05.320 ************************************ 00:06:05.320 16:59:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:05.320 * Looking for test storage... 00:06:05.321 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:05.321 16:59:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.321 16:59:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.321 16:59:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:05.321 16:59:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:05.321 16:59:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:05.321 16:59:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:05.321 16:59:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:05.321 16:59:02 -- scripts/common.sh@335 -- # IFS=.-: 00:06:05.321 16:59:02 -- scripts/common.sh@335 -- # read -ra ver1 00:06:05.321 16:59:02 -- scripts/common.sh@336 -- # IFS=.-: 00:06:05.321 16:59:02 -- scripts/common.sh@336 -- # read -ra ver2 00:06:05.321 16:59:02 -- scripts/common.sh@337 -- # local 'op=<' 00:06:05.321 16:59:02 -- scripts/common.sh@339 -- # ver1_l=2 00:06:05.321 16:59:02 -- scripts/common.sh@340 -- # ver2_l=1 00:06:05.321 16:59:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:05.321 16:59:02 -- scripts/common.sh@343 -- # case "$op" in 00:06:05.321 16:59:02 -- scripts/common.sh@344 -- # : 1 00:06:05.321 16:59:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:05.321 16:59:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:05.321 16:59:02 -- scripts/common.sh@364 -- # decimal 1 00:06:05.321 16:59:02 -- scripts/common.sh@352 -- # local d=1 00:06:05.321 16:59:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:05.321 16:59:02 -- scripts/common.sh@354 -- # echo 1 00:06:05.321 16:59:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:05.321 16:59:02 -- scripts/common.sh@365 -- # decimal 2 00:06:05.321 16:59:02 -- scripts/common.sh@352 -- # local d=2 00:06:05.321 16:59:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:05.321 16:59:02 -- scripts/common.sh@354 -- # echo 2 00:06:05.321 16:59:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:05.321 16:59:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:05.321 16:59:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:05.321 16:59:02 -- scripts/common.sh@367 -- # return 0 00:06:05.321 16:59:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:05.321 16:59:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:05.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.321 --rc genhtml_branch_coverage=1 00:06:05.321 --rc genhtml_function_coverage=1 00:06:05.321 --rc genhtml_legend=1 00:06:05.321 --rc geninfo_all_blocks=1 00:06:05.321 --rc geninfo_unexecuted_blocks=1 00:06:05.321 00:06:05.321 ' 00:06:05.321 16:59:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:05.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.321 --rc genhtml_branch_coverage=1 00:06:05.321 --rc genhtml_function_coverage=1 00:06:05.321 --rc genhtml_legend=1 00:06:05.321 --rc geninfo_all_blocks=1 00:06:05.321 --rc geninfo_unexecuted_blocks=1 00:06:05.321 00:06:05.321 ' 00:06:05.321 16:59:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:05.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.321 --rc genhtml_branch_coverage=1 00:06:05.321 --rc genhtml_function_coverage=1 00:06:05.321 --rc genhtml_legend=1 00:06:05.321 --rc geninfo_all_blocks=1 00:06:05.321 --rc geninfo_unexecuted_blocks=1 00:06:05.321 00:06:05.321 ' 00:06:05.321 16:59:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:05.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.321 --rc genhtml_branch_coverage=1 00:06:05.321 --rc genhtml_function_coverage=1 00:06:05.321 --rc genhtml_legend=1 00:06:05.321 --rc geninfo_all_blocks=1 00:06:05.321 --rc geninfo_unexecuted_blocks=1 00:06:05.321 00:06:05.321 ' 00:06:05.321 16:59:02 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:05.321 16:59:02 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1619943 00:06:05.321 16:59:02 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:05.321 16:59:02 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1619943 00:06:05.321 16:59:02 -- common/autotest_common.sh@829 -- # '[' -z 1619943 ']' 00:06:05.321 16:59:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.321 16:59:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.321 16:59:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.321 16:59:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.321 16:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:05.321 [2024-11-27 16:59:02.175219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:05.321 [2024-11-27 16:59:02.175318] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1619943 ] 00:06:05.321 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.321 [2024-11-27 16:59:02.233022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.580 [2024-11-27 16:59:02.320785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.580 [2024-11-27 16:59:02.320956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.574 16:59:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.574 16:59:03 -- common/autotest_common.sh@862 -- # return 0 00:06:06.574 16:59:03 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:06.574 16:59:03 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1619943 00:06:06.574 16:59:03 -- common/autotest_common.sh@936 -- # '[' -z 1619943 ']' 00:06:06.574 16:59:03 -- common/autotest_common.sh@940 -- # kill -0 1619943 00:06:06.574 16:59:03 -- common/autotest_common.sh@941 -- # uname 00:06:06.574 16:59:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.574 16:59:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1619943 00:06:06.574 16:59:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.574 16:59:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.574 16:59:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1619943' 00:06:06.574 killing process with pid 1619943 00:06:06.574 16:59:03 -- common/autotest_common.sh@955 -- # kill 1619943 00:06:06.574 16:59:03 -- common/autotest_common.sh@960 -- # wait 1619943 00:06:07.142 00:06:07.142 real 0m1.906s 00:06:07.142 user 0m2.229s 00:06:07.142 sys 0m0.483s 00:06:07.142 16:59:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.142 16:59:03 -- common/autotest_common.sh@10 -- # set +x 00:06:07.142 ************************************ 00:06:07.142 END TEST alias_rpc 00:06:07.142 ************************************ 00:06:07.142 16:59:03 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:07.142 16:59:03 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:07.142 16:59:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:07.142 16:59:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.142 16:59:03 -- common/autotest_common.sh@10 -- # set +x 00:06:07.142 ************************************ 00:06:07.142 START TEST spdkcli_tcp 00:06:07.142 ************************************ 00:06:07.142 16:59:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:07.142 * Looking for test storage... 00:06:07.142 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:07.142 16:59:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:07.142 16:59:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:07.142 16:59:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:07.142 16:59:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:07.142 16:59:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:07.142 16:59:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:07.142 16:59:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:07.142 16:59:04 -- scripts/common.sh@335 -- # IFS=.-: 00:06:07.142 16:59:04 -- scripts/common.sh@335 -- # read -ra ver1 00:06:07.142 16:59:04 -- scripts/common.sh@336 -- # IFS=.-: 00:06:07.142 16:59:04 -- scripts/common.sh@336 -- # read -ra ver2 00:06:07.142 16:59:04 -- scripts/common.sh@337 -- # local 'op=<' 00:06:07.142 16:59:04 -- scripts/common.sh@339 -- # ver1_l=2 00:06:07.142 16:59:04 -- scripts/common.sh@340 -- # ver2_l=1 00:06:07.142 16:59:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:07.142 16:59:04 -- scripts/common.sh@343 -- # case "$op" in 00:06:07.142 16:59:04 -- scripts/common.sh@344 -- # : 1 00:06:07.142 16:59:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:07.142 16:59:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:07.142 16:59:04 -- scripts/common.sh@364 -- # decimal 1 00:06:07.142 16:59:04 -- scripts/common.sh@352 -- # local d=1 00:06:07.142 16:59:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:07.142 16:59:04 -- scripts/common.sh@354 -- # echo 1 00:06:07.142 16:59:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:07.142 16:59:04 -- scripts/common.sh@365 -- # decimal 2 00:06:07.142 16:59:04 -- scripts/common.sh@352 -- # local d=2 00:06:07.142 16:59:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:07.142 16:59:04 -- scripts/common.sh@354 -- # echo 2 00:06:07.142 16:59:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:07.142 16:59:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:07.142 16:59:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:07.142 16:59:04 -- scripts/common.sh@367 -- # return 0 00:06:07.142 16:59:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:07.142 16:59:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:07.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.142 --rc genhtml_branch_coverage=1 00:06:07.142 --rc genhtml_function_coverage=1 00:06:07.142 --rc genhtml_legend=1 00:06:07.142 --rc geninfo_all_blocks=1 00:06:07.142 --rc geninfo_unexecuted_blocks=1 00:06:07.142 00:06:07.142 ' 00:06:07.142 16:59:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:07.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.142 --rc genhtml_branch_coverage=1 00:06:07.142 --rc genhtml_function_coverage=1 00:06:07.142 --rc genhtml_legend=1 00:06:07.142 --rc geninfo_all_blocks=1 00:06:07.142 --rc geninfo_unexecuted_blocks=1 00:06:07.142 00:06:07.142 ' 00:06:07.142 16:59:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:07.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.142 --rc genhtml_branch_coverage=1 00:06:07.142 --rc genhtml_function_coverage=1 00:06:07.142 --rc genhtml_legend=1 00:06:07.142 --rc geninfo_all_blocks=1 00:06:07.142 --rc geninfo_unexecuted_blocks=1 00:06:07.142 00:06:07.142 ' 00:06:07.142 16:59:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:07.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.142 --rc genhtml_branch_coverage=1 00:06:07.143 --rc genhtml_function_coverage=1 00:06:07.143 --rc genhtml_legend=1 00:06:07.143 --rc geninfo_all_blocks=1 00:06:07.143 --rc geninfo_unexecuted_blocks=1 00:06:07.143 00:06:07.143 ' 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:07.143 16:59:04 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:07.143 16:59:04 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:07.143 16:59:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:07.143 16:59:04 -- common/autotest_common.sh@10 -- # set +x 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1620153 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:07.143 16:59:04 -- spdkcli/tcp.sh@27 -- # waitforlisten 1620153 00:06:07.143 16:59:04 -- common/autotest_common.sh@829 -- # '[' -z 1620153 ']' 00:06:07.143 16:59:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.143 16:59:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.143 16:59:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.143 16:59:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.143 16:59:04 -- common/autotest_common.sh@10 -- # set +x 00:06:07.401 [2024-11-27 16:59:04.122790] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:07.401 [2024-11-27 16:59:04.122901] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1620153 ] 00:06:07.401 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.401 [2024-11-27 16:59:04.179136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:07.401 [2024-11-27 16:59:04.270002] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:07.401 [2024-11-27 16:59:04.270246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.401 [2024-11-27 16:59:04.270252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.336 16:59:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:08.336 16:59:05 -- common/autotest_common.sh@862 -- # return 0 00:06:08.336 16:59:05 -- spdkcli/tcp.sh@31 -- # socat_pid=1620294 00:06:08.336 16:59:05 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:08.336 16:59:05 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:08.594 [ 00:06:08.594 "bdev_malloc_delete", 00:06:08.594 "bdev_malloc_create", 00:06:08.594 "bdev_null_resize", 00:06:08.594 "bdev_null_delete", 00:06:08.594 "bdev_null_create", 00:06:08.594 "bdev_nvme_cuse_unregister", 00:06:08.594 "bdev_nvme_cuse_register", 00:06:08.594 "bdev_opal_new_user", 00:06:08.594 "bdev_opal_set_lock_state", 00:06:08.594 "bdev_opal_delete", 00:06:08.594 "bdev_opal_get_info", 00:06:08.594 "bdev_opal_create", 00:06:08.594 "bdev_nvme_opal_revert", 00:06:08.594 "bdev_nvme_opal_init", 00:06:08.594 "bdev_nvme_send_cmd", 00:06:08.594 "bdev_nvme_get_path_iostat", 00:06:08.594 "bdev_nvme_get_mdns_discovery_info", 00:06:08.594 "bdev_nvme_stop_mdns_discovery", 00:06:08.594 "bdev_nvme_start_mdns_discovery", 00:06:08.594 "bdev_nvme_set_multipath_policy", 00:06:08.594 "bdev_nvme_set_preferred_path", 00:06:08.594 "bdev_nvme_get_io_paths", 00:06:08.594 "bdev_nvme_remove_error_injection", 00:06:08.594 "bdev_nvme_add_error_injection", 00:06:08.594 "bdev_nvme_get_discovery_info", 00:06:08.595 "bdev_nvme_stop_discovery", 00:06:08.595 "bdev_nvme_start_discovery", 00:06:08.595 "bdev_nvme_get_controller_health_info", 00:06:08.595 "bdev_nvme_disable_controller", 00:06:08.595 "bdev_nvme_enable_controller", 00:06:08.595 "bdev_nvme_reset_controller", 00:06:08.595 "bdev_nvme_get_transport_statistics", 00:06:08.595 "bdev_nvme_apply_firmware", 00:06:08.595 "bdev_nvme_detach_controller", 00:06:08.595 "bdev_nvme_get_controllers", 00:06:08.595 "bdev_nvme_attach_controller", 00:06:08.595 "bdev_nvme_set_hotplug", 00:06:08.595 "bdev_nvme_set_options", 00:06:08.595 "bdev_passthru_delete", 00:06:08.595 "bdev_passthru_create", 00:06:08.595 "bdev_lvol_grow_lvstore", 00:06:08.595 "bdev_lvol_get_lvols", 00:06:08.595 "bdev_lvol_get_lvstores", 00:06:08.595 "bdev_lvol_delete", 00:06:08.595 "bdev_lvol_set_read_only", 00:06:08.595 "bdev_lvol_resize", 00:06:08.595 "bdev_lvol_decouple_parent", 00:06:08.595 "bdev_lvol_inflate", 00:06:08.595 "bdev_lvol_rename", 00:06:08.595 "bdev_lvol_clone_bdev", 00:06:08.595 "bdev_lvol_clone", 00:06:08.595 "bdev_lvol_snapshot", 00:06:08.595 "bdev_lvol_create", 00:06:08.595 "bdev_lvol_delete_lvstore", 00:06:08.595 "bdev_lvol_rename_lvstore", 00:06:08.595 "bdev_lvol_create_lvstore", 00:06:08.595 "bdev_raid_set_options", 00:06:08.595 "bdev_raid_remove_base_bdev", 00:06:08.595 "bdev_raid_add_base_bdev", 00:06:08.595 "bdev_raid_delete", 00:06:08.595 "bdev_raid_create", 00:06:08.595 "bdev_raid_get_bdevs", 00:06:08.595 "bdev_error_inject_error", 00:06:08.595 "bdev_error_delete", 00:06:08.595 "bdev_error_create", 00:06:08.595 "bdev_split_delete", 00:06:08.595 "bdev_split_create", 00:06:08.595 "bdev_delay_delete", 00:06:08.595 "bdev_delay_create", 00:06:08.595 "bdev_delay_update_latency", 00:06:08.595 "bdev_zone_block_delete", 00:06:08.595 "bdev_zone_block_create", 00:06:08.595 "blobfs_create", 00:06:08.595 "blobfs_detect", 00:06:08.595 "blobfs_set_cache_size", 00:06:08.595 "bdev_aio_delete", 00:06:08.595 "bdev_aio_rescan", 00:06:08.595 "bdev_aio_create", 00:06:08.595 "bdev_ftl_set_property", 00:06:08.595 "bdev_ftl_get_properties", 00:06:08.595 "bdev_ftl_get_stats", 00:06:08.595 "bdev_ftl_unmap", 00:06:08.595 "bdev_ftl_unload", 00:06:08.595 "bdev_ftl_delete", 00:06:08.595 "bdev_ftl_load", 00:06:08.595 "bdev_ftl_create", 00:06:08.595 "bdev_virtio_attach_controller", 00:06:08.595 "bdev_virtio_scsi_get_devices", 00:06:08.595 "bdev_virtio_detach_controller", 00:06:08.595 "bdev_virtio_blk_set_hotplug", 00:06:08.595 "bdev_iscsi_delete", 00:06:08.595 "bdev_iscsi_create", 00:06:08.595 "bdev_iscsi_set_options", 00:06:08.595 "accel_error_inject_error", 00:06:08.595 "ioat_scan_accel_module", 00:06:08.595 "dsa_scan_accel_module", 00:06:08.595 "iaa_scan_accel_module", 00:06:08.595 "vfu_virtio_create_scsi_endpoint", 00:06:08.595 "vfu_virtio_scsi_remove_target", 00:06:08.595 "vfu_virtio_scsi_add_target", 00:06:08.595 "vfu_virtio_create_blk_endpoint", 00:06:08.595 "vfu_virtio_delete_endpoint", 00:06:08.595 "iscsi_set_options", 00:06:08.595 "iscsi_get_auth_groups", 00:06:08.595 "iscsi_auth_group_remove_secret", 00:06:08.595 "iscsi_auth_group_add_secret", 00:06:08.595 "iscsi_delete_auth_group", 00:06:08.595 "iscsi_create_auth_group", 00:06:08.595 "iscsi_set_discovery_auth", 00:06:08.595 "iscsi_get_options", 00:06:08.595 "iscsi_target_node_request_logout", 00:06:08.595 "iscsi_target_node_set_redirect", 00:06:08.595 "iscsi_target_node_set_auth", 00:06:08.595 "iscsi_target_node_add_lun", 00:06:08.595 "iscsi_get_connections", 00:06:08.595 "iscsi_portal_group_set_auth", 00:06:08.595 "iscsi_start_portal_group", 00:06:08.595 "iscsi_delete_portal_group", 00:06:08.595 "iscsi_create_portal_group", 00:06:08.595 "iscsi_get_portal_groups", 00:06:08.595 "iscsi_delete_target_node", 00:06:08.595 "iscsi_target_node_remove_pg_ig_maps", 00:06:08.595 "iscsi_target_node_add_pg_ig_maps", 00:06:08.595 "iscsi_create_target_node", 00:06:08.595 "iscsi_get_target_nodes", 00:06:08.595 "iscsi_delete_initiator_group", 00:06:08.595 "iscsi_initiator_group_remove_initiators", 00:06:08.595 "iscsi_initiator_group_add_initiators", 00:06:08.595 "iscsi_create_initiator_group", 00:06:08.595 "iscsi_get_initiator_groups", 00:06:08.595 "nvmf_set_crdt", 00:06:08.595 "nvmf_set_config", 00:06:08.595 "nvmf_set_max_subsystems", 00:06:08.595 "nvmf_subsystem_get_listeners", 00:06:08.595 "nvmf_subsystem_get_qpairs", 00:06:08.595 "nvmf_subsystem_get_controllers", 00:06:08.595 "nvmf_get_stats", 00:06:08.595 "nvmf_get_transports", 00:06:08.595 "nvmf_create_transport", 00:06:08.595 "nvmf_get_targets", 00:06:08.595 "nvmf_delete_target", 00:06:08.595 "nvmf_create_target", 00:06:08.595 "nvmf_subsystem_allow_any_host", 00:06:08.595 "nvmf_subsystem_remove_host", 00:06:08.595 "nvmf_subsystem_add_host", 00:06:08.595 "nvmf_subsystem_remove_ns", 00:06:08.595 "nvmf_subsystem_add_ns", 00:06:08.595 "nvmf_subsystem_listener_set_ana_state", 00:06:08.595 "nvmf_discovery_get_referrals", 00:06:08.595 "nvmf_discovery_remove_referral", 00:06:08.595 "nvmf_discovery_add_referral", 00:06:08.595 "nvmf_subsystem_remove_listener", 00:06:08.595 "nvmf_subsystem_add_listener", 00:06:08.595 "nvmf_delete_subsystem", 00:06:08.595 "nvmf_create_subsystem", 00:06:08.595 "nvmf_get_subsystems", 00:06:08.595 "env_dpdk_get_mem_stats", 00:06:08.595 "nbd_get_disks", 00:06:08.595 "nbd_stop_disk", 00:06:08.595 "nbd_start_disk", 00:06:08.595 "ublk_recover_disk", 00:06:08.595 "ublk_get_disks", 00:06:08.595 "ublk_stop_disk", 00:06:08.595 "ublk_start_disk", 00:06:08.595 "ublk_destroy_target", 00:06:08.595 "ublk_create_target", 00:06:08.595 "virtio_blk_create_transport", 00:06:08.595 "virtio_blk_get_transports", 00:06:08.595 "vhost_controller_set_coalescing", 00:06:08.595 "vhost_get_controllers", 00:06:08.595 "vhost_delete_controller", 00:06:08.595 "vhost_create_blk_controller", 00:06:08.595 "vhost_scsi_controller_remove_target", 00:06:08.595 "vhost_scsi_controller_add_target", 00:06:08.595 "vhost_start_scsi_controller", 00:06:08.595 "vhost_create_scsi_controller", 00:06:08.595 "thread_set_cpumask", 00:06:08.595 "framework_get_scheduler", 00:06:08.595 "framework_set_scheduler", 00:06:08.595 "framework_get_reactors", 00:06:08.595 "thread_get_io_channels", 00:06:08.595 "thread_get_pollers", 00:06:08.595 "thread_get_stats", 00:06:08.595 "framework_monitor_context_switch", 00:06:08.595 "spdk_kill_instance", 00:06:08.595 "log_enable_timestamps", 00:06:08.595 "log_get_flags", 00:06:08.595 "log_clear_flag", 00:06:08.595 "log_set_flag", 00:06:08.595 "log_get_level", 00:06:08.595 "log_set_level", 00:06:08.595 "log_get_print_level", 00:06:08.595 "log_set_print_level", 00:06:08.595 "framework_enable_cpumask_locks", 00:06:08.595 "framework_disable_cpumask_locks", 00:06:08.595 "framework_wait_init", 00:06:08.595 "framework_start_init", 00:06:08.595 "scsi_get_devices", 00:06:08.595 "bdev_get_histogram", 00:06:08.595 "bdev_enable_histogram", 00:06:08.595 "bdev_set_qos_limit", 00:06:08.595 "bdev_set_qd_sampling_period", 00:06:08.595 "bdev_get_bdevs", 00:06:08.595 "bdev_reset_iostat", 00:06:08.595 "bdev_get_iostat", 00:06:08.595 "bdev_examine", 00:06:08.595 "bdev_wait_for_examine", 00:06:08.595 "bdev_set_options", 00:06:08.595 "notify_get_notifications", 00:06:08.595 "notify_get_types", 00:06:08.595 "accel_get_stats", 00:06:08.595 "accel_set_options", 00:06:08.595 "accel_set_driver", 00:06:08.595 "accel_crypto_key_destroy", 00:06:08.595 "accel_crypto_keys_get", 00:06:08.595 "accel_crypto_key_create", 00:06:08.595 "accel_assign_opc", 00:06:08.595 "accel_get_module_info", 00:06:08.595 "accel_get_opc_assignments", 00:06:08.595 "vmd_rescan", 00:06:08.595 "vmd_remove_device", 00:06:08.595 "vmd_enable", 00:06:08.595 "sock_set_default_impl", 00:06:08.595 "sock_impl_set_options", 00:06:08.595 "sock_impl_get_options", 00:06:08.595 "iobuf_get_stats", 00:06:08.595 "iobuf_set_options", 00:06:08.595 "framework_get_pci_devices", 00:06:08.595 "framework_get_config", 00:06:08.595 "framework_get_subsystems", 00:06:08.595 "vfu_tgt_set_base_path", 00:06:08.595 "trace_get_info", 00:06:08.595 "trace_get_tpoint_group_mask", 00:06:08.595 "trace_disable_tpoint_group", 00:06:08.595 "trace_enable_tpoint_group", 00:06:08.595 "trace_clear_tpoint_mask", 00:06:08.595 "trace_set_tpoint_mask", 00:06:08.595 "spdk_get_version", 00:06:08.595 "rpc_get_methods" 00:06:08.595 ] 00:06:08.595 16:59:05 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:08.595 16:59:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:08.595 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:08.595 16:59:05 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:08.595 16:59:05 -- spdkcli/tcp.sh@38 -- # killprocess 1620153 00:06:08.595 16:59:05 -- common/autotest_common.sh@936 -- # '[' -z 1620153 ']' 00:06:08.595 16:59:05 -- common/autotest_common.sh@940 -- # kill -0 1620153 00:06:08.595 16:59:05 -- common/autotest_common.sh@941 -- # uname 00:06:08.595 16:59:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:08.596 16:59:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1620153 00:06:08.596 16:59:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:08.596 16:59:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:08.596 16:59:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1620153' 00:06:08.596 killing process with pid 1620153 00:06:08.596 16:59:05 -- common/autotest_common.sh@955 -- # kill 1620153 00:06:08.596 16:59:05 -- common/autotest_common.sh@960 -- # wait 1620153 00:06:08.854 00:06:08.854 real 0m1.840s 00:06:08.854 user 0m3.532s 00:06:08.854 sys 0m0.483s 00:06:08.854 16:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.854 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:08.854 ************************************ 00:06:08.854 END TEST spdkcli_tcp 00:06:08.854 ************************************ 00:06:08.854 16:59:05 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:08.854 16:59:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:08.854 16:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.854 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:08.854 ************************************ 00:06:08.854 START TEST dpdk_mem_utility 00:06:08.854 ************************************ 00:06:08.854 16:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:09.113 * Looking for test storage... 00:06:09.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:09.113 16:59:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.113 16:59:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.113 16:59:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.113 16:59:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.113 16:59:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.113 16:59:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.113 16:59:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.113 16:59:05 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.113 16:59:05 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.113 16:59:05 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.113 16:59:05 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.113 16:59:05 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.113 16:59:05 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.113 16:59:05 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.113 16:59:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.113 16:59:05 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.113 16:59:05 -- scripts/common.sh@344 -- # : 1 00:06:09.113 16:59:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.113 16:59:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.113 16:59:05 -- scripts/common.sh@364 -- # decimal 1 00:06:09.113 16:59:05 -- scripts/common.sh@352 -- # local d=1 00:06:09.113 16:59:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.113 16:59:05 -- scripts/common.sh@354 -- # echo 1 00:06:09.113 16:59:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.113 16:59:05 -- scripts/common.sh@365 -- # decimal 2 00:06:09.113 16:59:05 -- scripts/common.sh@352 -- # local d=2 00:06:09.113 16:59:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.113 16:59:05 -- scripts/common.sh@354 -- # echo 2 00:06:09.113 16:59:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.113 16:59:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.113 16:59:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.113 16:59:05 -- scripts/common.sh@367 -- # return 0 00:06:09.113 16:59:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.113 16:59:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.113 --rc genhtml_branch_coverage=1 00:06:09.113 --rc genhtml_function_coverage=1 00:06:09.113 --rc genhtml_legend=1 00:06:09.113 --rc geninfo_all_blocks=1 00:06:09.113 --rc geninfo_unexecuted_blocks=1 00:06:09.113 00:06:09.113 ' 00:06:09.113 16:59:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.113 --rc genhtml_branch_coverage=1 00:06:09.113 --rc genhtml_function_coverage=1 00:06:09.113 --rc genhtml_legend=1 00:06:09.113 --rc geninfo_all_blocks=1 00:06:09.113 --rc geninfo_unexecuted_blocks=1 00:06:09.113 00:06:09.113 ' 00:06:09.113 16:59:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.113 --rc genhtml_branch_coverage=1 00:06:09.113 --rc genhtml_function_coverage=1 00:06:09.113 --rc genhtml_legend=1 00:06:09.113 --rc geninfo_all_blocks=1 00:06:09.113 --rc geninfo_unexecuted_blocks=1 00:06:09.113 00:06:09.113 ' 00:06:09.113 16:59:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.113 --rc genhtml_branch_coverage=1 00:06:09.113 --rc genhtml_function_coverage=1 00:06:09.113 --rc genhtml_legend=1 00:06:09.113 --rc geninfo_all_blocks=1 00:06:09.113 --rc geninfo_unexecuted_blocks=1 00:06:09.113 00:06:09.113 ' 00:06:09.113 16:59:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:09.113 16:59:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1620501 00:06:09.113 16:59:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:09.113 16:59:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1620501 00:06:09.113 16:59:05 -- common/autotest_common.sh@829 -- # '[' -z 1620501 ']' 00:06:09.113 16:59:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:09.113 16:59:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.113 16:59:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:09.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:09.113 16:59:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.113 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:09.113 [2024-11-27 16:59:05.984560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:09.113 [2024-11-27 16:59:05.984640] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1620501 ] 00:06:09.113 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.113 [2024-11-27 16:59:06.041415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.371 [2024-11-27 16:59:06.129236] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:09.372 [2024-11-27 16:59:06.129392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.306 16:59:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.306 16:59:06 -- common/autotest_common.sh@862 -- # return 0 00:06:10.306 16:59:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:10.306 16:59:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:10.306 16:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.306 16:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:10.306 { 00:06:10.306 "filename": "/tmp/spdk_mem_dump.txt" 00:06:10.306 } 00:06:10.306 16:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.306 16:59:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:10.306 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:10.306 1 heaps totaling size 814.000000 MiB 00:06:10.306 size: 814.000000 MiB heap id: 0 00:06:10.306 end heaps---------- 00:06:10.306 8 mempools totaling size 598.116089 MiB 00:06:10.306 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:10.306 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:10.306 size: 84.521057 MiB name: bdev_io_1620501 00:06:10.306 size: 51.011292 MiB name: evtpool_1620501 00:06:10.306 size: 50.003479 MiB name: msgpool_1620501 00:06:10.306 size: 21.763794 MiB name: PDU_Pool 00:06:10.306 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:10.306 size: 0.026123 MiB name: Session_Pool 00:06:10.306 end mempools------- 00:06:10.306 6 memzones totaling size 4.142822 MiB 00:06:10.306 size: 1.000366 MiB name: RG_ring_0_1620501 00:06:10.306 size: 1.000366 MiB name: RG_ring_1_1620501 00:06:10.306 size: 1.000366 MiB name: RG_ring_4_1620501 00:06:10.306 size: 1.000366 MiB name: RG_ring_5_1620501 00:06:10.306 size: 0.125366 MiB name: RG_ring_2_1620501 00:06:10.306 size: 0.015991 MiB name: RG_ring_3_1620501 00:06:10.306 end memzones------- 00:06:10.306 16:59:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:10.306 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:10.306 list of free elements. size: 12.519348 MiB 00:06:10.306 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:10.306 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:10.306 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:10.306 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:10.306 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:10.306 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:10.306 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:10.306 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:10.306 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:10.306 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:10.306 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:10.306 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:10.306 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:10.306 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:10.306 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:10.306 list of standard malloc elements. size: 199.218079 MiB 00:06:10.306 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:10.306 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:10.306 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:10.306 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:10.306 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:10.306 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:10.306 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:10.306 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:10.306 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:10.306 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:10.306 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:10.306 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:10.306 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:10.306 list of memzone associated elements. size: 602.262573 MiB 00:06:10.306 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:10.306 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:10.306 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:10.306 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:10.306 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:10.306 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1620501_0 00:06:10.306 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:10.306 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1620501_0 00:06:10.306 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:10.306 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1620501_0 00:06:10.306 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:10.306 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:10.306 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:10.306 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:10.306 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:10.306 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1620501 00:06:10.306 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:10.306 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1620501 00:06:10.306 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:10.306 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1620501 00:06:10.306 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:10.306 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:10.306 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:10.306 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:10.306 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:10.306 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:10.306 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:10.306 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:10.306 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:10.306 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1620501 00:06:10.307 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:10.307 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1620501 00:06:10.307 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:10.307 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1620501 00:06:10.307 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:10.307 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1620501 00:06:10.307 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:10.307 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1620501 00:06:10.307 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:10.307 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:10.307 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:10.307 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:10.307 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:10.307 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:10.307 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:10.307 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1620501 00:06:10.307 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:10.307 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:10.307 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:10.307 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:10.307 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:10.307 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1620501 00:06:10.307 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:10.307 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:10.307 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:10.307 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1620501 00:06:10.307 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:10.307 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1620501 00:06:10.307 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:10.307 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:10.307 16:59:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:10.307 16:59:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1620501 00:06:10.307 16:59:07 -- common/autotest_common.sh@936 -- # '[' -z 1620501 ']' 00:06:10.307 16:59:07 -- common/autotest_common.sh@940 -- # kill -0 1620501 00:06:10.307 16:59:07 -- common/autotest_common.sh@941 -- # uname 00:06:10.307 16:59:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:10.307 16:59:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1620501 00:06:10.307 16:59:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:10.307 16:59:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:10.307 16:59:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1620501' 00:06:10.307 killing process with pid 1620501 00:06:10.307 16:59:07 -- common/autotest_common.sh@955 -- # kill 1620501 00:06:10.307 16:59:07 -- common/autotest_common.sh@960 -- # wait 1620501 00:06:10.565 00:06:10.565 real 0m1.711s 00:06:10.565 user 0m1.866s 00:06:10.565 sys 0m0.472s 00:06:10.565 16:59:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.565 16:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:10.565 ************************************ 00:06:10.565 END TEST dpdk_mem_utility 00:06:10.565 ************************************ 00:06:10.823 16:59:07 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:10.823 16:59:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.823 16:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:10.823 ************************************ 00:06:10.823 START TEST event 00:06:10.823 ************************************ 00:06:10.823 16:59:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:10.823 * Looking for test storage... 00:06:10.823 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:10.823 16:59:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:10.823 16:59:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:10.823 16:59:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:10.823 16:59:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:10.823 16:59:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:10.823 16:59:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:10.823 16:59:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:10.823 16:59:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:10.823 16:59:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:10.823 16:59:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:10.823 16:59:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:10.823 16:59:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:10.823 16:59:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:10.823 16:59:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:10.823 16:59:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:10.823 16:59:07 -- scripts/common.sh@344 -- # : 1 00:06:10.823 16:59:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:10.823 16:59:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:10.823 16:59:07 -- scripts/common.sh@364 -- # decimal 1 00:06:10.823 16:59:07 -- scripts/common.sh@352 -- # local d=1 00:06:10.823 16:59:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:10.823 16:59:07 -- scripts/common.sh@354 -- # echo 1 00:06:10.823 16:59:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:10.823 16:59:07 -- scripts/common.sh@365 -- # decimal 2 00:06:10.823 16:59:07 -- scripts/common.sh@352 -- # local d=2 00:06:10.823 16:59:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:10.823 16:59:07 -- scripts/common.sh@354 -- # echo 2 00:06:10.823 16:59:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:10.823 16:59:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:10.823 16:59:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:10.823 16:59:07 -- scripts/common.sh@367 -- # return 0 00:06:10.823 16:59:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:10.823 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.823 --rc genhtml_branch_coverage=1 00:06:10.823 --rc genhtml_function_coverage=1 00:06:10.823 --rc genhtml_legend=1 00:06:10.823 --rc geninfo_all_blocks=1 00:06:10.823 --rc geninfo_unexecuted_blocks=1 00:06:10.823 00:06:10.823 ' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:10.823 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.823 --rc genhtml_branch_coverage=1 00:06:10.823 --rc genhtml_function_coverage=1 00:06:10.823 --rc genhtml_legend=1 00:06:10.823 --rc geninfo_all_blocks=1 00:06:10.823 --rc geninfo_unexecuted_blocks=1 00:06:10.823 00:06:10.823 ' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:10.823 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.823 --rc genhtml_branch_coverage=1 00:06:10.823 --rc genhtml_function_coverage=1 00:06:10.823 --rc genhtml_legend=1 00:06:10.823 --rc geninfo_all_blocks=1 00:06:10.823 --rc geninfo_unexecuted_blocks=1 00:06:10.823 00:06:10.823 ' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:10.823 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.823 --rc genhtml_branch_coverage=1 00:06:10.823 --rc genhtml_function_coverage=1 00:06:10.823 --rc genhtml_legend=1 00:06:10.823 --rc geninfo_all_blocks=1 00:06:10.823 --rc geninfo_unexecuted_blocks=1 00:06:10.823 00:06:10.823 ' 00:06:10.823 16:59:07 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:10.823 16:59:07 -- bdev/nbd_common.sh@6 -- # set -e 00:06:10.823 16:59:07 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:10.823 16:59:07 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:10.823 16:59:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.823 16:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:10.823 ************************************ 00:06:10.823 START TEST event_perf 00:06:10.823 ************************************ 00:06:10.823 16:59:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:10.823 Running I/O for 1 seconds...[2024-11-27 16:59:07.702258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:10.823 [2024-11-27 16:59:07.702325] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1620828 ] 00:06:10.823 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.823 [2024-11-27 16:59:07.762800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:11.080 [2024-11-27 16:59:07.855518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.080 [2024-11-27 16:59:07.855615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:11.080 [2024-11-27 16:59:07.855618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.080 [2024-11-27 16:59:07.855589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:12.013 Running I/O for 1 seconds... 00:06:12.013 lcore 0: 230898 00:06:12.013 lcore 1: 230898 00:06:12.013 lcore 2: 230898 00:06:12.013 lcore 3: 230899 00:06:12.013 done. 00:06:12.013 00:06:12.013 real 0m1.248s 00:06:12.013 user 0m4.166s 00:06:12.013 sys 0m0.078s 00:06:12.013 16:59:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.013 16:59:08 -- common/autotest_common.sh@10 -- # set +x 00:06:12.013 ************************************ 00:06:12.013 END TEST event_perf 00:06:12.013 ************************************ 00:06:12.271 16:59:08 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:12.271 16:59:08 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:12.271 16:59:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.271 16:59:08 -- common/autotest_common.sh@10 -- # set +x 00:06:12.271 ************************************ 00:06:12.271 START TEST event_reactor 00:06:12.271 ************************************ 00:06:12.271 16:59:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:12.271 [2024-11-27 16:59:08.981156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:12.271 [2024-11-27 16:59:08.981255] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1620989 ] 00:06:12.271 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.271 [2024-11-27 16:59:09.044315] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.271 [2024-11-27 16:59:09.132667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.644 test_start 00:06:13.644 oneshot 00:06:13.644 tick 100 00:06:13.644 tick 100 00:06:13.644 tick 250 00:06:13.644 tick 100 00:06:13.644 tick 100 00:06:13.644 tick 100 00:06:13.644 tick 250 00:06:13.644 tick 500 00:06:13.644 tick 100 00:06:13.644 tick 100 00:06:13.644 tick 250 00:06:13.644 tick 100 00:06:13.644 tick 100 00:06:13.644 test_end 00:06:13.644 00:06:13.644 real 0m1.243s 00:06:13.644 user 0m1.151s 00:06:13.644 sys 0m0.087s 00:06:13.644 16:59:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.644 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:06:13.644 ************************************ 00:06:13.644 END TEST event_reactor 00:06:13.644 ************************************ 00:06:13.644 16:59:10 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:13.644 16:59:10 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:13.644 16:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.644 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:06:13.644 ************************************ 00:06:13.644 START TEST event_reactor_perf 00:06:13.644 ************************************ 00:06:13.644 16:59:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:13.644 [2024-11-27 16:59:10.251460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:13.644 [2024-11-27 16:59:10.251548] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1621145 ] 00:06:13.644 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.644 [2024-11-27 16:59:10.317386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.644 [2024-11-27 16:59:10.408190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.576 test_start 00:06:14.576 test_end 00:06:14.576 Performance: 345728 events per second 00:06:14.576 00:06:14.576 real 0m1.252s 00:06:14.576 user 0m1.164s 00:06:14.576 sys 0m0.082s 00:06:14.576 16:59:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.576 16:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:14.576 ************************************ 00:06:14.576 END TEST event_reactor_perf 00:06:14.576 ************************************ 00:06:14.576 16:59:11 -- event/event.sh@49 -- # uname -s 00:06:14.576 16:59:11 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:14.576 16:59:11 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:14.576 16:59:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.576 16:59:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.576 16:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:14.576 ************************************ 00:06:14.576 START TEST event_scheduler 00:06:14.576 ************************************ 00:06:14.576 16:59:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:14.834 * Looking for test storage... 00:06:14.834 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:14.834 16:59:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:14.834 16:59:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:14.834 16:59:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:14.834 16:59:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:14.834 16:59:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:14.834 16:59:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:14.834 16:59:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:14.834 16:59:11 -- scripts/common.sh@335 -- # IFS=.-: 00:06:14.834 16:59:11 -- scripts/common.sh@335 -- # read -ra ver1 00:06:14.834 16:59:11 -- scripts/common.sh@336 -- # IFS=.-: 00:06:14.834 16:59:11 -- scripts/common.sh@336 -- # read -ra ver2 00:06:14.834 16:59:11 -- scripts/common.sh@337 -- # local 'op=<' 00:06:14.834 16:59:11 -- scripts/common.sh@339 -- # ver1_l=2 00:06:14.834 16:59:11 -- scripts/common.sh@340 -- # ver2_l=1 00:06:14.834 16:59:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:14.834 16:59:11 -- scripts/common.sh@343 -- # case "$op" in 00:06:14.834 16:59:11 -- scripts/common.sh@344 -- # : 1 00:06:14.834 16:59:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:14.834 16:59:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:14.834 16:59:11 -- scripts/common.sh@364 -- # decimal 1 00:06:14.834 16:59:11 -- scripts/common.sh@352 -- # local d=1 00:06:14.834 16:59:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:14.834 16:59:11 -- scripts/common.sh@354 -- # echo 1 00:06:14.834 16:59:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:14.834 16:59:11 -- scripts/common.sh@365 -- # decimal 2 00:06:14.834 16:59:11 -- scripts/common.sh@352 -- # local d=2 00:06:14.834 16:59:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:14.834 16:59:11 -- scripts/common.sh@354 -- # echo 2 00:06:14.834 16:59:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:14.834 16:59:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:14.834 16:59:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:14.834 16:59:11 -- scripts/common.sh@367 -- # return 0 00:06:14.834 16:59:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:14.834 16:59:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:14.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:14.834 --rc genhtml_branch_coverage=1 00:06:14.834 --rc genhtml_function_coverage=1 00:06:14.834 --rc genhtml_legend=1 00:06:14.834 --rc geninfo_all_blocks=1 00:06:14.834 --rc geninfo_unexecuted_blocks=1 00:06:14.834 00:06:14.834 ' 00:06:14.834 16:59:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:14.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:14.834 --rc genhtml_branch_coverage=1 00:06:14.834 --rc genhtml_function_coverage=1 00:06:14.834 --rc genhtml_legend=1 00:06:14.834 --rc geninfo_all_blocks=1 00:06:14.834 --rc geninfo_unexecuted_blocks=1 00:06:14.834 00:06:14.834 ' 00:06:14.834 16:59:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:14.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:14.834 --rc genhtml_branch_coverage=1 00:06:14.834 --rc genhtml_function_coverage=1 00:06:14.834 --rc genhtml_legend=1 00:06:14.834 --rc geninfo_all_blocks=1 00:06:14.834 --rc geninfo_unexecuted_blocks=1 00:06:14.834 00:06:14.834 ' 00:06:14.834 16:59:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:14.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:14.834 --rc genhtml_branch_coverage=1 00:06:14.834 --rc genhtml_function_coverage=1 00:06:14.834 --rc genhtml_legend=1 00:06:14.834 --rc geninfo_all_blocks=1 00:06:14.834 --rc geninfo_unexecuted_blocks=1 00:06:14.834 00:06:14.834 ' 00:06:14.834 16:59:11 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:14.834 16:59:11 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1621335 00:06:14.834 16:59:11 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:14.834 16:59:11 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:14.834 16:59:11 -- scheduler/scheduler.sh@37 -- # waitforlisten 1621335 00:06:14.834 16:59:11 -- common/autotest_common.sh@829 -- # '[' -z 1621335 ']' 00:06:14.834 16:59:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.834 16:59:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:14.834 16:59:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.834 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.834 16:59:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:14.834 16:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:14.834 [2024-11-27 16:59:11.700351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:14.834 [2024-11-27 16:59:11.700421] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1621335 ] 00:06:14.834 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.834 [2024-11-27 16:59:11.761956] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.091 [2024-11-27 16:59:11.852845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.091 [2024-11-27 16:59:11.852928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.091 [2024-11-27 16:59:11.852931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.091 [2024-11-27 16:59:11.852869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.091 16:59:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:15.091 16:59:11 -- common/autotest_common.sh@862 -- # return 0 00:06:15.091 16:59:11 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:15.091 16:59:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.091 16:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:15.091 POWER: Env isn't set yet! 00:06:15.091 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:15.091 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:15.091 POWER: Cannot get available frequencies of lcore 0 00:06:15.091 POWER: Attempting to initialise PSTAT power management... 00:06:15.091 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:15.091 POWER: Initialized successfully for lcore 0 power management 00:06:15.091 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:15.091 POWER: Initialized successfully for lcore 1 power management 00:06:15.091 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:15.091 POWER: Initialized successfully for lcore 2 power management 00:06:15.091 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:15.091 POWER: Initialized successfully for lcore 3 power management 00:06:15.091 [2024-11-27 16:59:11.961713] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:15.091 [2024-11-27 16:59:11.961730] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:15.091 [2024-11-27 16:59:11.961741] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:15.091 16:59:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.091 16:59:11 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:15.091 16:59:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.091 16:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:15.348 [2024-11-27 16:59:12.064136] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:15.348 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.348 16:59:12 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:15.348 16:59:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:15.348 16:59:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.348 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.348 ************************************ 00:06:15.348 START TEST scheduler_create_thread 00:06:15.348 ************************************ 00:06:15.348 16:59:12 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:15.348 16:59:12 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:15.348 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.348 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.348 2 00:06:15.348 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.348 16:59:12 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:15.348 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.348 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.348 3 00:06:15.348 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.348 16:59:12 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 4 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 5 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 6 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 7 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 8 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 9 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 10 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.349 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:15.349 16:59:12 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:15.349 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.349 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:15.912 16:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.912 16:59:12 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:15.912 16:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.912 16:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:17.281 16:59:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:17.281 16:59:14 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:17.281 16:59:14 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:17.281 16:59:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:17.281 16:59:14 -- common/autotest_common.sh@10 -- # set +x 00:06:18.655 16:59:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:18.655 00:06:18.655 real 0m3.099s 00:06:18.655 user 0m0.008s 00:06:18.655 sys 0m0.006s 00:06:18.655 16:59:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.655 16:59:15 -- common/autotest_common.sh@10 -- # set +x 00:06:18.655 ************************************ 00:06:18.655 END TEST scheduler_create_thread 00:06:18.655 ************************************ 00:06:18.655 16:59:15 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:18.655 16:59:15 -- scheduler/scheduler.sh@46 -- # killprocess 1621335 00:06:18.655 16:59:15 -- common/autotest_common.sh@936 -- # '[' -z 1621335 ']' 00:06:18.655 16:59:15 -- common/autotest_common.sh@940 -- # kill -0 1621335 00:06:18.655 16:59:15 -- common/autotest_common.sh@941 -- # uname 00:06:18.655 16:59:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.655 16:59:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1621335 00:06:18.655 16:59:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:18.655 16:59:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:18.655 16:59:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1621335' 00:06:18.655 killing process with pid 1621335 00:06:18.655 16:59:15 -- common/autotest_common.sh@955 -- # kill 1621335 00:06:18.655 16:59:15 -- common/autotest_common.sh@960 -- # wait 1621335 00:06:18.655 [2024-11-27 16:59:15.548451] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:18.914 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:18.914 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:18.914 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:18.914 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:18.914 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:18.914 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:18.914 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:18.914 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:18.914 00:06:18.914 real 0m4.284s 00:06:18.914 user 0m6.967s 00:06:18.914 sys 0m0.348s 00:06:18.914 16:59:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.914 16:59:15 -- common/autotest_common.sh@10 -- # set +x 00:06:18.914 ************************************ 00:06:18.914 END TEST event_scheduler 00:06:18.914 ************************************ 00:06:18.914 16:59:15 -- event/event.sh@51 -- # modprobe -n nbd 00:06:18.914 16:59:15 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:18.914 16:59:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:18.914 16:59:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.914 16:59:15 -- common/autotest_common.sh@10 -- # set +x 00:06:18.914 ************************************ 00:06:18.914 START TEST app_repeat 00:06:18.914 ************************************ 00:06:18.914 16:59:15 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:18.914 16:59:15 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:18.914 16:59:15 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:18.914 16:59:15 -- event/event.sh@13 -- # local nbd_list 00:06:18.914 16:59:15 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:18.914 16:59:15 -- event/event.sh@14 -- # local bdev_list 00:06:18.914 16:59:15 -- event/event.sh@15 -- # local repeat_times=4 00:06:18.914 16:59:15 -- event/event.sh@17 -- # modprobe nbd 00:06:18.914 16:59:15 -- event/event.sh@19 -- # repeat_pid=1621926 00:06:18.914 16:59:15 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:18.914 16:59:15 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:18.914 16:59:15 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1621926' 00:06:18.914 Process app_repeat pid: 1621926 00:06:18.914 16:59:15 -- event/event.sh@23 -- # for i in {0..2} 00:06:18.914 16:59:15 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:18.914 spdk_app_start Round 0 00:06:18.914 16:59:15 -- event/event.sh@25 -- # waitforlisten 1621926 /var/tmp/spdk-nbd.sock 00:06:18.914 16:59:15 -- common/autotest_common.sh@829 -- # '[' -z 1621926 ']' 00:06:18.914 16:59:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:18.914 16:59:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:18.914 16:59:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:18.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:18.914 16:59:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:18.914 16:59:15 -- common/autotest_common.sh@10 -- # set +x 00:06:18.914 [2024-11-27 16:59:15.863537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:18.914 [2024-11-27 16:59:15.863626] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1621926 ] 00:06:19.172 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.172 [2024-11-27 16:59:15.928951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:19.172 [2024-11-27 16:59:16.018413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.172 [2024-11-27 16:59:16.018418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.106 16:59:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.106 16:59:16 -- common/autotest_common.sh@862 -- # return 0 00:06:20.106 16:59:16 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.365 Malloc0 00:06:20.365 16:59:17 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.623 Malloc1 00:06:20.624 16:59:17 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.624 16:59:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.882 /dev/nbd0 00:06:20.883 16:59:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.883 16:59:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.883 16:59:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.883 16:59:17 -- common/autotest_common.sh@867 -- # local i 00:06:20.883 16:59:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.883 16:59:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.883 16:59:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.883 16:59:17 -- common/autotest_common.sh@871 -- # break 00:06:20.883 16:59:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.883 16:59:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.883 16:59:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.883 1+0 records in 00:06:20.883 1+0 records out 00:06:20.883 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207497 s, 19.7 MB/s 00:06:20.883 16:59:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.883 16:59:17 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.883 16:59:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.883 16:59:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.883 16:59:17 -- common/autotest_common.sh@887 -- # return 0 00:06:20.883 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.883 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.883 16:59:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:21.141 /dev/nbd1 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:21.141 16:59:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:21.141 16:59:17 -- common/autotest_common.sh@867 -- # local i 00:06:21.141 16:59:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:21.141 16:59:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:21.141 16:59:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:21.141 16:59:17 -- common/autotest_common.sh@871 -- # break 00:06:21.141 16:59:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:21.141 16:59:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:21.141 16:59:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:21.141 1+0 records in 00:06:21.141 1+0 records out 00:06:21.141 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000215171 s, 19.0 MB/s 00:06:21.141 16:59:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.141 16:59:17 -- common/autotest_common.sh@884 -- # size=4096 00:06:21.141 16:59:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.141 16:59:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:21.141 16:59:17 -- common/autotest_common.sh@887 -- # return 0 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.141 16:59:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.399 16:59:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:21.399 { 00:06:21.399 "nbd_device": "/dev/nbd0", 00:06:21.399 "bdev_name": "Malloc0" 00:06:21.399 }, 00:06:21.399 { 00:06:21.399 "nbd_device": "/dev/nbd1", 00:06:21.399 "bdev_name": "Malloc1" 00:06:21.399 } 00:06:21.399 ]' 00:06:21.399 16:59:18 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:21.399 { 00:06:21.399 "nbd_device": "/dev/nbd0", 00:06:21.399 "bdev_name": "Malloc0" 00:06:21.399 }, 00:06:21.399 { 00:06:21.399 "nbd_device": "/dev/nbd1", 00:06:21.399 "bdev_name": "Malloc1" 00:06:21.399 } 00:06:21.399 ]' 00:06:21.399 16:59:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.399 16:59:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:21.399 /dev/nbd1' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:21.400 /dev/nbd1' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@65 -- # count=2 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@95 -- # count=2 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:21.400 256+0 records in 00:06:21.400 256+0 records out 00:06:21.400 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505332 s, 208 MB/s 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:21.400 256+0 records in 00:06:21.400 256+0 records out 00:06:21.400 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255283 s, 41.1 MB/s 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:21.400 256+0 records in 00:06:21.400 256+0 records out 00:06:21.400 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247839 s, 42.3 MB/s 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@51 -- # local i 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.400 16:59:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.659 16:59:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.659 16:59:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.659 16:59:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.659 16:59:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.659 16:59:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@41 -- # break 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@41 -- # break 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.997 16:59:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@65 -- # true 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@65 -- # count=0 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@104 -- # count=0 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:22.254 16:59:19 -- bdev/nbd_common.sh@109 -- # return 0 00:06:22.254 16:59:19 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.512 16:59:19 -- event/event.sh@35 -- # sleep 3 00:06:22.769 [2024-11-27 16:59:19.686301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:23.027 [2024-11-27 16:59:19.775312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.027 [2024-11-27 16:59:19.775313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.027 [2024-11-27 16:59:19.836634] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:23.027 [2024-11-27 16:59:19.836697] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.554 16:59:22 -- event/event.sh@23 -- # for i in {0..2} 00:06:25.554 16:59:22 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:25.554 spdk_app_start Round 1 00:06:25.554 16:59:22 -- event/event.sh@25 -- # waitforlisten 1621926 /var/tmp/spdk-nbd.sock 00:06:25.554 16:59:22 -- common/autotest_common.sh@829 -- # '[' -z 1621926 ']' 00:06:25.554 16:59:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.554 16:59:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.554 16:59:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.554 16:59:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.554 16:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:25.812 16:59:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.812 16:59:22 -- common/autotest_common.sh@862 -- # return 0 00:06:25.812 16:59:22 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.069 Malloc0 00:06:26.069 16:59:22 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.328 Malloc1 00:06:26.328 16:59:23 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@12 -- # local i 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.328 16:59:23 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:26.585 /dev/nbd0 00:06:26.585 16:59:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:26.585 16:59:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:26.585 16:59:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:26.585 16:59:23 -- common/autotest_common.sh@867 -- # local i 00:06:26.585 16:59:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:26.586 16:59:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:26.586 16:59:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:26.586 16:59:23 -- common/autotest_common.sh@871 -- # break 00:06:26.586 16:59:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:26.586 16:59:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:26.586 16:59:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:26.586 1+0 records in 00:06:26.586 1+0 records out 00:06:26.586 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209116 s, 19.6 MB/s 00:06:26.586 16:59:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.844 16:59:23 -- common/autotest_common.sh@884 -- # size=4096 00:06:26.844 16:59:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.844 16:59:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:26.844 16:59:23 -- common/autotest_common.sh@887 -- # return 0 00:06:26.844 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:26.845 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.845 16:59:23 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:26.845 /dev/nbd1 00:06:26.845 16:59:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:26.845 16:59:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:26.845 16:59:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:26.845 16:59:23 -- common/autotest_common.sh@867 -- # local i 00:06:26.845 16:59:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:26.845 16:59:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:26.845 16:59:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:26.845 16:59:23 -- common/autotest_common.sh@871 -- # break 00:06:26.845 16:59:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:26.845 16:59:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:26.845 16:59:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:27.103 1+0 records in 00:06:27.103 1+0 records out 00:06:27.103 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000251979 s, 16.3 MB/s 00:06:27.103 16:59:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.103 16:59:23 -- common/autotest_common.sh@884 -- # size=4096 00:06:27.103 16:59:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.103 16:59:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:27.103 16:59:23 -- common/autotest_common.sh@887 -- # return 0 00:06:27.103 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:27.103 16:59:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:27.103 16:59:23 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:27.103 16:59:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.103 16:59:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:27.361 { 00:06:27.361 "nbd_device": "/dev/nbd0", 00:06:27.361 "bdev_name": "Malloc0" 00:06:27.361 }, 00:06:27.361 { 00:06:27.361 "nbd_device": "/dev/nbd1", 00:06:27.361 "bdev_name": "Malloc1" 00:06:27.361 } 00:06:27.361 ]' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:27.361 { 00:06:27.361 "nbd_device": "/dev/nbd0", 00:06:27.361 "bdev_name": "Malloc0" 00:06:27.361 }, 00:06:27.361 { 00:06:27.361 "nbd_device": "/dev/nbd1", 00:06:27.361 "bdev_name": "Malloc1" 00:06:27.361 } 00:06:27.361 ]' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:27.361 /dev/nbd1' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:27.361 /dev/nbd1' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@65 -- # count=2 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@95 -- # count=2 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:27.361 256+0 records in 00:06:27.361 256+0 records out 00:06:27.361 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00385359 s, 272 MB/s 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:27.361 256+0 records in 00:06:27.361 256+0 records out 00:06:27.361 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022344 s, 46.9 MB/s 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:27.361 256+0 records in 00:06:27.361 256+0 records out 00:06:27.361 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269276 s, 38.9 MB/s 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.361 16:59:24 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.362 16:59:24 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:27.362 16:59:24 -- bdev/nbd_common.sh@51 -- # local i 00:06:27.362 16:59:24 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.362 16:59:24 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@41 -- # break 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.620 16:59:24 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@41 -- # break 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.878 16:59:24 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@65 -- # true 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@65 -- # count=0 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@104 -- # count=0 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:28.135 16:59:25 -- bdev/nbd_common.sh@109 -- # return 0 00:06:28.135 16:59:25 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:28.392 16:59:25 -- event/event.sh@35 -- # sleep 3 00:06:28.650 [2024-11-27 16:59:25.551794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:28.908 [2024-11-27 16:59:25.639421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.908 [2024-11-27 16:59:25.639424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.908 [2024-11-27 16:59:25.699873] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:28.908 [2024-11-27 16:59:25.699964] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:31.437 16:59:28 -- event/event.sh@23 -- # for i in {0..2} 00:06:31.437 16:59:28 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:31.437 spdk_app_start Round 2 00:06:31.437 16:59:28 -- event/event.sh@25 -- # waitforlisten 1621926 /var/tmp/spdk-nbd.sock 00:06:31.437 16:59:28 -- common/autotest_common.sh@829 -- # '[' -z 1621926 ']' 00:06:31.437 16:59:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:31.437 16:59:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.437 16:59:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:31.437 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:31.437 16:59:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.437 16:59:28 -- common/autotest_common.sh@10 -- # set +x 00:06:31.694 16:59:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.694 16:59:28 -- common/autotest_common.sh@862 -- # return 0 00:06:31.694 16:59:28 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:31.953 Malloc0 00:06:31.953 16:59:28 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:32.211 Malloc1 00:06:32.211 16:59:29 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@12 -- # local i 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.211 16:59:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:32.473 /dev/nbd0 00:06:32.473 16:59:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:32.473 16:59:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:32.473 16:59:29 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:32.473 16:59:29 -- common/autotest_common.sh@867 -- # local i 00:06:32.473 16:59:29 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:32.473 16:59:29 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:32.473 16:59:29 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:32.473 16:59:29 -- common/autotest_common.sh@871 -- # break 00:06:32.473 16:59:29 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:32.473 16:59:29 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:32.473 16:59:29 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:32.473 1+0 records in 00:06:32.473 1+0 records out 00:06:32.473 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00020333 s, 20.1 MB/s 00:06:32.473 16:59:29 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.473 16:59:29 -- common/autotest_common.sh@884 -- # size=4096 00:06:32.473 16:59:29 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.473 16:59:29 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:32.473 16:59:29 -- common/autotest_common.sh@887 -- # return 0 00:06:32.473 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:32.473 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.473 16:59:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:32.751 /dev/nbd1 00:06:32.751 16:59:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:32.751 16:59:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:32.751 16:59:29 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:32.751 16:59:29 -- common/autotest_common.sh@867 -- # local i 00:06:32.751 16:59:29 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:32.751 16:59:29 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:32.751 16:59:29 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:32.751 16:59:29 -- common/autotest_common.sh@871 -- # break 00:06:32.751 16:59:29 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:32.751 16:59:29 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:32.751 16:59:29 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:32.751 1+0 records in 00:06:32.751 1+0 records out 00:06:32.751 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209952 s, 19.5 MB/s 00:06:32.751 16:59:29 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.751 16:59:29 -- common/autotest_common.sh@884 -- # size=4096 00:06:32.751 16:59:29 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.751 16:59:29 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:32.751 16:59:29 -- common/autotest_common.sh@887 -- # return 0 00:06:32.751 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:32.751 16:59:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.751 16:59:29 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:32.752 16:59:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.752 16:59:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:33.010 16:59:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:33.010 { 00:06:33.010 "nbd_device": "/dev/nbd0", 00:06:33.010 "bdev_name": "Malloc0" 00:06:33.010 }, 00:06:33.010 { 00:06:33.010 "nbd_device": "/dev/nbd1", 00:06:33.010 "bdev_name": "Malloc1" 00:06:33.010 } 00:06:33.010 ]' 00:06:33.010 16:59:29 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:33.010 { 00:06:33.010 "nbd_device": "/dev/nbd0", 00:06:33.010 "bdev_name": "Malloc0" 00:06:33.010 }, 00:06:33.010 { 00:06:33.010 "nbd_device": "/dev/nbd1", 00:06:33.010 "bdev_name": "Malloc1" 00:06:33.010 } 00:06:33.010 ]' 00:06:33.010 16:59:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:33.269 /dev/nbd1' 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:33.269 /dev/nbd1' 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@65 -- # count=2 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@95 -- # count=2 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:33.269 256+0 records in 00:06:33.269 256+0 records out 00:06:33.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00524767 s, 200 MB/s 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.269 16:59:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:33.269 256+0 records in 00:06:33.269 256+0 records out 00:06:33.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267633 s, 39.2 MB/s 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:33.269 256+0 records in 00:06:33.269 256+0 records out 00:06:33.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280555 s, 37.4 MB/s 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@51 -- # local i 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.269 16:59:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@41 -- # break 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@45 -- # return 0 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.527 16:59:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@41 -- # break 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@45 -- # return 0 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.786 16:59:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@65 -- # true 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@65 -- # count=0 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@104 -- # count=0 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:34.044 16:59:30 -- bdev/nbd_common.sh@109 -- # return 0 00:06:34.044 16:59:30 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:34.302 16:59:31 -- event/event.sh@35 -- # sleep 3 00:06:34.559 [2024-11-27 16:59:31.436302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:34.818 [2024-11-27 16:59:31.524561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.818 [2024-11-27 16:59:31.524565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:34.818 [2024-11-27 16:59:31.586240] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:34.818 [2024-11-27 16:59:31.586317] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:37.347 16:59:34 -- event/event.sh@38 -- # waitforlisten 1621926 /var/tmp/spdk-nbd.sock 00:06:37.347 16:59:34 -- common/autotest_common.sh@829 -- # '[' -z 1621926 ']' 00:06:37.347 16:59:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:37.347 16:59:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.347 16:59:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:37.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:37.347 16:59:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.347 16:59:34 -- common/autotest_common.sh@10 -- # set +x 00:06:37.605 16:59:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.605 16:59:34 -- common/autotest_common.sh@862 -- # return 0 00:06:37.605 16:59:34 -- event/event.sh@39 -- # killprocess 1621926 00:06:37.605 16:59:34 -- common/autotest_common.sh@936 -- # '[' -z 1621926 ']' 00:06:37.605 16:59:34 -- common/autotest_common.sh@940 -- # kill -0 1621926 00:06:37.605 16:59:34 -- common/autotest_common.sh@941 -- # uname 00:06:37.605 16:59:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.605 16:59:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1621926 00:06:37.605 16:59:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.605 16:59:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.605 16:59:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1621926' 00:06:37.605 killing process with pid 1621926 00:06:37.605 16:59:34 -- common/autotest_common.sh@955 -- # kill 1621926 00:06:37.605 16:59:34 -- common/autotest_common.sh@960 -- # wait 1621926 00:06:37.863 spdk_app_start is called in Round 0. 00:06:37.863 Shutdown signal received, stop current app iteration 00:06:37.863 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:37.863 spdk_app_start is called in Round 1. 00:06:37.863 Shutdown signal received, stop current app iteration 00:06:37.863 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:37.863 spdk_app_start is called in Round 2. 00:06:37.863 Shutdown signal received, stop current app iteration 00:06:37.863 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:37.863 spdk_app_start is called in Round 3. 00:06:37.863 Shutdown signal received, stop current app iteration 00:06:37.863 16:59:34 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:37.863 16:59:34 -- event/event.sh@42 -- # return 0 00:06:37.863 00:06:37.863 real 0m18.861s 00:06:37.863 user 0m41.387s 00:06:37.863 sys 0m3.217s 00:06:37.863 16:59:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.863 16:59:34 -- common/autotest_common.sh@10 -- # set +x 00:06:37.863 ************************************ 00:06:37.863 END TEST app_repeat 00:06:37.863 ************************************ 00:06:37.863 16:59:34 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:37.863 16:59:34 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:37.863 16:59:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.863 16:59:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.863 16:59:34 -- common/autotest_common.sh@10 -- # set +x 00:06:37.863 ************************************ 00:06:37.863 START TEST cpu_locks 00:06:37.863 ************************************ 00:06:37.863 16:59:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:37.863 * Looking for test storage... 00:06:37.863 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:37.863 16:59:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:37.863 16:59:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:37.863 16:59:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.122 16:59:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.122 16:59:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.122 16:59:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.122 16:59:34 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.122 16:59:34 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.122 16:59:34 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.122 16:59:34 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.122 16:59:34 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.122 16:59:34 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.122 16:59:34 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.122 16:59:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.122 16:59:34 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.122 16:59:34 -- scripts/common.sh@344 -- # : 1 00:06:38.122 16:59:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.122 16:59:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.122 16:59:34 -- scripts/common.sh@364 -- # decimal 1 00:06:38.122 16:59:34 -- scripts/common.sh@352 -- # local d=1 00:06:38.122 16:59:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.122 16:59:34 -- scripts/common.sh@354 -- # echo 1 00:06:38.122 16:59:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.122 16:59:34 -- scripts/common.sh@365 -- # decimal 2 00:06:38.122 16:59:34 -- scripts/common.sh@352 -- # local d=2 00:06:38.122 16:59:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.122 16:59:34 -- scripts/common.sh@354 -- # echo 2 00:06:38.122 16:59:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.122 16:59:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.122 16:59:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.122 16:59:34 -- scripts/common.sh@367 -- # return 0 00:06:38.122 16:59:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.122 --rc genhtml_branch_coverage=1 00:06:38.122 --rc genhtml_function_coverage=1 00:06:38.122 --rc genhtml_legend=1 00:06:38.122 --rc geninfo_all_blocks=1 00:06:38.122 --rc geninfo_unexecuted_blocks=1 00:06:38.122 00:06:38.122 ' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.122 --rc genhtml_branch_coverage=1 00:06:38.122 --rc genhtml_function_coverage=1 00:06:38.122 --rc genhtml_legend=1 00:06:38.122 --rc geninfo_all_blocks=1 00:06:38.122 --rc geninfo_unexecuted_blocks=1 00:06:38.122 00:06:38.122 ' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.122 --rc genhtml_branch_coverage=1 00:06:38.122 --rc genhtml_function_coverage=1 00:06:38.122 --rc genhtml_legend=1 00:06:38.122 --rc geninfo_all_blocks=1 00:06:38.122 --rc geninfo_unexecuted_blocks=1 00:06:38.122 00:06:38.122 ' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.122 --rc genhtml_branch_coverage=1 00:06:38.122 --rc genhtml_function_coverage=1 00:06:38.122 --rc genhtml_legend=1 00:06:38.122 --rc geninfo_all_blocks=1 00:06:38.122 --rc geninfo_unexecuted_blocks=1 00:06:38.122 00:06:38.122 ' 00:06:38.122 16:59:34 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:38.122 16:59:34 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:38.122 16:59:34 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:38.122 16:59:34 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:38.122 16:59:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.122 16:59:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.122 16:59:34 -- common/autotest_common.sh@10 -- # set +x 00:06:38.122 ************************************ 00:06:38.122 START TEST default_locks 00:06:38.122 ************************************ 00:06:38.122 16:59:34 -- common/autotest_common.sh@1114 -- # default_locks 00:06:38.123 16:59:34 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1624479 00:06:38.123 16:59:34 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:38.123 16:59:34 -- event/cpu_locks.sh@47 -- # waitforlisten 1624479 00:06:38.123 16:59:34 -- common/autotest_common.sh@829 -- # '[' -z 1624479 ']' 00:06:38.123 16:59:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.123 16:59:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.123 16:59:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.123 16:59:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.123 16:59:34 -- common/autotest_common.sh@10 -- # set +x 00:06:38.123 [2024-11-27 16:59:34.921403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:38.123 [2024-11-27 16:59:34.921483] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1624479 ] 00:06:38.123 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.123 [2024-11-27 16:59:34.978746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.123 [2024-11-27 16:59:35.065222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.123 [2024-11-27 16:59:35.065391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.057 16:59:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:39.057 16:59:35 -- common/autotest_common.sh@862 -- # return 0 00:06:39.057 16:59:35 -- event/cpu_locks.sh@49 -- # locks_exist 1624479 00:06:39.057 16:59:35 -- event/cpu_locks.sh@22 -- # lslocks -p 1624479 00:06:39.057 16:59:35 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:39.315 lslocks: write error 00:06:39.315 16:59:36 -- event/cpu_locks.sh@50 -- # killprocess 1624479 00:06:39.315 16:59:36 -- common/autotest_common.sh@936 -- # '[' -z 1624479 ']' 00:06:39.315 16:59:36 -- common/autotest_common.sh@940 -- # kill -0 1624479 00:06:39.315 16:59:36 -- common/autotest_common.sh@941 -- # uname 00:06:39.315 16:59:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.315 16:59:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1624479 00:06:39.315 16:59:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.315 16:59:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.315 16:59:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1624479' 00:06:39.315 killing process with pid 1624479 00:06:39.315 16:59:36 -- common/autotest_common.sh@955 -- # kill 1624479 00:06:39.315 16:59:36 -- common/autotest_common.sh@960 -- # wait 1624479 00:06:39.881 16:59:36 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1624479 00:06:39.881 16:59:36 -- common/autotest_common.sh@650 -- # local es=0 00:06:39.881 16:59:36 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1624479 00:06:39.881 16:59:36 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:39.881 16:59:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.881 16:59:36 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:39.881 16:59:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.882 16:59:36 -- common/autotest_common.sh@653 -- # waitforlisten 1624479 00:06:39.882 16:59:36 -- common/autotest_common.sh@829 -- # '[' -z 1624479 ']' 00:06:39.882 16:59:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.882 16:59:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.882 16:59:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.882 16:59:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.882 16:59:36 -- common/autotest_common.sh@10 -- # set +x 00:06:39.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1624479) - No such process 00:06:39.882 ERROR: process (pid: 1624479) is no longer running 00:06:39.882 16:59:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:39.882 16:59:36 -- common/autotest_common.sh@862 -- # return 1 00:06:39.882 16:59:36 -- common/autotest_common.sh@653 -- # es=1 00:06:39.882 16:59:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:39.882 16:59:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:39.882 16:59:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:39.882 16:59:36 -- event/cpu_locks.sh@54 -- # no_locks 00:06:39.882 16:59:36 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:39.882 16:59:36 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:39.882 16:59:36 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:39.882 00:06:39.882 real 0m1.691s 00:06:39.882 user 0m1.857s 00:06:39.882 sys 0m0.563s 00:06:39.882 16:59:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.882 16:59:36 -- common/autotest_common.sh@10 -- # set +x 00:06:39.882 ************************************ 00:06:39.882 END TEST default_locks 00:06:39.882 ************************************ 00:06:39.882 16:59:36 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:39.882 16:59:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.882 16:59:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.882 16:59:36 -- common/autotest_common.sh@10 -- # set +x 00:06:39.882 ************************************ 00:06:39.882 START TEST default_locks_via_rpc 00:06:39.882 ************************************ 00:06:39.882 16:59:36 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:39.882 16:59:36 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1624656 00:06:39.882 16:59:36 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:39.882 16:59:36 -- event/cpu_locks.sh@63 -- # waitforlisten 1624656 00:06:39.882 16:59:36 -- common/autotest_common.sh@829 -- # '[' -z 1624656 ']' 00:06:39.882 16:59:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.882 16:59:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.882 16:59:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.882 16:59:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.882 16:59:36 -- common/autotest_common.sh@10 -- # set +x 00:06:39.882 [2024-11-27 16:59:36.635608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.882 [2024-11-27 16:59:36.635692] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1624656 ] 00:06:39.882 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.882 [2024-11-27 16:59:36.693682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.882 [2024-11-27 16:59:36.782663] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.882 [2024-11-27 16:59:36.782817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.817 16:59:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.817 16:59:37 -- common/autotest_common.sh@862 -- # return 0 00:06:40.817 16:59:37 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:40.817 16:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.817 16:59:37 -- common/autotest_common.sh@10 -- # set +x 00:06:40.817 16:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.817 16:59:37 -- event/cpu_locks.sh@67 -- # no_locks 00:06:40.817 16:59:37 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:40.817 16:59:37 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:40.817 16:59:37 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:40.817 16:59:37 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:40.817 16:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.817 16:59:37 -- common/autotest_common.sh@10 -- # set +x 00:06:40.817 16:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.817 16:59:37 -- event/cpu_locks.sh@71 -- # locks_exist 1624656 00:06:40.817 16:59:37 -- event/cpu_locks.sh@22 -- # lslocks -p 1624656 00:06:40.817 16:59:37 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:41.076 16:59:37 -- event/cpu_locks.sh@73 -- # killprocess 1624656 00:06:41.076 16:59:37 -- common/autotest_common.sh@936 -- # '[' -z 1624656 ']' 00:06:41.076 16:59:37 -- common/autotest_common.sh@940 -- # kill -0 1624656 00:06:41.076 16:59:37 -- common/autotest_common.sh@941 -- # uname 00:06:41.076 16:59:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.076 16:59:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1624656 00:06:41.076 16:59:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.076 16:59:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.076 16:59:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1624656' 00:06:41.076 killing process with pid 1624656 00:06:41.076 16:59:37 -- common/autotest_common.sh@955 -- # kill 1624656 00:06:41.076 16:59:37 -- common/autotest_common.sh@960 -- # wait 1624656 00:06:41.334 00:06:41.334 real 0m1.695s 00:06:41.334 user 0m1.904s 00:06:41.334 sys 0m0.532s 00:06:41.334 16:59:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.334 16:59:38 -- common/autotest_common.sh@10 -- # set +x 00:06:41.334 ************************************ 00:06:41.334 END TEST default_locks_via_rpc 00:06:41.334 ************************************ 00:06:41.593 16:59:38 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:41.593 16:59:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.593 16:59:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.593 16:59:38 -- common/autotest_common.sh@10 -- # set +x 00:06:41.593 ************************************ 00:06:41.593 START TEST non_locking_app_on_locked_coremask 00:06:41.593 ************************************ 00:06:41.593 16:59:38 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:41.593 16:59:38 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1624955 00:06:41.593 16:59:38 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:41.593 16:59:38 -- event/cpu_locks.sh@81 -- # waitforlisten 1624955 /var/tmp/spdk.sock 00:06:41.593 16:59:38 -- common/autotest_common.sh@829 -- # '[' -z 1624955 ']' 00:06:41.593 16:59:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.593 16:59:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.593 16:59:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.594 16:59:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.594 16:59:38 -- common/autotest_common.sh@10 -- # set +x 00:06:41.594 [2024-11-27 16:59:38.359032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:41.594 [2024-11-27 16:59:38.359113] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1624955 ] 00:06:41.594 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.594 [2024-11-27 16:59:38.416311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.594 [2024-11-27 16:59:38.505274] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.594 [2024-11-27 16:59:38.505436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.526 16:59:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.526 16:59:39 -- common/autotest_common.sh@862 -- # return 0 00:06:42.526 16:59:39 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1625095 00:06:42.526 16:59:39 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:42.526 16:59:39 -- event/cpu_locks.sh@85 -- # waitforlisten 1625095 /var/tmp/spdk2.sock 00:06:42.526 16:59:39 -- common/autotest_common.sh@829 -- # '[' -z 1625095 ']' 00:06:42.526 16:59:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.526 16:59:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.526 16:59:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.526 16:59:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.526 16:59:39 -- common/autotest_common.sh@10 -- # set +x 00:06:42.526 [2024-11-27 16:59:39.374004] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.526 [2024-11-27 16:59:39.374076] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625095 ] 00:06:42.526 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.526 [2024-11-27 16:59:39.463301] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:42.526 [2024-11-27 16:59:39.463334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.784 [2024-11-27 16:59:39.644665] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.784 [2024-11-27 16:59:39.644857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.717 16:59:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.717 16:59:40 -- common/autotest_common.sh@862 -- # return 0 00:06:43.717 16:59:40 -- event/cpu_locks.sh@87 -- # locks_exist 1624955 00:06:43.717 16:59:40 -- event/cpu_locks.sh@22 -- # lslocks -p 1624955 00:06:43.717 16:59:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:43.975 lslocks: write error 00:06:43.975 16:59:40 -- event/cpu_locks.sh@89 -- # killprocess 1624955 00:06:43.975 16:59:40 -- common/autotest_common.sh@936 -- # '[' -z 1624955 ']' 00:06:43.975 16:59:40 -- common/autotest_common.sh@940 -- # kill -0 1624955 00:06:43.975 16:59:40 -- common/autotest_common.sh@941 -- # uname 00:06:43.975 16:59:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.975 16:59:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1624955 00:06:43.976 16:59:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:43.976 16:59:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:43.976 16:59:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1624955' 00:06:43.976 killing process with pid 1624955 00:06:43.976 16:59:40 -- common/autotest_common.sh@955 -- # kill 1624955 00:06:43.976 16:59:40 -- common/autotest_common.sh@960 -- # wait 1624955 00:06:44.911 16:59:41 -- event/cpu_locks.sh@90 -- # killprocess 1625095 00:06:44.911 16:59:41 -- common/autotest_common.sh@936 -- # '[' -z 1625095 ']' 00:06:44.911 16:59:41 -- common/autotest_common.sh@940 -- # kill -0 1625095 00:06:44.911 16:59:41 -- common/autotest_common.sh@941 -- # uname 00:06:44.911 16:59:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.911 16:59:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625095 00:06:44.911 16:59:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.911 16:59:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.911 16:59:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625095' 00:06:44.911 killing process with pid 1625095 00:06:44.911 16:59:41 -- common/autotest_common.sh@955 -- # kill 1625095 00:06:44.911 16:59:41 -- common/autotest_common.sh@960 -- # wait 1625095 00:06:45.170 00:06:45.170 real 0m3.764s 00:06:45.170 user 0m4.148s 00:06:45.170 sys 0m1.092s 00:06:45.170 16:59:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.170 16:59:42 -- common/autotest_common.sh@10 -- # set +x 00:06:45.170 ************************************ 00:06:45.170 END TEST non_locking_app_on_locked_coremask 00:06:45.170 ************************************ 00:06:45.170 16:59:42 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:45.170 16:59:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.170 16:59:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.170 16:59:42 -- common/autotest_common.sh@10 -- # set +x 00:06:45.170 ************************************ 00:06:45.170 START TEST locking_app_on_unlocked_coremask 00:06:45.170 ************************************ 00:06:45.170 16:59:42 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:45.170 16:59:42 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1625407 00:06:45.170 16:59:42 -- event/cpu_locks.sh@99 -- # waitforlisten 1625407 /var/tmp/spdk.sock 00:06:45.170 16:59:42 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:45.170 16:59:42 -- common/autotest_common.sh@829 -- # '[' -z 1625407 ']' 00:06:45.170 16:59:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.170 16:59:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.170 16:59:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.170 16:59:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.170 16:59:42 -- common/autotest_common.sh@10 -- # set +x 00:06:45.429 [2024-11-27 16:59:42.154155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.429 [2024-11-27 16:59:42.154265] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625407 ] 00:06:45.429 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.429 [2024-11-27 16:59:42.216257] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:45.429 [2024-11-27 16:59:42.216300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.429 [2024-11-27 16:59:42.303558] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.429 [2024-11-27 16:59:42.303760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.363 16:59:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.363 16:59:43 -- common/autotest_common.sh@862 -- # return 0 00:06:46.363 16:59:43 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1625541 00:06:46.363 16:59:43 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:46.363 16:59:43 -- event/cpu_locks.sh@103 -- # waitforlisten 1625541 /var/tmp/spdk2.sock 00:06:46.363 16:59:43 -- common/autotest_common.sh@829 -- # '[' -z 1625541 ']' 00:06:46.363 16:59:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:46.363 16:59:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.363 16:59:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:46.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:46.363 16:59:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.363 16:59:43 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 [2024-11-27 16:59:43.149897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.363 [2024-11-27 16:59:43.149989] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625541 ] 00:06:46.363 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.363 [2024-11-27 16:59:43.246485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.621 [2024-11-27 16:59:43.424606] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:46.621 [2024-11-27 16:59:43.424813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.186 16:59:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.186 16:59:44 -- common/autotest_common.sh@862 -- # return 0 00:06:47.186 16:59:44 -- event/cpu_locks.sh@105 -- # locks_exist 1625541 00:06:47.186 16:59:44 -- event/cpu_locks.sh@22 -- # lslocks -p 1625541 00:06:47.186 16:59:44 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:47.753 lslocks: write error 00:06:47.753 16:59:44 -- event/cpu_locks.sh@107 -- # killprocess 1625407 00:06:47.753 16:59:44 -- common/autotest_common.sh@936 -- # '[' -z 1625407 ']' 00:06:47.753 16:59:44 -- common/autotest_common.sh@940 -- # kill -0 1625407 00:06:47.753 16:59:44 -- common/autotest_common.sh@941 -- # uname 00:06:47.753 16:59:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:47.753 16:59:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625407 00:06:47.753 16:59:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:47.753 16:59:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:47.753 16:59:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625407' 00:06:47.753 killing process with pid 1625407 00:06:47.753 16:59:44 -- common/autotest_common.sh@955 -- # kill 1625407 00:06:47.753 16:59:44 -- common/autotest_common.sh@960 -- # wait 1625407 00:06:48.701 16:59:45 -- event/cpu_locks.sh@108 -- # killprocess 1625541 00:06:48.701 16:59:45 -- common/autotest_common.sh@936 -- # '[' -z 1625541 ']' 00:06:48.701 16:59:45 -- common/autotest_common.sh@940 -- # kill -0 1625541 00:06:48.701 16:59:45 -- common/autotest_common.sh@941 -- # uname 00:06:48.701 16:59:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:48.701 16:59:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625541 00:06:48.701 16:59:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:48.701 16:59:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:48.701 16:59:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625541' 00:06:48.701 killing process with pid 1625541 00:06:48.701 16:59:45 -- common/autotest_common.sh@955 -- # kill 1625541 00:06:48.701 16:59:45 -- common/autotest_common.sh@960 -- # wait 1625541 00:06:48.959 00:06:48.959 real 0m3.696s 00:06:48.959 user 0m4.055s 00:06:48.959 sys 0m1.070s 00:06:48.959 16:59:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.959 16:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:48.960 ************************************ 00:06:48.960 END TEST locking_app_on_unlocked_coremask 00:06:48.960 ************************************ 00:06:48.960 16:59:45 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:48.960 16:59:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:48.960 16:59:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.960 16:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:48.960 ************************************ 00:06:48.960 START TEST locking_app_on_locked_coremask 00:06:48.960 ************************************ 00:06:48.960 16:59:45 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:48.960 16:59:45 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1625946 00:06:48.960 16:59:45 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:48.960 16:59:45 -- event/cpu_locks.sh@116 -- # waitforlisten 1625946 /var/tmp/spdk.sock 00:06:48.960 16:59:45 -- common/autotest_common.sh@829 -- # '[' -z 1625946 ']' 00:06:48.960 16:59:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:48.960 16:59:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.960 16:59:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:48.960 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:48.960 16:59:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.960 16:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:48.960 [2024-11-27 16:59:45.881583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.960 [2024-11-27 16:59:45.881662] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625946 ] 00:06:49.218 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.218 [2024-11-27 16:59:45.947361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.218 [2024-11-27 16:59:46.035357] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:49.218 [2024-11-27 16:59:46.035544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.153 16:59:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.153 16:59:46 -- common/autotest_common.sh@862 -- # return 0 00:06:50.153 16:59:46 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1625995 00:06:50.153 16:59:46 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1625995 /var/tmp/spdk2.sock 00:06:50.153 16:59:46 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.153 16:59:46 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:50.153 16:59:46 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1625995 /var/tmp/spdk2.sock 00:06:50.153 16:59:46 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:50.153 16:59:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.153 16:59:46 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:50.153 16:59:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.153 16:59:46 -- common/autotest_common.sh@653 -- # waitforlisten 1625995 /var/tmp/spdk2.sock 00:06:50.153 16:59:46 -- common/autotest_common.sh@829 -- # '[' -z 1625995 ']' 00:06:50.153 16:59:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:50.153 16:59:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.153 16:59:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:50.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:50.153 16:59:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.153 16:59:46 -- common/autotest_common.sh@10 -- # set +x 00:06:50.153 [2024-11-27 16:59:46.871257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:50.153 [2024-11-27 16:59:46.871337] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625995 ] 00:06:50.153 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.153 [2024-11-27 16:59:46.966193] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1625946 has claimed it. 00:06:50.153 [2024-11-27 16:59:46.966253] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:50.729 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1625995) - No such process 00:06:50.729 ERROR: process (pid: 1625995) is no longer running 00:06:50.729 16:59:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.729 16:59:47 -- common/autotest_common.sh@862 -- # return 1 00:06:50.729 16:59:47 -- common/autotest_common.sh@653 -- # es=1 00:06:50.729 16:59:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.729 16:59:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.729 16:59:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.729 16:59:47 -- event/cpu_locks.sh@122 -- # locks_exist 1625946 00:06:50.729 16:59:47 -- event/cpu_locks.sh@22 -- # lslocks -p 1625946 00:06:50.729 16:59:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:51.296 lslocks: write error 00:06:51.296 16:59:47 -- event/cpu_locks.sh@124 -- # killprocess 1625946 00:06:51.296 16:59:47 -- common/autotest_common.sh@936 -- # '[' -z 1625946 ']' 00:06:51.296 16:59:47 -- common/autotest_common.sh@940 -- # kill -0 1625946 00:06:51.296 16:59:47 -- common/autotest_common.sh@941 -- # uname 00:06:51.296 16:59:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:51.296 16:59:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625946 00:06:51.296 16:59:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:51.296 16:59:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:51.296 16:59:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625946' 00:06:51.296 killing process with pid 1625946 00:06:51.296 16:59:48 -- common/autotest_common.sh@955 -- # kill 1625946 00:06:51.296 16:59:48 -- common/autotest_common.sh@960 -- # wait 1625946 00:06:51.554 00:06:51.554 real 0m2.599s 00:06:51.554 user 0m2.981s 00:06:51.554 sys 0m0.679s 00:06:51.554 16:59:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.554 16:59:48 -- common/autotest_common.sh@10 -- # set +x 00:06:51.554 ************************************ 00:06:51.554 END TEST locking_app_on_locked_coremask 00:06:51.554 ************************************ 00:06:51.554 16:59:48 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:51.554 16:59:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:51.554 16:59:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.554 16:59:48 -- common/autotest_common.sh@10 -- # set +x 00:06:51.554 ************************************ 00:06:51.554 START TEST locking_overlapped_coremask 00:06:51.554 ************************************ 00:06:51.554 16:59:48 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:51.554 16:59:48 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1626294 00:06:51.554 16:59:48 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:51.554 16:59:48 -- event/cpu_locks.sh@133 -- # waitforlisten 1626294 /var/tmp/spdk.sock 00:06:51.554 16:59:48 -- common/autotest_common.sh@829 -- # '[' -z 1626294 ']' 00:06:51.554 16:59:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.554 16:59:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.554 16:59:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.554 16:59:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.554 16:59:48 -- common/autotest_common.sh@10 -- # set +x 00:06:51.813 [2024-11-27 16:59:48.506449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.813 [2024-11-27 16:59:48.506569] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1626294 ] 00:06:51.813 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.813 [2024-11-27 16:59:48.569092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:51.813 [2024-11-27 16:59:48.656498] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.813 [2024-11-27 16:59:48.656760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.813 [2024-11-27 16:59:48.656814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:51.813 [2024-11-27 16:59:48.656818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.746 16:59:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.746 16:59:49 -- common/autotest_common.sh@862 -- # return 0 00:06:52.746 16:59:49 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1626436 00:06:52.746 16:59:49 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:52.746 16:59:49 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1626436 /var/tmp/spdk2.sock 00:06:52.746 16:59:49 -- common/autotest_common.sh@650 -- # local es=0 00:06:52.746 16:59:49 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1626436 /var/tmp/spdk2.sock 00:06:52.746 16:59:49 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:52.746 16:59:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:52.746 16:59:49 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:52.746 16:59:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:52.746 16:59:49 -- common/autotest_common.sh@653 -- # waitforlisten 1626436 /var/tmp/spdk2.sock 00:06:52.746 16:59:49 -- common/autotest_common.sh@829 -- # '[' -z 1626436 ']' 00:06:52.746 16:59:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:52.746 16:59:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:52.746 16:59:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:52.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:52.747 16:59:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:52.747 16:59:49 -- common/autotest_common.sh@10 -- # set +x 00:06:52.747 [2024-11-27 16:59:49.535426] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:52.747 [2024-11-27 16:59:49.535546] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1626436 ] 00:06:52.747 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.747 [2024-11-27 16:59:49.621193] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1626294 has claimed it. 00:06:52.747 [2024-11-27 16:59:49.621256] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:53.325 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1626436) - No such process 00:06:53.325 ERROR: process (pid: 1626436) is no longer running 00:06:53.325 16:59:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:53.325 16:59:50 -- common/autotest_common.sh@862 -- # return 1 00:06:53.325 16:59:50 -- common/autotest_common.sh@653 -- # es=1 00:06:53.325 16:59:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:53.325 16:59:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:53.325 16:59:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:53.325 16:59:50 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:53.325 16:59:50 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:53.325 16:59:50 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:53.325 16:59:50 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:53.325 16:59:50 -- event/cpu_locks.sh@141 -- # killprocess 1626294 00:06:53.325 16:59:50 -- common/autotest_common.sh@936 -- # '[' -z 1626294 ']' 00:06:53.325 16:59:50 -- common/autotest_common.sh@940 -- # kill -0 1626294 00:06:53.325 16:59:50 -- common/autotest_common.sh@941 -- # uname 00:06:53.325 16:59:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.325 16:59:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1626294 00:06:53.325 16:59:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:53.325 16:59:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:53.325 16:59:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1626294' 00:06:53.325 killing process with pid 1626294 00:06:53.325 16:59:50 -- common/autotest_common.sh@955 -- # kill 1626294 00:06:53.325 16:59:50 -- common/autotest_common.sh@960 -- # wait 1626294 00:06:53.891 00:06:53.891 real 0m2.201s 00:06:53.891 user 0m6.351s 00:06:53.891 sys 0m0.486s 00:06:53.891 16:59:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.891 16:59:50 -- common/autotest_common.sh@10 -- # set +x 00:06:53.891 ************************************ 00:06:53.891 END TEST locking_overlapped_coremask 00:06:53.891 ************************************ 00:06:53.891 16:59:50 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:53.891 16:59:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.891 16:59:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.891 16:59:50 -- common/autotest_common.sh@10 -- # set +x 00:06:53.891 ************************************ 00:06:53.891 START TEST locking_overlapped_coremask_via_rpc 00:06:53.891 ************************************ 00:06:53.891 16:59:50 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:53.891 16:59:50 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1626602 00:06:53.891 16:59:50 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:53.891 16:59:50 -- event/cpu_locks.sh@149 -- # waitforlisten 1626602 /var/tmp/spdk.sock 00:06:53.891 16:59:50 -- common/autotest_common.sh@829 -- # '[' -z 1626602 ']' 00:06:53.891 16:59:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.891 16:59:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:53.891 16:59:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.891 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.891 16:59:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:53.891 16:59:50 -- common/autotest_common.sh@10 -- # set +x 00:06:53.891 [2024-11-27 16:59:50.735441] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.891 [2024-11-27 16:59:50.735569] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1626602 ] 00:06:53.891 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.891 [2024-11-27 16:59:50.797066] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:53.891 [2024-11-27 16:59:50.797115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:54.150 [2024-11-27 16:59:50.883937] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:54.150 [2024-11-27 16:59:50.884182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:54.150 [2024-11-27 16:59:50.884250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:54.150 [2024-11-27 16:59:50.884253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.085 16:59:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.085 16:59:51 -- common/autotest_common.sh@862 -- # return 0 00:06:55.085 16:59:51 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1626744 00:06:55.085 16:59:51 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:55.085 16:59:51 -- event/cpu_locks.sh@153 -- # waitforlisten 1626744 /var/tmp/spdk2.sock 00:06:55.085 16:59:51 -- common/autotest_common.sh@829 -- # '[' -z 1626744 ']' 00:06:55.085 16:59:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:55.085 16:59:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:55.085 16:59:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:55.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:55.085 16:59:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:55.085 16:59:51 -- common/autotest_common.sh@10 -- # set +x 00:06:55.085 [2024-11-27 16:59:51.739568] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.085 [2024-11-27 16:59:51.739662] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1626744 ] 00:06:55.085 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.085 [2024-11-27 16:59:51.826172] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:55.085 [2024-11-27 16:59:51.826214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:55.085 [2024-11-27 16:59:51.995288] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:55.085 [2024-11-27 16:59:51.995533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:55.085 [2024-11-27 16:59:51.998582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:55.085 [2024-11-27 16:59:51.998583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:56.019 16:59:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:56.019 16:59:52 -- common/autotest_common.sh@862 -- # return 0 00:06:56.019 16:59:52 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:56.019 16:59:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:56.019 16:59:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.019 16:59:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:56.019 16:59:52 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:56.019 16:59:52 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.019 16:59:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:56.019 16:59:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:56.019 16:59:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.019 16:59:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:56.019 16:59:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.019 16:59:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:56.019 16:59:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:56.019 16:59:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.019 [2024-11-27 16:59:52.713635] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1626602 has claimed it. 00:06:56.019 request: 00:06:56.019 { 00:06:56.019 "method": "framework_enable_cpumask_locks", 00:06:56.019 "req_id": 1 00:06:56.019 } 00:06:56.019 Got JSON-RPC error response 00:06:56.019 response: 00:06:56.019 { 00:06:56.019 "code": -32603, 00:06:56.019 "message": "Failed to claim CPU core: 2" 00:06:56.019 } 00:06:56.019 16:59:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:56.019 16:59:52 -- common/autotest_common.sh@653 -- # es=1 00:06:56.019 16:59:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.019 16:59:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:56.019 16:59:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.019 16:59:52 -- event/cpu_locks.sh@158 -- # waitforlisten 1626602 /var/tmp/spdk.sock 00:06:56.019 16:59:52 -- common/autotest_common.sh@829 -- # '[' -z 1626602 ']' 00:06:56.019 16:59:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.019 16:59:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:56.019 16:59:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.019 16:59:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:56.019 16:59:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.019 16:59:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:56.019 16:59:52 -- common/autotest_common.sh@862 -- # return 0 00:06:56.019 16:59:52 -- event/cpu_locks.sh@159 -- # waitforlisten 1626744 /var/tmp/spdk2.sock 00:06:56.019 16:59:52 -- common/autotest_common.sh@829 -- # '[' -z 1626744 ']' 00:06:56.019 16:59:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:56.019 16:59:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:56.277 16:59:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:56.277 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:56.277 16:59:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:56.277 16:59:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.277 16:59:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:56.277 16:59:53 -- common/autotest_common.sh@862 -- # return 0 00:06:56.277 16:59:53 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:56.277 16:59:53 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:56.277 16:59:53 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:56.277 16:59:53 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:56.277 00:06:56.277 real 0m2.525s 00:06:56.277 user 0m1.266s 00:06:56.277 sys 0m0.192s 00:06:56.277 16:59:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.277 16:59:53 -- common/autotest_common.sh@10 -- # set +x 00:06:56.277 ************************************ 00:06:56.277 END TEST locking_overlapped_coremask_via_rpc 00:06:56.277 ************************************ 00:06:56.535 16:59:53 -- event/cpu_locks.sh@174 -- # cleanup 00:06:56.535 16:59:53 -- event/cpu_locks.sh@15 -- # [[ -z 1626602 ]] 00:06:56.535 16:59:53 -- event/cpu_locks.sh@15 -- # killprocess 1626602 00:06:56.535 16:59:53 -- common/autotest_common.sh@936 -- # '[' -z 1626602 ']' 00:06:56.535 16:59:53 -- common/autotest_common.sh@940 -- # kill -0 1626602 00:06:56.535 16:59:53 -- common/autotest_common.sh@941 -- # uname 00:06:56.535 16:59:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.535 16:59:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1626602 00:06:56.535 16:59:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.535 16:59:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.535 16:59:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1626602' 00:06:56.535 killing process with pid 1626602 00:06:56.535 16:59:53 -- common/autotest_common.sh@955 -- # kill 1626602 00:06:56.535 16:59:53 -- common/autotest_common.sh@960 -- # wait 1626602 00:06:56.794 16:59:53 -- event/cpu_locks.sh@16 -- # [[ -z 1626744 ]] 00:06:56.794 16:59:53 -- event/cpu_locks.sh@16 -- # killprocess 1626744 00:06:56.794 16:59:53 -- common/autotest_common.sh@936 -- # '[' -z 1626744 ']' 00:06:56.794 16:59:53 -- common/autotest_common.sh@940 -- # kill -0 1626744 00:06:56.794 16:59:53 -- common/autotest_common.sh@941 -- # uname 00:06:56.794 16:59:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.794 16:59:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1626744 00:06:56.794 16:59:53 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:56.794 16:59:53 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:56.794 16:59:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1626744' 00:06:56.794 killing process with pid 1626744 00:06:56.794 16:59:53 -- common/autotest_common.sh@955 -- # kill 1626744 00:06:56.794 16:59:53 -- common/autotest_common.sh@960 -- # wait 1626744 00:06:57.361 16:59:54 -- event/cpu_locks.sh@18 -- # rm -f 00:06:57.361 16:59:54 -- event/cpu_locks.sh@1 -- # cleanup 00:06:57.361 16:59:54 -- event/cpu_locks.sh@15 -- # [[ -z 1626602 ]] 00:06:57.361 16:59:54 -- event/cpu_locks.sh@15 -- # killprocess 1626602 00:06:57.361 16:59:54 -- common/autotest_common.sh@936 -- # '[' -z 1626602 ']' 00:06:57.362 16:59:54 -- common/autotest_common.sh@940 -- # kill -0 1626602 00:06:57.362 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1626602) - No such process 00:06:57.362 16:59:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1626602 is not found' 00:06:57.362 Process with pid 1626602 is not found 00:06:57.362 16:59:54 -- event/cpu_locks.sh@16 -- # [[ -z 1626744 ]] 00:06:57.362 16:59:54 -- event/cpu_locks.sh@16 -- # killprocess 1626744 00:06:57.362 16:59:54 -- common/autotest_common.sh@936 -- # '[' -z 1626744 ']' 00:06:57.362 16:59:54 -- common/autotest_common.sh@940 -- # kill -0 1626744 00:06:57.362 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1626744) - No such process 00:06:57.362 16:59:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1626744 is not found' 00:06:57.362 Process with pid 1626744 is not found 00:06:57.362 16:59:54 -- event/cpu_locks.sh@18 -- # rm -f 00:06:57.362 00:06:57.362 real 0m19.390s 00:06:57.362 user 0m35.166s 00:06:57.362 sys 0m5.466s 00:06:57.362 16:59:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.362 16:59:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.362 ************************************ 00:06:57.362 END TEST cpu_locks 00:06:57.362 ************************************ 00:06:57.362 00:06:57.362 real 0m46.609s 00:06:57.362 user 1m30.173s 00:06:57.362 sys 0m9.471s 00:06:57.362 16:59:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.362 16:59:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.362 ************************************ 00:06:57.362 END TEST event 00:06:57.362 ************************************ 00:06:57.362 16:59:54 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:57.362 16:59:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.362 16:59:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.362 ************************************ 00:06:57.362 START TEST thread 00:06:57.362 ************************************ 00:06:57.362 16:59:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:57.362 * Looking for test storage... 00:06:57.362 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:57.362 16:59:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:57.362 16:59:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:57.362 16:59:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:57.362 16:59:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:57.362 16:59:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:57.362 16:59:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:57.362 16:59:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:57.362 16:59:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:57.362 16:59:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:57.362 16:59:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:57.362 16:59:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:57.362 16:59:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:57.362 16:59:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:57.362 16:59:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:57.362 16:59:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:57.362 16:59:54 -- scripts/common.sh@344 -- # : 1 00:06:57.362 16:59:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:57.362 16:59:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:57.362 16:59:54 -- scripts/common.sh@364 -- # decimal 1 00:06:57.362 16:59:54 -- scripts/common.sh@352 -- # local d=1 00:06:57.362 16:59:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:57.362 16:59:54 -- scripts/common.sh@354 -- # echo 1 00:06:57.362 16:59:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:57.362 16:59:54 -- scripts/common.sh@365 -- # decimal 2 00:06:57.362 16:59:54 -- scripts/common.sh@352 -- # local d=2 00:06:57.362 16:59:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:57.362 16:59:54 -- scripts/common.sh@354 -- # echo 2 00:06:57.362 16:59:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:57.362 16:59:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:57.362 16:59:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:57.362 16:59:54 -- scripts/common.sh@367 -- # return 0 00:06:57.362 16:59:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:57.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.362 --rc genhtml_branch_coverage=1 00:06:57.362 --rc genhtml_function_coverage=1 00:06:57.362 --rc genhtml_legend=1 00:06:57.362 --rc geninfo_all_blocks=1 00:06:57.362 --rc geninfo_unexecuted_blocks=1 00:06:57.362 00:06:57.362 ' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:57.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.362 --rc genhtml_branch_coverage=1 00:06:57.362 --rc genhtml_function_coverage=1 00:06:57.362 --rc genhtml_legend=1 00:06:57.362 --rc geninfo_all_blocks=1 00:06:57.362 --rc geninfo_unexecuted_blocks=1 00:06:57.362 00:06:57.362 ' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:57.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.362 --rc genhtml_branch_coverage=1 00:06:57.362 --rc genhtml_function_coverage=1 00:06:57.362 --rc genhtml_legend=1 00:06:57.362 --rc geninfo_all_blocks=1 00:06:57.362 --rc geninfo_unexecuted_blocks=1 00:06:57.362 00:06:57.362 ' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:57.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.362 --rc genhtml_branch_coverage=1 00:06:57.362 --rc genhtml_function_coverage=1 00:06:57.362 --rc genhtml_legend=1 00:06:57.362 --rc geninfo_all_blocks=1 00:06:57.362 --rc geninfo_unexecuted_blocks=1 00:06:57.362 00:06:57.362 ' 00:06:57.362 16:59:54 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:57.362 16:59:54 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:57.362 16:59:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.362 16:59:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.621 ************************************ 00:06:57.621 START TEST thread_poller_perf 00:06:57.621 ************************************ 00:06:57.621 16:59:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:57.621 [2024-11-27 16:59:54.327209] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:57.621 [2024-11-27 16:59:54.327298] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627124 ] 00:06:57.621 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.621 [2024-11-27 16:59:54.391737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.621 [2024-11-27 16:59:54.483913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.621 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:58.996 [2024-11-27T15:59:55.947Z] ====================================== 00:06:58.996 [2024-11-27T15:59:55.947Z] busy:2717556057 (cyc) 00:06:58.996 [2024-11-27T15:59:55.947Z] total_run_count: 284000 00:06:58.996 [2024-11-27T15:59:55.947Z] tsc_hz: 2700000000 (cyc) 00:06:58.996 [2024-11-27T15:59:55.947Z] ====================================== 00:06:58.996 [2024-11-27T15:59:55.947Z] poller_cost: 9568 (cyc), 3543 (nsec) 00:06:58.996 00:06:58.996 real 0m1.263s 00:06:58.996 user 0m1.173s 00:06:58.996 sys 0m0.083s 00:06:58.996 16:59:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.996 16:59:55 -- common/autotest_common.sh@10 -- # set +x 00:06:58.996 ************************************ 00:06:58.996 END TEST thread_poller_perf 00:06:58.996 ************************************ 00:06:58.996 16:59:55 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:58.996 16:59:55 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:58.996 16:59:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.996 16:59:55 -- common/autotest_common.sh@10 -- # set +x 00:06:58.996 ************************************ 00:06:58.996 START TEST thread_poller_perf 00:06:58.996 ************************************ 00:06:58.996 16:59:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:58.996 [2024-11-27 16:59:55.621423] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:58.996 [2024-11-27 16:59:55.621504] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627278 ] 00:06:58.996 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.996 [2024-11-27 16:59:55.683949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.996 [2024-11-27 16:59:55.774175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.996 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:59.931 [2024-11-27T15:59:56.882Z] ====================================== 00:06:59.931 [2024-11-27T15:59:56.882Z] busy:2703664848 (cyc) 00:06:59.931 [2024-11-27T15:59:56.882Z] total_run_count: 3786000 00:06:59.931 [2024-11-27T15:59:56.882Z] tsc_hz: 2700000000 (cyc) 00:06:59.931 [2024-11-27T15:59:56.882Z] ====================================== 00:06:59.931 [2024-11-27T15:59:56.882Z] poller_cost: 714 (cyc), 264 (nsec) 00:06:59.931 00:06:59.931 real 0m1.251s 00:06:59.931 user 0m1.156s 00:06:59.931 sys 0m0.088s 00:06:59.931 16:59:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.931 16:59:56 -- common/autotest_common.sh@10 -- # set +x 00:06:59.931 ************************************ 00:06:59.931 END TEST thread_poller_perf 00:06:59.931 ************************************ 00:07:00.190 16:59:56 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:00.190 00:07:00.190 real 0m2.714s 00:07:00.190 user 0m2.441s 00:07:00.190 sys 0m0.278s 00:07:00.190 16:59:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.190 16:59:56 -- common/autotest_common.sh@10 -- # set +x 00:07:00.190 ************************************ 00:07:00.190 END TEST thread 00:07:00.190 ************************************ 00:07:00.190 16:59:56 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:00.190 16:59:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:00.190 16:59:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.190 16:59:56 -- common/autotest_common.sh@10 -- # set +x 00:07:00.190 ************************************ 00:07:00.190 START TEST accel 00:07:00.190 ************************************ 00:07:00.190 16:59:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:00.190 * Looking for test storage... 00:07:00.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:00.190 16:59:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:00.190 16:59:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:00.190 16:59:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:00.190 16:59:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:00.190 16:59:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:00.190 16:59:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:00.190 16:59:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:00.190 16:59:57 -- scripts/common.sh@335 -- # IFS=.-: 00:07:00.190 16:59:57 -- scripts/common.sh@335 -- # read -ra ver1 00:07:00.190 16:59:57 -- scripts/common.sh@336 -- # IFS=.-: 00:07:00.190 16:59:57 -- scripts/common.sh@336 -- # read -ra ver2 00:07:00.190 16:59:57 -- scripts/common.sh@337 -- # local 'op=<' 00:07:00.190 16:59:57 -- scripts/common.sh@339 -- # ver1_l=2 00:07:00.190 16:59:57 -- scripts/common.sh@340 -- # ver2_l=1 00:07:00.190 16:59:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:00.190 16:59:57 -- scripts/common.sh@343 -- # case "$op" in 00:07:00.190 16:59:57 -- scripts/common.sh@344 -- # : 1 00:07:00.190 16:59:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:00.190 16:59:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:00.190 16:59:57 -- scripts/common.sh@364 -- # decimal 1 00:07:00.190 16:59:57 -- scripts/common.sh@352 -- # local d=1 00:07:00.190 16:59:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:00.190 16:59:57 -- scripts/common.sh@354 -- # echo 1 00:07:00.190 16:59:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:00.190 16:59:57 -- scripts/common.sh@365 -- # decimal 2 00:07:00.190 16:59:57 -- scripts/common.sh@352 -- # local d=2 00:07:00.190 16:59:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:00.190 16:59:57 -- scripts/common.sh@354 -- # echo 2 00:07:00.190 16:59:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:00.190 16:59:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:00.190 16:59:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:00.190 16:59:57 -- scripts/common.sh@367 -- # return 0 00:07:00.190 16:59:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:00.190 16:59:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:00.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:00.190 --rc genhtml_branch_coverage=1 00:07:00.190 --rc genhtml_function_coverage=1 00:07:00.190 --rc genhtml_legend=1 00:07:00.190 --rc geninfo_all_blocks=1 00:07:00.190 --rc geninfo_unexecuted_blocks=1 00:07:00.190 00:07:00.190 ' 00:07:00.190 16:59:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:00.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:00.191 --rc genhtml_branch_coverage=1 00:07:00.191 --rc genhtml_function_coverage=1 00:07:00.191 --rc genhtml_legend=1 00:07:00.191 --rc geninfo_all_blocks=1 00:07:00.191 --rc geninfo_unexecuted_blocks=1 00:07:00.191 00:07:00.191 ' 00:07:00.191 16:59:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:00.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:00.191 --rc genhtml_branch_coverage=1 00:07:00.191 --rc genhtml_function_coverage=1 00:07:00.191 --rc genhtml_legend=1 00:07:00.191 --rc geninfo_all_blocks=1 00:07:00.191 --rc geninfo_unexecuted_blocks=1 00:07:00.191 00:07:00.191 ' 00:07:00.191 16:59:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:00.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:00.191 --rc genhtml_branch_coverage=1 00:07:00.191 --rc genhtml_function_coverage=1 00:07:00.191 --rc genhtml_legend=1 00:07:00.191 --rc geninfo_all_blocks=1 00:07:00.191 --rc geninfo_unexecuted_blocks=1 00:07:00.191 00:07:00.191 ' 00:07:00.191 16:59:57 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:07:00.191 16:59:57 -- accel/accel.sh@74 -- # get_expected_opcs 00:07:00.191 16:59:57 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:00.191 16:59:57 -- accel/accel.sh@59 -- # spdk_tgt_pid=1627555 00:07:00.191 16:59:57 -- accel/accel.sh@60 -- # waitforlisten 1627555 00:07:00.191 16:59:57 -- common/autotest_common.sh@829 -- # '[' -z 1627555 ']' 00:07:00.191 16:59:57 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:00.191 16:59:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.191 16:59:57 -- accel/accel.sh@58 -- # build_accel_config 00:07:00.191 16:59:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.191 16:59:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.191 16:59:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.191 16:59:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.191 16:59:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.191 16:59:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.191 16:59:57 -- common/autotest_common.sh@10 -- # set +x 00:07:00.191 16:59:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.191 16:59:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.191 16:59:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.191 16:59:57 -- accel/accel.sh@42 -- # jq -r . 00:07:00.191 [2024-11-27 16:59:57.102295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.191 [2024-11-27 16:59:57.102368] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627555 ] 00:07:00.191 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.450 [2024-11-27 16:59:57.164157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.450 [2024-11-27 16:59:57.255278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:00.450 [2024-11-27 16:59:57.255426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.384 16:59:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:01.384 16:59:58 -- common/autotest_common.sh@862 -- # return 0 00:07:01.384 16:59:58 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:01.384 16:59:58 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:07:01.384 16:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.384 16:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:01.384 16:59:58 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:01.385 16:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # IFS== 00:07:01.385 16:59:58 -- accel/accel.sh@64 -- # read -r opc module 00:07:01.385 16:59:58 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:01.385 16:59:58 -- accel/accel.sh@67 -- # killprocess 1627555 00:07:01.385 16:59:58 -- common/autotest_common.sh@936 -- # '[' -z 1627555 ']' 00:07:01.385 16:59:58 -- common/autotest_common.sh@940 -- # kill -0 1627555 00:07:01.385 16:59:58 -- common/autotest_common.sh@941 -- # uname 00:07:01.385 16:59:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:01.385 16:59:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1627555 00:07:01.385 16:59:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:01.385 16:59:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:01.385 16:59:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1627555' 00:07:01.385 killing process with pid 1627555 00:07:01.385 16:59:58 -- common/autotest_common.sh@955 -- # kill 1627555 00:07:01.385 16:59:58 -- common/autotest_common.sh@960 -- # wait 1627555 00:07:01.645 16:59:58 -- accel/accel.sh@68 -- # trap - ERR 00:07:01.645 16:59:58 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:07:01.645 16:59:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:01.645 16:59:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.645 16:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:01.645 16:59:58 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:07:01.645 16:59:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:01.645 16:59:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.645 16:59:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.645 16:59:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.645 16:59:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.645 16:59:58 -- accel/accel.sh@42 -- # jq -r . 00:07:01.645 16:59:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.645 16:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:01.645 16:59:58 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:01.645 16:59:58 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:01.645 16:59:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.645 16:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:01.645 ************************************ 00:07:01.645 START TEST accel_missing_filename 00:07:01.645 ************************************ 00:07:01.645 16:59:58 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:07:01.645 16:59:58 -- common/autotest_common.sh@650 -- # local es=0 00:07:01.645 16:59:58 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:01.645 16:59:58 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:01.645 16:59:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:01.645 16:59:58 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:01.645 16:59:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:01.645 16:59:58 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:07:01.645 16:59:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:01.645 16:59:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.645 16:59:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.645 16:59:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.645 16:59:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.645 16:59:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.645 16:59:58 -- accel/accel.sh@42 -- # jq -r . 00:07:01.903 [2024-11-27 16:59:58.603726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:01.903 [2024-11-27 16:59:58.603811] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627785 ] 00:07:01.903 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.903 [2024-11-27 16:59:58.667124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.903 [2024-11-27 16:59:58.757447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.903 [2024-11-27 16:59:58.819480] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:02.162 [2024-11-27 16:59:58.908193] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:02.163 A filename is required. 00:07:02.163 16:59:58 -- common/autotest_common.sh@653 -- # es=234 00:07:02.163 16:59:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:02.163 16:59:58 -- common/autotest_common.sh@662 -- # es=106 00:07:02.163 16:59:58 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:02.163 16:59:58 -- common/autotest_common.sh@670 -- # es=1 00:07:02.163 16:59:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:02.163 00:07:02.163 real 0m0.407s 00:07:02.163 user 0m0.289s 00:07:02.163 sys 0m0.151s 00:07:02.163 16:59:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.163 16:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:02.163 ************************************ 00:07:02.163 END TEST accel_missing_filename 00:07:02.163 ************************************ 00:07:02.163 16:59:59 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.163 16:59:59 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:02.163 16:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.163 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.163 ************************************ 00:07:02.163 START TEST accel_compress_verify 00:07:02.163 ************************************ 00:07:02.163 16:59:59 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.163 16:59:59 -- common/autotest_common.sh@650 -- # local es=0 00:07:02.163 16:59:59 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.163 16:59:59 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:02.163 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.163 16:59:59 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:02.163 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.163 16:59:59 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.163 16:59:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.163 16:59:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.163 16:59:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.163 16:59:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.163 16:59:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.163 16:59:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.163 16:59:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.163 16:59:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.163 16:59:59 -- accel/accel.sh@42 -- # jq -r . 00:07:02.163 [2024-11-27 16:59:59.036844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.163 [2024-11-27 16:59:59.036921] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627804 ] 00:07:02.163 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.163 [2024-11-27 16:59:59.099608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.435 [2024-11-27 16:59:59.188079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.436 [2024-11-27 16:59:59.249167] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:02.436 [2024-11-27 16:59:59.326194] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:02.702 00:07:02.702 Compression does not support the verify option, aborting. 00:07:02.702 16:59:59 -- common/autotest_common.sh@653 -- # es=161 00:07:02.702 16:59:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:02.702 16:59:59 -- common/autotest_common.sh@662 -- # es=33 00:07:02.702 16:59:59 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:02.702 16:59:59 -- common/autotest_common.sh@670 -- # es=1 00:07:02.702 16:59:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:02.702 00:07:02.702 real 0m0.391s 00:07:02.702 user 0m0.279s 00:07:02.702 sys 0m0.147s 00:07:02.702 16:59:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.702 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.702 ************************************ 00:07:02.702 END TEST accel_compress_verify 00:07:02.702 ************************************ 00:07:02.702 16:59:59 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:02.702 16:59:59 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:02.702 16:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.702 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.702 ************************************ 00:07:02.702 START TEST accel_wrong_workload 00:07:02.702 ************************************ 00:07:02.702 16:59:59 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:07:02.702 16:59:59 -- common/autotest_common.sh@650 -- # local es=0 00:07:02.702 16:59:59 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:02.702 16:59:59 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.702 16:59:59 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:07:02.702 16:59:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:02.702 16:59:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.702 16:59:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.702 16:59:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.702 16:59:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.702 16:59:59 -- accel/accel.sh@42 -- # jq -r . 00:07:02.702 Unsupported workload type: foobar 00:07:02.702 [2024-11-27 16:59:59.448376] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:02.702 accel_perf options: 00:07:02.702 [-h help message] 00:07:02.702 [-q queue depth per core] 00:07:02.702 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:02.702 [-T number of threads per core 00:07:02.702 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:02.702 [-t time in seconds] 00:07:02.702 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:02.702 [ dif_verify, , dif_generate, dif_generate_copy 00:07:02.702 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:02.702 [-l for compress/decompress workloads, name of uncompressed input file 00:07:02.702 [-S for crc32c workload, use this seed value (default 0) 00:07:02.702 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:02.702 [-f for fill workload, use this BYTE value (default 255) 00:07:02.702 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:02.702 [-y verify result if this switch is on] 00:07:02.702 [-a tasks to allocate per core (default: same value as -q)] 00:07:02.702 Can be used to spread operations across a wider range of memory. 00:07:02.702 16:59:59 -- common/autotest_common.sh@653 -- # es=1 00:07:02.702 16:59:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:02.702 16:59:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:02.702 16:59:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:02.702 00:07:02.702 real 0m0.020s 00:07:02.702 user 0m0.010s 00:07:02.702 sys 0m0.010s 00:07:02.702 16:59:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.702 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.702 ************************************ 00:07:02.702 END TEST accel_wrong_workload 00:07:02.702 ************************************ 00:07:02.702 Error: writing output failed: Broken pipe 00:07:02.702 16:59:59 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:02.702 16:59:59 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:02.702 16:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.702 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.702 ************************************ 00:07:02.702 START TEST accel_negative_buffers 00:07:02.702 ************************************ 00:07:02.702 16:59:59 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:02.702 16:59:59 -- common/autotest_common.sh@650 -- # local es=0 00:07:02.702 16:59:59 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:02.702 16:59:59 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:02.702 16:59:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.702 16:59:59 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:07:02.702 16:59:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:02.702 16:59:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.702 16:59:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.702 16:59:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.702 16:59:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.702 16:59:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.702 16:59:59 -- accel/accel.sh@42 -- # jq -r . 00:07:02.702 -x option must be non-negative. 00:07:02.702 [2024-11-27 16:59:59.491784] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:02.702 accel_perf options: 00:07:02.702 [-h help message] 00:07:02.702 [-q queue depth per core] 00:07:02.702 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:02.702 [-T number of threads per core 00:07:02.702 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:02.702 [-t time in seconds] 00:07:02.702 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:02.702 [ dif_verify, , dif_generate, dif_generate_copy 00:07:02.702 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:02.702 [-l for compress/decompress workloads, name of uncompressed input file 00:07:02.702 [-S for crc32c workload, use this seed value (default 0) 00:07:02.703 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:02.703 [-f for fill workload, use this BYTE value (default 255) 00:07:02.703 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:02.703 [-y verify result if this switch is on] 00:07:02.703 [-a tasks to allocate per core (default: same value as -q)] 00:07:02.703 Can be used to spread operations across a wider range of memory. 00:07:02.703 16:59:59 -- common/autotest_common.sh@653 -- # es=1 00:07:02.703 16:59:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:02.703 16:59:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:02.703 16:59:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:02.703 00:07:02.703 real 0m0.019s 00:07:02.703 user 0m0.010s 00:07:02.703 sys 0m0.009s 00:07:02.703 16:59:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.703 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.703 ************************************ 00:07:02.703 END TEST accel_negative_buffers 00:07:02.703 ************************************ 00:07:02.703 Error: writing output failed: Broken pipe 00:07:02.703 16:59:59 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:02.703 16:59:59 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:02.703 16:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.703 16:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:02.703 ************************************ 00:07:02.703 START TEST accel_crc32c 00:07:02.703 ************************************ 00:07:02.703 16:59:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:02.703 16:59:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.703 16:59:59 -- accel/accel.sh@17 -- # local accel_module 00:07:02.703 16:59:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:02.703 16:59:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:02.703 16:59:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.703 16:59:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.703 16:59:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.703 16:59:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.703 16:59:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.703 16:59:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.703 16:59:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.703 16:59:59 -- accel/accel.sh@42 -- # jq -r . 00:07:02.703 [2024-11-27 16:59:59.532598] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.703 [2024-11-27 16:59:59.532654] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1627992 ] 00:07:02.703 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.703 [2024-11-27 16:59:59.593181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.961 [2024-11-27 16:59:59.683853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.334 17:00:00 -- accel/accel.sh@18 -- # out=' 00:07:04.334 SPDK Configuration: 00:07:04.334 Core mask: 0x1 00:07:04.334 00:07:04.334 Accel Perf Configuration: 00:07:04.334 Workload Type: crc32c 00:07:04.334 CRC-32C seed: 32 00:07:04.334 Transfer size: 4096 bytes 00:07:04.334 Vector count 1 00:07:04.334 Module: software 00:07:04.334 Queue depth: 32 00:07:04.334 Allocate depth: 32 00:07:04.334 # threads/core: 1 00:07:04.334 Run time: 1 seconds 00:07:04.334 Verify: Yes 00:07:04.334 00:07:04.334 Running for 1 seconds... 00:07:04.334 00:07:04.334 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:04.334 ------------------------------------------------------------------------------------ 00:07:04.334 0,0 406464/s 1587 MiB/s 0 0 00:07:04.334 ==================================================================================== 00:07:04.334 Total 406464/s 1587 MiB/s 0 0' 00:07:04.334 17:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:04.334 17:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:04.334 17:00:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.334 17:00:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.334 17:00:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.334 17:00:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.334 17:00:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.334 17:00:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.334 17:00:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.334 17:00:00 -- accel/accel.sh@42 -- # jq -r . 00:07:04.334 [2024-11-27 17:00:00.927313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.334 [2024-11-27 17:00:00.927393] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628194 ] 00:07:04.334 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.334 [2024-11-27 17:00:00.991295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.334 [2024-11-27 17:00:01.081001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=0x1 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=crc32c 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=32 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=software 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@23 -- # accel_module=software 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=32 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=32 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=1 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val=Yes 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.334 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:04.334 17:00:01 -- accel/accel.sh@21 -- # val= 00:07:04.334 17:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.335 17:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:04.335 17:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@21 -- # val= 00:07:05.708 17:00:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # IFS=: 00:07:05.708 17:00:02 -- accel/accel.sh@20 -- # read -r var val 00:07:05.708 17:00:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.708 17:00:02 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:05.708 17:00:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.708 00:07:05.708 real 0m2.797s 00:07:05.708 user 0m2.497s 00:07:05.708 sys 0m0.293s 00:07:05.708 17:00:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.708 17:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:05.708 ************************************ 00:07:05.708 END TEST accel_crc32c 00:07:05.708 ************************************ 00:07:05.708 17:00:02 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:05.708 17:00:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:05.708 17:00:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.708 17:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:05.708 ************************************ 00:07:05.708 START TEST accel_crc32c_C2 00:07:05.708 ************************************ 00:07:05.708 17:00:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:05.708 17:00:02 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.708 17:00:02 -- accel/accel.sh@17 -- # local accel_module 00:07:05.708 17:00:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:05.708 17:00:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:05.708 17:00:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.708 17:00:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.708 17:00:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.708 17:00:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.709 17:00:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.709 17:00:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.709 17:00:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.709 17:00:02 -- accel/accel.sh@42 -- # jq -r . 00:07:05.709 [2024-11-27 17:00:02.357172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:05.709 [2024-11-27 17:00:02.357255] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628400 ] 00:07:05.709 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.709 [2024-11-27 17:00:02.418786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.709 [2024-11-27 17:00:02.510609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.081 17:00:03 -- accel/accel.sh@18 -- # out=' 00:07:07.081 SPDK Configuration: 00:07:07.081 Core mask: 0x1 00:07:07.081 00:07:07.081 Accel Perf Configuration: 00:07:07.081 Workload Type: crc32c 00:07:07.081 CRC-32C seed: 0 00:07:07.081 Transfer size: 4096 bytes 00:07:07.081 Vector count 2 00:07:07.081 Module: software 00:07:07.081 Queue depth: 32 00:07:07.081 Allocate depth: 32 00:07:07.081 # threads/core: 1 00:07:07.081 Run time: 1 seconds 00:07:07.081 Verify: Yes 00:07:07.081 00:07:07.081 Running for 1 seconds... 00:07:07.081 00:07:07.081 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:07.081 ------------------------------------------------------------------------------------ 00:07:07.082 0,0 312416/s 2440 MiB/s 0 0 00:07:07.082 ==================================================================================== 00:07:07.082 Total 312416/s 1220 MiB/s 0 0' 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:07.082 17:00:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.082 17:00:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.082 17:00:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.082 17:00:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.082 17:00:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.082 17:00:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.082 17:00:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.082 17:00:03 -- accel/accel.sh@42 -- # jq -r . 00:07:07.082 [2024-11-27 17:00:03.766706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.082 [2024-11-27 17:00:03.766783] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628547 ] 00:07:07.082 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.082 [2024-11-27 17:00:03.830897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.082 [2024-11-27 17:00:03.920114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=0x1 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=crc32c 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=0 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=software 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=32 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=32 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=1 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val=Yes 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:07.082 17:00:03 -- accel/accel.sh@21 -- # val= 00:07:07.082 17:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:07.082 17:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@21 -- # val= 00:07:08.487 17:00:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # IFS=: 00:07:08.487 17:00:05 -- accel/accel.sh@20 -- # read -r var val 00:07:08.487 17:00:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:08.487 17:00:05 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:08.487 17:00:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:08.487 00:07:08.487 real 0m2.814s 00:07:08.487 user 0m2.522s 00:07:08.487 sys 0m0.284s 00:07:08.487 17:00:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.487 17:00:05 -- common/autotest_common.sh@10 -- # set +x 00:07:08.487 ************************************ 00:07:08.487 END TEST accel_crc32c_C2 00:07:08.487 ************************************ 00:07:08.487 17:00:05 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:08.487 17:00:05 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:08.487 17:00:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.487 17:00:05 -- common/autotest_common.sh@10 -- # set +x 00:07:08.487 ************************************ 00:07:08.487 START TEST accel_copy 00:07:08.487 ************************************ 00:07:08.487 17:00:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:08.487 17:00:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:08.487 17:00:05 -- accel/accel.sh@17 -- # local accel_module 00:07:08.487 17:00:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:08.487 17:00:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:08.487 17:00:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.487 17:00:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.487 17:00:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.487 17:00:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.487 17:00:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.487 17:00:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.487 17:00:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.487 17:00:05 -- accel/accel.sh@42 -- # jq -r . 00:07:08.487 [2024-11-27 17:00:05.197750] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.487 [2024-11-27 17:00:05.197831] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628820 ] 00:07:08.487 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.487 [2024-11-27 17:00:05.259849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.487 [2024-11-27 17:00:05.349161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.909 17:00:06 -- accel/accel.sh@18 -- # out=' 00:07:09.909 SPDK Configuration: 00:07:09.909 Core mask: 0x1 00:07:09.909 00:07:09.909 Accel Perf Configuration: 00:07:09.909 Workload Type: copy 00:07:09.909 Transfer size: 4096 bytes 00:07:09.909 Vector count 1 00:07:09.909 Module: software 00:07:09.909 Queue depth: 32 00:07:09.909 Allocate depth: 32 00:07:09.909 # threads/core: 1 00:07:09.909 Run time: 1 seconds 00:07:09.909 Verify: Yes 00:07:09.909 00:07:09.909 Running for 1 seconds... 00:07:09.909 00:07:09.909 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.909 ------------------------------------------------------------------------------------ 00:07:09.909 0,0 277184/s 1082 MiB/s 0 0 00:07:09.909 ==================================================================================== 00:07:09.909 Total 277184/s 1082 MiB/s 0 0' 00:07:09.909 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.909 17:00:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:09.909 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.909 17:00:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:09.909 17:00:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.909 17:00:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.909 17:00:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.909 17:00:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.909 17:00:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.909 17:00:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.909 17:00:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.909 17:00:06 -- accel/accel.sh@42 -- # jq -r . 00:07:09.909 [2024-11-27 17:00:06.599504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:09.909 [2024-11-27 17:00:06.599592] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628975 ] 00:07:09.909 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.909 [2024-11-27 17:00:06.661457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.910 [2024-11-27 17:00:06.751969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=0x1 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=copy 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=software 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=32 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=32 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=1 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val=Yes 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:09.910 17:00:06 -- accel/accel.sh@21 -- # val= 00:07:09.910 17:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # IFS=: 00:07:09.910 17:00:06 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@21 -- # val= 00:07:11.284 17:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # IFS=: 00:07:11.284 17:00:07 -- accel/accel.sh@20 -- # read -r var val 00:07:11.284 17:00:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:11.284 17:00:07 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:11.284 17:00:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.284 00:07:11.284 real 0m2.801s 00:07:11.284 user 0m2.506s 00:07:11.284 sys 0m0.287s 00:07:11.284 17:00:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.284 17:00:07 -- common/autotest_common.sh@10 -- # set +x 00:07:11.284 ************************************ 00:07:11.284 END TEST accel_copy 00:07:11.284 ************************************ 00:07:11.284 17:00:08 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:11.284 17:00:08 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:11.284 17:00:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.284 17:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:11.284 ************************************ 00:07:11.284 START TEST accel_fill 00:07:11.284 ************************************ 00:07:11.284 17:00:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:11.284 17:00:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.284 17:00:08 -- accel/accel.sh@17 -- # local accel_module 00:07:11.284 17:00:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:11.284 17:00:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:11.284 17:00:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.284 17:00:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.284 17:00:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.284 17:00:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.284 17:00:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.284 17:00:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.284 17:00:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.284 17:00:08 -- accel/accel.sh@42 -- # jq -r . 00:07:11.284 [2024-11-27 17:00:08.025120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.284 [2024-11-27 17:00:08.025217] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1629420 ] 00:07:11.284 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.284 [2024-11-27 17:00:08.084471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.284 [2024-11-27 17:00:08.175843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.658 17:00:09 -- accel/accel.sh@18 -- # out=' 00:07:12.658 SPDK Configuration: 00:07:12.658 Core mask: 0x1 00:07:12.658 00:07:12.658 Accel Perf Configuration: 00:07:12.658 Workload Type: fill 00:07:12.658 Fill pattern: 0x80 00:07:12.658 Transfer size: 4096 bytes 00:07:12.658 Vector count 1 00:07:12.658 Module: software 00:07:12.658 Queue depth: 64 00:07:12.658 Allocate depth: 64 00:07:12.658 # threads/core: 1 00:07:12.658 Run time: 1 seconds 00:07:12.658 Verify: Yes 00:07:12.658 00:07:12.658 Running for 1 seconds... 00:07:12.658 00:07:12.658 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.658 ------------------------------------------------------------------------------------ 00:07:12.658 0,0 407872/s 1593 MiB/s 0 0 00:07:12.658 ==================================================================================== 00:07:12.658 Total 407872/s 1593 MiB/s 0 0' 00:07:12.658 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.658 17:00:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:12.658 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.658 17:00:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:12.658 17:00:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.658 17:00:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.658 17:00:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.658 17:00:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.658 17:00:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.658 17:00:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.658 17:00:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.658 17:00:09 -- accel/accel.sh@42 -- # jq -r . 00:07:12.658 [2024-11-27 17:00:09.411643] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:12.658 [2024-11-27 17:00:09.411721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1629776 ] 00:07:12.658 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.658 [2024-11-27 17:00:09.474385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.658 [2024-11-27 17:00:09.565314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=0x1 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=fill 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=0x80 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=software 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=64 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=64 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=1 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val=Yes 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:12.916 17:00:09 -- accel/accel.sh@21 -- # val= 00:07:12.916 17:00:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # IFS=: 00:07:12.916 17:00:09 -- accel/accel.sh@20 -- # read -r var val 00:07:13.849 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.849 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.849 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.849 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.849 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.849 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.849 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.849 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.849 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.850 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.850 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.850 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.850 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.850 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.850 17:00:10 -- accel/accel.sh@21 -- # val= 00:07:13.850 17:00:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.850 17:00:10 -- accel/accel.sh@20 -- # IFS=: 00:07:13.850 17:00:10 -- accel/accel.sh@20 -- # read -r var val 00:07:13.850 17:00:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.850 17:00:10 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:13.850 17:00:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.850 00:07:13.850 real 0m2.791s 00:07:13.850 user 0m2.499s 00:07:13.850 sys 0m0.283s 00:07:13.850 17:00:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.850 17:00:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.850 ************************************ 00:07:13.850 END TEST accel_fill 00:07:13.850 ************************************ 00:07:14.108 17:00:10 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:14.108 17:00:10 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:14.108 17:00:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.108 17:00:10 -- common/autotest_common.sh@10 -- # set +x 00:07:14.108 ************************************ 00:07:14.108 START TEST accel_copy_crc32c 00:07:14.108 ************************************ 00:07:14.108 17:00:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:14.108 17:00:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.108 17:00:10 -- accel/accel.sh@17 -- # local accel_module 00:07:14.108 17:00:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:14.108 17:00:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:14.108 17:00:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.108 17:00:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.108 17:00:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.108 17:00:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.108 17:00:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.108 17:00:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.108 17:00:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.108 17:00:10 -- accel/accel.sh@42 -- # jq -r . 00:07:14.108 [2024-11-27 17:00:10.838010] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.108 [2024-11-27 17:00:10.838072] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630060 ] 00:07:14.108 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.108 [2024-11-27 17:00:10.898584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.108 [2024-11-27 17:00:10.988319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.483 17:00:12 -- accel/accel.sh@18 -- # out=' 00:07:15.483 SPDK Configuration: 00:07:15.483 Core mask: 0x1 00:07:15.483 00:07:15.483 Accel Perf Configuration: 00:07:15.483 Workload Type: copy_crc32c 00:07:15.483 CRC-32C seed: 0 00:07:15.483 Vector size: 4096 bytes 00:07:15.483 Transfer size: 4096 bytes 00:07:15.483 Vector count 1 00:07:15.483 Module: software 00:07:15.483 Queue depth: 32 00:07:15.483 Allocate depth: 32 00:07:15.483 # threads/core: 1 00:07:15.483 Run time: 1 seconds 00:07:15.483 Verify: Yes 00:07:15.483 00:07:15.483 Running for 1 seconds... 00:07:15.483 00:07:15.483 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:15.483 ------------------------------------------------------------------------------------ 00:07:15.483 0,0 219360/s 856 MiB/s 0 0 00:07:15.483 ==================================================================================== 00:07:15.483 Total 219360/s 856 MiB/s 0 0' 00:07:15.483 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.483 17:00:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:15.483 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.483 17:00:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:15.483 17:00:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.483 17:00:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.483 17:00:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.483 17:00:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.483 17:00:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.483 17:00:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.483 17:00:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.483 17:00:12 -- accel/accel.sh@42 -- # jq -r . 00:07:15.483 [2024-11-27 17:00:12.244082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:15.483 [2024-11-27 17:00:12.244162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630201 ] 00:07:15.483 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.483 [2024-11-27 17:00:12.304468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.483 [2024-11-27 17:00:12.394106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=0x1 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=0 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=software 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=32 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=32 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=1 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val=Yes 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:15.742 17:00:12 -- accel/accel.sh@21 -- # val= 00:07:15.742 17:00:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # IFS=: 00:07:15.742 17:00:12 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.676 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.676 17:00:13 -- accel/accel.sh@21 -- # val= 00:07:16.676 17:00:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.677 17:00:13 -- accel/accel.sh@20 -- # IFS=: 00:07:16.677 17:00:13 -- accel/accel.sh@20 -- # read -r var val 00:07:16.677 17:00:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.677 17:00:13 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:16.677 17:00:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.677 00:07:16.677 real 0m2.803s 00:07:16.677 user 0m2.505s 00:07:16.677 sys 0m0.291s 00:07:16.677 17:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.677 17:00:13 -- common/autotest_common.sh@10 -- # set +x 00:07:16.935 ************************************ 00:07:16.935 END TEST accel_copy_crc32c 00:07:16.935 ************************************ 00:07:16.935 17:00:13 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:16.935 17:00:13 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:16.935 17:00:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.935 17:00:13 -- common/autotest_common.sh@10 -- # set +x 00:07:16.935 ************************************ 00:07:16.935 START TEST accel_copy_crc32c_C2 00:07:16.935 ************************************ 00:07:16.935 17:00:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:16.935 17:00:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.935 17:00:13 -- accel/accel.sh@17 -- # local accel_module 00:07:16.935 17:00:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:16.935 17:00:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:16.935 17:00:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.935 17:00:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.935 17:00:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.935 17:00:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.935 17:00:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.935 17:00:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.935 17:00:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.935 17:00:13 -- accel/accel.sh@42 -- # jq -r . 00:07:16.935 [2024-11-27 17:00:13.672797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.935 [2024-11-27 17:00:13.672897] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630365 ] 00:07:16.935 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.935 [2024-11-27 17:00:13.735477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.935 [2024-11-27 17:00:13.824547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.309 17:00:15 -- accel/accel.sh@18 -- # out=' 00:07:18.309 SPDK Configuration: 00:07:18.309 Core mask: 0x1 00:07:18.309 00:07:18.309 Accel Perf Configuration: 00:07:18.309 Workload Type: copy_crc32c 00:07:18.309 CRC-32C seed: 0 00:07:18.309 Vector size: 4096 bytes 00:07:18.309 Transfer size: 8192 bytes 00:07:18.309 Vector count 2 00:07:18.309 Module: software 00:07:18.309 Queue depth: 32 00:07:18.309 Allocate depth: 32 00:07:18.309 # threads/core: 1 00:07:18.309 Run time: 1 seconds 00:07:18.309 Verify: Yes 00:07:18.309 00:07:18.309 Running for 1 seconds... 00:07:18.309 00:07:18.309 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:18.309 ------------------------------------------------------------------------------------ 00:07:18.309 0,0 154944/s 1210 MiB/s 0 0 00:07:18.309 ==================================================================================== 00:07:18.309 Total 154944/s 605 MiB/s 0 0' 00:07:18.309 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.309 17:00:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:18.309 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.309 17:00:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:18.309 17:00:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.309 17:00:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.309 17:00:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.309 17:00:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.309 17:00:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.309 17:00:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.309 17:00:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.309 17:00:15 -- accel/accel.sh@42 -- # jq -r . 00:07:18.309 [2024-11-27 17:00:15.081118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:18.309 [2024-11-27 17:00:15.081202] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630505 ] 00:07:18.309 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.309 [2024-11-27 17:00:15.143256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.309 [2024-11-27 17:00:15.233213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.567 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.567 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.567 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.567 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.567 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.567 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=0x1 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=0 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=software 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=32 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=32 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=1 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val=Yes 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:18.568 17:00:15 -- accel/accel.sh@21 -- # val= 00:07:18.568 17:00:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # IFS=: 00:07:18.568 17:00:15 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@21 -- # val= 00:07:19.942 17:00:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # IFS=: 00:07:19.942 17:00:16 -- accel/accel.sh@20 -- # read -r var val 00:07:19.942 17:00:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.942 17:00:16 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:19.942 17:00:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.942 00:07:19.942 real 0m2.810s 00:07:19.942 user 0m2.512s 00:07:19.942 sys 0m0.290s 00:07:19.942 17:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.942 17:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:19.942 ************************************ 00:07:19.942 END TEST accel_copy_crc32c_C2 00:07:19.942 ************************************ 00:07:19.942 17:00:16 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:19.942 17:00:16 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:19.942 17:00:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.942 17:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:19.942 ************************************ 00:07:19.942 START TEST accel_dualcast 00:07:19.942 ************************************ 00:07:19.942 17:00:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:19.942 17:00:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.942 17:00:16 -- accel/accel.sh@17 -- # local accel_module 00:07:19.942 17:00:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:19.942 17:00:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:19.942 17:00:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.942 17:00:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.942 17:00:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.942 17:00:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.942 17:00:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.942 17:00:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.942 17:00:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.942 17:00:16 -- accel/accel.sh@42 -- # jq -r . 00:07:19.942 [2024-11-27 17:00:16.504388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.942 [2024-11-27 17:00:16.504469] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630781 ] 00:07:19.942 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.942 [2024-11-27 17:00:16.567909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.942 [2024-11-27 17:00:16.658120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.317 17:00:17 -- accel/accel.sh@18 -- # out=' 00:07:21.317 SPDK Configuration: 00:07:21.317 Core mask: 0x1 00:07:21.317 00:07:21.317 Accel Perf Configuration: 00:07:21.317 Workload Type: dualcast 00:07:21.317 Transfer size: 4096 bytes 00:07:21.317 Vector count 1 00:07:21.317 Module: software 00:07:21.317 Queue depth: 32 00:07:21.317 Allocate depth: 32 00:07:21.317 # threads/core: 1 00:07:21.317 Run time: 1 seconds 00:07:21.317 Verify: Yes 00:07:21.317 00:07:21.317 Running for 1 seconds... 00:07:21.317 00:07:21.317 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:21.317 ------------------------------------------------------------------------------------ 00:07:21.317 0,0 299072/s 1168 MiB/s 0 0 00:07:21.317 ==================================================================================== 00:07:21.317 Total 299072/s 1168 MiB/s 0 0' 00:07:21.317 17:00:17 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:21.317 17:00:17 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:21.317 17:00:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.317 17:00:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.317 17:00:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.317 17:00:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.317 17:00:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.317 17:00:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.317 17:00:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.317 17:00:17 -- accel/accel.sh@42 -- # jq -r . 00:07:21.317 [2024-11-27 17:00:17.914108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.317 [2024-11-27 17:00:17.914189] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630928 ] 00:07:21.317 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.317 [2024-11-27 17:00:17.973946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.317 [2024-11-27 17:00:18.063293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=0x1 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=dualcast 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=software 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=32 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=32 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val=1 00:07:21.317 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.317 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.317 17:00:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:21.318 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.318 17:00:18 -- accel/accel.sh@21 -- # val=Yes 00:07:21.318 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.318 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.318 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:21.318 17:00:18 -- accel/accel.sh@21 -- # val= 00:07:21.318 17:00:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # IFS=: 00:07:21.318 17:00:18 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@21 -- # val= 00:07:22.698 17:00:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # IFS=: 00:07:22.698 17:00:19 -- accel/accel.sh@20 -- # read -r var val 00:07:22.698 17:00:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.698 17:00:19 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:22.698 17:00:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.698 00:07:22.698 real 0m2.800s 00:07:22.698 user 0m2.512s 00:07:22.698 sys 0m0.281s 00:07:22.698 17:00:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.698 17:00:19 -- common/autotest_common.sh@10 -- # set +x 00:07:22.698 ************************************ 00:07:22.698 END TEST accel_dualcast 00:07:22.698 ************************************ 00:07:22.698 17:00:19 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:22.698 17:00:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:22.698 17:00:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.698 17:00:19 -- common/autotest_common.sh@10 -- # set +x 00:07:22.698 ************************************ 00:07:22.698 START TEST accel_compare 00:07:22.698 ************************************ 00:07:22.698 17:00:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:22.698 17:00:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.698 17:00:19 -- accel/accel.sh@17 -- # local accel_module 00:07:22.698 17:00:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:22.698 17:00:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:22.698 17:00:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.698 17:00:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.698 17:00:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.698 17:00:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.698 17:00:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.698 17:00:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.698 17:00:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.698 17:00:19 -- accel/accel.sh@42 -- # jq -r . 00:07:22.698 [2024-11-27 17:00:19.331235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.698 [2024-11-27 17:00:19.331317] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631086 ] 00:07:22.698 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.698 [2024-11-27 17:00:19.392095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.698 [2024-11-27 17:00:19.482603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.067 17:00:20 -- accel/accel.sh@18 -- # out=' 00:07:24.067 SPDK Configuration: 00:07:24.067 Core mask: 0x1 00:07:24.067 00:07:24.067 Accel Perf Configuration: 00:07:24.067 Workload Type: compare 00:07:24.067 Transfer size: 4096 bytes 00:07:24.067 Vector count 1 00:07:24.067 Module: software 00:07:24.067 Queue depth: 32 00:07:24.067 Allocate depth: 32 00:07:24.067 # threads/core: 1 00:07:24.067 Run time: 1 seconds 00:07:24.067 Verify: Yes 00:07:24.067 00:07:24.067 Running for 1 seconds... 00:07:24.067 00:07:24.067 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:24.067 ------------------------------------------------------------------------------------ 00:07:24.067 0,0 397664/s 1553 MiB/s 0 0 00:07:24.067 ==================================================================================== 00:07:24.067 Total 397664/s 1553 MiB/s 0 0' 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:24.067 17:00:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.067 17:00:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.067 17:00:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.067 17:00:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.067 17:00:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.067 17:00:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.067 17:00:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.067 17:00:20 -- accel/accel.sh@42 -- # jq -r . 00:07:24.067 [2024-11-27 17:00:20.729821] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:24.067 [2024-11-27 17:00:20.729900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631232 ] 00:07:24.067 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.067 [2024-11-27 17:00:20.791962] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.067 [2024-11-27 17:00:20.884138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val=0x1 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val=compare 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.067 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.067 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.067 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val=software 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val=32 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val=32 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val=1 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val=Yes 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:24.068 17:00:20 -- accel/accel.sh@21 -- # val= 00:07:24.068 17:00:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # IFS=: 00:07:24.068 17:00:20 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@21 -- # val= 00:07:25.438 17:00:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # IFS=: 00:07:25.438 17:00:22 -- accel/accel.sh@20 -- # read -r var val 00:07:25.438 17:00:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:25.438 17:00:22 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:25.438 17:00:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.438 00:07:25.438 real 0m2.799s 00:07:25.438 user 0m2.499s 00:07:25.438 sys 0m0.292s 00:07:25.438 17:00:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.438 17:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:25.438 ************************************ 00:07:25.438 END TEST accel_compare 00:07:25.438 ************************************ 00:07:25.438 17:00:22 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:25.438 17:00:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:25.438 17:00:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.438 17:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:25.438 ************************************ 00:07:25.438 START TEST accel_xor 00:07:25.438 ************************************ 00:07:25.438 17:00:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:25.438 17:00:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.438 17:00:22 -- accel/accel.sh@17 -- # local accel_module 00:07:25.438 17:00:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:25.438 17:00:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:25.438 17:00:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.438 17:00:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.438 17:00:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.438 17:00:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.438 17:00:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.438 17:00:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.438 17:00:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.438 17:00:22 -- accel/accel.sh@42 -- # jq -r . 00:07:25.438 [2024-11-27 17:00:22.155656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.438 [2024-11-27 17:00:22.155727] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631508 ] 00:07:25.438 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.438 [2024-11-27 17:00:22.215111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.438 [2024-11-27 17:00:22.304422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.812 17:00:23 -- accel/accel.sh@18 -- # out=' 00:07:26.812 SPDK Configuration: 00:07:26.812 Core mask: 0x1 00:07:26.812 00:07:26.812 Accel Perf Configuration: 00:07:26.812 Workload Type: xor 00:07:26.812 Source buffers: 2 00:07:26.812 Transfer size: 4096 bytes 00:07:26.812 Vector count 1 00:07:26.812 Module: software 00:07:26.812 Queue depth: 32 00:07:26.812 Allocate depth: 32 00:07:26.812 # threads/core: 1 00:07:26.812 Run time: 1 seconds 00:07:26.812 Verify: Yes 00:07:26.812 00:07:26.812 Running for 1 seconds... 00:07:26.812 00:07:26.812 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.812 ------------------------------------------------------------------------------------ 00:07:26.812 0,0 192736/s 752 MiB/s 0 0 00:07:26.812 ==================================================================================== 00:07:26.812 Total 192736/s 752 MiB/s 0 0' 00:07:26.812 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:26.812 17:00:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:26.812 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:26.812 17:00:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:26.812 17:00:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.812 17:00:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.812 17:00:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.812 17:00:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.812 17:00:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.812 17:00:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.812 17:00:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.812 17:00:23 -- accel/accel.sh@42 -- # jq -r . 00:07:26.812 [2024-11-27 17:00:23.557837] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.812 [2024-11-27 17:00:23.557915] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631649 ] 00:07:26.812 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.812 [2024-11-27 17:00:23.618929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.812 [2024-11-27 17:00:23.709405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=0x1 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=xor 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=2 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=software 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=32 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=32 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=1 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val=Yes 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:27.070 17:00:23 -- accel/accel.sh@21 -- # val= 00:07:27.070 17:00:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # IFS=: 00:07:27.070 17:00:23 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@21 -- # val= 00:07:28.004 17:00:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # IFS=: 00:07:28.004 17:00:24 -- accel/accel.sh@20 -- # read -r var val 00:07:28.004 17:00:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:28.004 17:00:24 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:28.004 17:00:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.004 00:07:28.004 real 0m2.804s 00:07:28.004 user 0m2.507s 00:07:28.004 sys 0m0.289s 00:07:28.004 17:00:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.004 17:00:24 -- common/autotest_common.sh@10 -- # set +x 00:07:28.004 ************************************ 00:07:28.004 END TEST accel_xor 00:07:28.004 ************************************ 00:07:28.263 17:00:24 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:28.263 17:00:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:28.263 17:00:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.263 17:00:24 -- common/autotest_common.sh@10 -- # set +x 00:07:28.263 ************************************ 00:07:28.263 START TEST accel_xor 00:07:28.263 ************************************ 00:07:28.263 17:00:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:28.263 17:00:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.263 17:00:24 -- accel/accel.sh@17 -- # local accel_module 00:07:28.263 17:00:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:28.263 17:00:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:28.263 17:00:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.263 17:00:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.263 17:00:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.263 17:00:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.263 17:00:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.263 17:00:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.263 17:00:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.263 17:00:24 -- accel/accel.sh@42 -- # jq -r . 00:07:28.263 [2024-11-27 17:00:24.990979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.263 [2024-11-27 17:00:24.991054] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631810 ] 00:07:28.263 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.263 [2024-11-27 17:00:25.052462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.263 [2024-11-27 17:00:25.144496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.637 17:00:26 -- accel/accel.sh@18 -- # out=' 00:07:29.637 SPDK Configuration: 00:07:29.637 Core mask: 0x1 00:07:29.637 00:07:29.637 Accel Perf Configuration: 00:07:29.637 Workload Type: xor 00:07:29.637 Source buffers: 3 00:07:29.637 Transfer size: 4096 bytes 00:07:29.637 Vector count 1 00:07:29.637 Module: software 00:07:29.637 Queue depth: 32 00:07:29.637 Allocate depth: 32 00:07:29.637 # threads/core: 1 00:07:29.637 Run time: 1 seconds 00:07:29.637 Verify: Yes 00:07:29.637 00:07:29.637 Running for 1 seconds... 00:07:29.637 00:07:29.637 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:29.637 ------------------------------------------------------------------------------------ 00:07:29.637 0,0 184096/s 719 MiB/s 0 0 00:07:29.637 ==================================================================================== 00:07:29.637 Total 184096/s 719 MiB/s 0 0' 00:07:29.637 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.637 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.637 17:00:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:29.637 17:00:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:29.637 17:00:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.637 17:00:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.637 17:00:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.637 17:00:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.637 17:00:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.637 17:00:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.637 17:00:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.637 17:00:26 -- accel/accel.sh@42 -- # jq -r . 00:07:29.637 [2024-11-27 17:00:26.400717] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:29.637 [2024-11-27 17:00:26.400795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631953 ] 00:07:29.637 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.637 [2024-11-27 17:00:26.461664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.637 [2024-11-27 17:00:26.556329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=0x1 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=xor 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=3 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=software 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=32 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=32 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=1 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val=Yes 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:29.896 17:00:26 -- accel/accel.sh@21 -- # val= 00:07:29.896 17:00:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # IFS=: 00:07:29.896 17:00:26 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@21 -- # val= 00:07:31.270 17:00:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # IFS=: 00:07:31.270 17:00:27 -- accel/accel.sh@20 -- # read -r var val 00:07:31.270 17:00:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:31.270 17:00:27 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:31.270 17:00:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.270 00:07:31.270 real 0m2.814s 00:07:31.270 user 0m2.520s 00:07:31.270 sys 0m0.286s 00:07:31.270 17:00:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.270 17:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:31.270 ************************************ 00:07:31.270 END TEST accel_xor 00:07:31.270 ************************************ 00:07:31.270 17:00:27 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:31.270 17:00:27 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:31.270 17:00:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.270 17:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:31.270 ************************************ 00:07:31.270 START TEST accel_dif_verify 00:07:31.270 ************************************ 00:07:31.270 17:00:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:31.270 17:00:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.270 17:00:27 -- accel/accel.sh@17 -- # local accel_module 00:07:31.270 17:00:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:31.270 17:00:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:31.270 17:00:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.270 17:00:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.270 17:00:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.270 17:00:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.270 17:00:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.270 17:00:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.270 17:00:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.270 17:00:27 -- accel/accel.sh@42 -- # jq -r . 00:07:31.270 [2024-11-27 17:00:27.828976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:31.270 [2024-11-27 17:00:27.829050] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1632235 ] 00:07:31.270 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.270 [2024-11-27 17:00:27.890455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.270 [2024-11-27 17:00:27.979730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.643 17:00:29 -- accel/accel.sh@18 -- # out=' 00:07:32.643 SPDK Configuration: 00:07:32.643 Core mask: 0x1 00:07:32.643 00:07:32.643 Accel Perf Configuration: 00:07:32.643 Workload Type: dif_verify 00:07:32.643 Vector size: 4096 bytes 00:07:32.643 Transfer size: 4096 bytes 00:07:32.643 Block size: 512 bytes 00:07:32.643 Metadata size: 8 bytes 00:07:32.643 Vector count 1 00:07:32.643 Module: software 00:07:32.643 Queue depth: 32 00:07:32.643 Allocate depth: 32 00:07:32.643 # threads/core: 1 00:07:32.643 Run time: 1 seconds 00:07:32.643 Verify: No 00:07:32.643 00:07:32.643 Running for 1 seconds... 00:07:32.644 00:07:32.644 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:32.644 ------------------------------------------------------------------------------------ 00:07:32.644 0,0 82272/s 326 MiB/s 0 0 00:07:32.644 ==================================================================================== 00:07:32.644 Total 82272/s 321 MiB/s 0 0' 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:32.644 17:00:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.644 17:00:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.644 17:00:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.644 17:00:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.644 17:00:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.644 17:00:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.644 17:00:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.644 17:00:29 -- accel/accel.sh@42 -- # jq -r . 00:07:32.644 [2024-11-27 17:00:29.228883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:32.644 [2024-11-27 17:00:29.228961] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1632374 ] 00:07:32.644 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.644 [2024-11-27 17:00:29.290180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.644 [2024-11-27 17:00:29.380430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=0x1 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=dif_verify 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=software 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@23 -- # accel_module=software 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=32 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=32 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=1 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val=No 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:32.644 17:00:29 -- accel/accel.sh@21 -- # val= 00:07:32.644 17:00:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # IFS=: 00:07:32.644 17:00:29 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@21 -- # val= 00:07:34.019 17:00:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # IFS=: 00:07:34.019 17:00:30 -- accel/accel.sh@20 -- # read -r var val 00:07:34.019 17:00:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:34.019 17:00:30 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:34.019 17:00:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:34.019 00:07:34.019 real 0m2.809s 00:07:34.019 user 0m2.506s 00:07:34.019 sys 0m0.298s 00:07:34.019 17:00:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.019 17:00:30 -- common/autotest_common.sh@10 -- # set +x 00:07:34.019 ************************************ 00:07:34.019 END TEST accel_dif_verify 00:07:34.019 ************************************ 00:07:34.019 17:00:30 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:34.019 17:00:30 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:34.019 17:00:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.019 17:00:30 -- common/autotest_common.sh@10 -- # set +x 00:07:34.019 ************************************ 00:07:34.019 START TEST accel_dif_generate 00:07:34.019 ************************************ 00:07:34.019 17:00:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:34.019 17:00:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:34.019 17:00:30 -- accel/accel.sh@17 -- # local accel_module 00:07:34.019 17:00:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:34.019 17:00:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:34.019 17:00:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.019 17:00:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.019 17:00:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.019 17:00:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.019 17:00:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.019 17:00:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.019 17:00:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.019 17:00:30 -- accel/accel.sh@42 -- # jq -r . 00:07:34.019 [2024-11-27 17:00:30.665818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:34.019 [2024-11-27 17:00:30.665894] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1632531 ] 00:07:34.019 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.019 [2024-11-27 17:00:30.729862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.019 [2024-11-27 17:00:30.821303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.393 17:00:32 -- accel/accel.sh@18 -- # out=' 00:07:35.393 SPDK Configuration: 00:07:35.393 Core mask: 0x1 00:07:35.393 00:07:35.393 Accel Perf Configuration: 00:07:35.393 Workload Type: dif_generate 00:07:35.393 Vector size: 4096 bytes 00:07:35.393 Transfer size: 4096 bytes 00:07:35.393 Block size: 512 bytes 00:07:35.393 Metadata size: 8 bytes 00:07:35.393 Vector count 1 00:07:35.393 Module: software 00:07:35.394 Queue depth: 32 00:07:35.394 Allocate depth: 32 00:07:35.394 # threads/core: 1 00:07:35.394 Run time: 1 seconds 00:07:35.394 Verify: No 00:07:35.394 00:07:35.394 Running for 1 seconds... 00:07:35.394 00:07:35.394 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:35.394 ------------------------------------------------------------------------------------ 00:07:35.394 0,0 99072/s 393 MiB/s 0 0 00:07:35.394 ==================================================================================== 00:07:35.394 Total 99072/s 387 MiB/s 0 0' 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:35.394 17:00:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.394 17:00:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.394 17:00:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.394 17:00:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.394 17:00:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.394 17:00:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.394 17:00:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.394 17:00:32 -- accel/accel.sh@42 -- # jq -r . 00:07:35.394 [2024-11-27 17:00:32.075329] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:35.394 [2024-11-27 17:00:32.075408] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1632678 ] 00:07:35.394 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.394 [2024-11-27 17:00:32.136203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.394 [2024-11-27 17:00:32.228407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=0x1 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=dif_generate 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=software 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=32 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=32 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=1 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val=No 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:35.394 17:00:32 -- accel/accel.sh@21 -- # val= 00:07:35.394 17:00:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # IFS=: 00:07:35.394 17:00:32 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@21 -- # val= 00:07:36.768 17:00:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # IFS=: 00:07:36.768 17:00:33 -- accel/accel.sh@20 -- # read -r var val 00:07:36.768 17:00:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.768 17:00:33 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:36.768 17:00:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.768 00:07:36.768 real 0m2.807s 00:07:36.768 user 0m2.499s 00:07:36.768 sys 0m0.303s 00:07:36.768 17:00:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.768 17:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:36.768 ************************************ 00:07:36.768 END TEST accel_dif_generate 00:07:36.768 ************************************ 00:07:36.768 17:00:33 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:36.768 17:00:33 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:36.768 17:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.768 17:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:36.768 ************************************ 00:07:36.768 START TEST accel_dif_generate_copy 00:07:36.768 ************************************ 00:07:36.768 17:00:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:36.768 17:00:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.768 17:00:33 -- accel/accel.sh@17 -- # local accel_module 00:07:36.768 17:00:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:36.768 17:00:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:36.768 17:00:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.768 17:00:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.768 17:00:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.768 17:00:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.768 17:00:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.768 17:00:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.768 17:00:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.768 17:00:33 -- accel/accel.sh@42 -- # jq -r . 00:07:36.768 [2024-11-27 17:00:33.500139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:36.768 [2024-11-27 17:00:33.500217] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1632952 ] 00:07:36.768 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.768 [2024-11-27 17:00:33.562125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.768 [2024-11-27 17:00:33.649855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.198 17:00:34 -- accel/accel.sh@18 -- # out=' 00:07:38.198 SPDK Configuration: 00:07:38.198 Core mask: 0x1 00:07:38.198 00:07:38.198 Accel Perf Configuration: 00:07:38.198 Workload Type: dif_generate_copy 00:07:38.198 Vector size: 4096 bytes 00:07:38.198 Transfer size: 4096 bytes 00:07:38.198 Vector count 1 00:07:38.198 Module: software 00:07:38.198 Queue depth: 32 00:07:38.198 Allocate depth: 32 00:07:38.198 # threads/core: 1 00:07:38.198 Run time: 1 seconds 00:07:38.198 Verify: No 00:07:38.199 00:07:38.199 Running for 1 seconds... 00:07:38.199 00:07:38.199 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:38.199 ------------------------------------------------------------------------------------ 00:07:38.199 0,0 75776/s 300 MiB/s 0 0 00:07:38.199 ==================================================================================== 00:07:38.199 Total 75776/s 296 MiB/s 0 0' 00:07:38.199 17:00:34 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:38.199 17:00:34 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:38.199 17:00:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.199 17:00:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.199 17:00:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.199 17:00:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.199 17:00:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.199 17:00:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.199 17:00:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.199 17:00:34 -- accel/accel.sh@42 -- # jq -r . 00:07:38.199 [2024-11-27 17:00:34.883416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:38.199 [2024-11-27 17:00:34.883496] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633104 ] 00:07:38.199 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.199 [2024-11-27 17:00:34.945249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.199 [2024-11-27 17:00:35.036094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=0x1 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=software 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@23 -- # accel_module=software 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=32 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=32 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=1 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val=No 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:38.199 17:00:35 -- accel/accel.sh@21 -- # val= 00:07:38.199 17:00:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # IFS=: 00:07:38.199 17:00:35 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@21 -- # val= 00:07:39.574 17:00:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # IFS=: 00:07:39.574 17:00:36 -- accel/accel.sh@20 -- # read -r var val 00:07:39.574 17:00:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:39.574 17:00:36 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:39.574 17:00:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:39.574 00:07:39.574 real 0m2.794s 00:07:39.574 user 0m2.499s 00:07:39.574 sys 0m0.288s 00:07:39.574 17:00:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.574 17:00:36 -- common/autotest_common.sh@10 -- # set +x 00:07:39.574 ************************************ 00:07:39.574 END TEST accel_dif_generate_copy 00:07:39.574 ************************************ 00:07:39.574 17:00:36 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:39.574 17:00:36 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.574 17:00:36 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:39.574 17:00:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.574 17:00:36 -- common/autotest_common.sh@10 -- # set +x 00:07:39.574 ************************************ 00:07:39.574 START TEST accel_comp 00:07:39.574 ************************************ 00:07:39.574 17:00:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.574 17:00:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.574 17:00:36 -- accel/accel.sh@17 -- # local accel_module 00:07:39.574 17:00:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.574 17:00:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.574 17:00:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.574 17:00:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.574 17:00:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.574 17:00:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.574 17:00:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.574 17:00:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.574 17:00:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.574 17:00:36 -- accel/accel.sh@42 -- # jq -r . 00:07:39.574 [2024-11-27 17:00:36.319825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:39.574 [2024-11-27 17:00:36.319901] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633259 ] 00:07:39.574 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.574 [2024-11-27 17:00:36.381099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.574 [2024-11-27 17:00:36.472936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.950 17:00:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.950 00:07:40.950 SPDK Configuration: 00:07:40.950 Core mask: 0x1 00:07:40.950 00:07:40.950 Accel Perf Configuration: 00:07:40.950 Workload Type: compress 00:07:40.950 Transfer size: 4096 bytes 00:07:40.950 Vector count 1 00:07:40.950 Module: software 00:07:40.950 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.950 Queue depth: 32 00:07:40.950 Allocate depth: 32 00:07:40.950 # threads/core: 1 00:07:40.950 Run time: 1 seconds 00:07:40.950 Verify: No 00:07:40.950 00:07:40.950 Running for 1 seconds... 00:07:40.950 00:07:40.950 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.950 ------------------------------------------------------------------------------------ 00:07:40.950 0,0 32384/s 134 MiB/s 0 0 00:07:40.950 ==================================================================================== 00:07:40.950 Total 32384/s 126 MiB/s 0 0' 00:07:40.950 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:40.950 17:00:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.950 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:40.950 17:00:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.950 17:00:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.950 17:00:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.950 17:00:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.950 17:00:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.950 17:00:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.950 17:00:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.950 17:00:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.950 17:00:37 -- accel/accel.sh@42 -- # jq -r . 00:07:40.950 [2024-11-27 17:00:37.724702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:40.950 [2024-11-27 17:00:37.724782] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633402 ] 00:07:40.950 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.950 [2024-11-27 17:00:37.786690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.950 [2024-11-27 17:00:37.880764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.208 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.208 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.208 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.208 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.208 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.208 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.208 17:00:37 -- accel/accel.sh@21 -- # val=0x1 00:07:41.208 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.208 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.208 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.208 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=compress 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=software 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=32 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=32 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=1 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val=No 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:41.209 17:00:37 -- accel/accel.sh@21 -- # val= 00:07:41.209 17:00:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # IFS=: 00:07:41.209 17:00:37 -- accel/accel.sh@20 -- # read -r var val 00:07:42.582 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.582 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.582 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.582 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.582 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.582 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.582 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.582 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.582 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.583 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.583 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.583 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.583 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.583 17:00:39 -- accel/accel.sh@21 -- # val= 00:07:42.583 17:00:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.583 17:00:39 -- accel/accel.sh@20 -- # IFS=: 00:07:42.583 17:00:39 -- accel/accel.sh@20 -- # read -r var val 00:07:42.583 17:00:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:42.583 17:00:39 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:42.583 17:00:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:42.583 00:07:42.583 real 0m2.808s 00:07:42.583 user 0m2.499s 00:07:42.583 sys 0m0.302s 00:07:42.583 17:00:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.583 17:00:39 -- common/autotest_common.sh@10 -- # set +x 00:07:42.583 ************************************ 00:07:42.583 END TEST accel_comp 00:07:42.583 ************************************ 00:07:42.583 17:00:39 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:42.583 17:00:39 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:42.583 17:00:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.583 17:00:39 -- common/autotest_common.sh@10 -- # set +x 00:07:42.583 ************************************ 00:07:42.583 START TEST accel_decomp 00:07:42.583 ************************************ 00:07:42.583 17:00:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:42.583 17:00:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:42.583 17:00:39 -- accel/accel.sh@17 -- # local accel_module 00:07:42.583 17:00:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:42.583 17:00:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:42.583 17:00:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.583 17:00:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.583 17:00:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.583 17:00:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.583 17:00:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.583 17:00:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.583 17:00:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.583 17:00:39 -- accel/accel.sh@42 -- # jq -r . 00:07:42.583 [2024-11-27 17:00:39.151679] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:42.583 [2024-11-27 17:00:39.151752] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633682 ] 00:07:42.583 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.583 [2024-11-27 17:00:39.213408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.583 [2024-11-27 17:00:39.304918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.957 17:00:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.957 00:07:43.957 SPDK Configuration: 00:07:43.957 Core mask: 0x1 00:07:43.957 00:07:43.957 Accel Perf Configuration: 00:07:43.957 Workload Type: decompress 00:07:43.957 Transfer size: 4096 bytes 00:07:43.957 Vector count 1 00:07:43.957 Module: software 00:07:43.957 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.957 Queue depth: 32 00:07:43.957 Allocate depth: 32 00:07:43.957 # threads/core: 1 00:07:43.957 Run time: 1 seconds 00:07:43.957 Verify: Yes 00:07:43.957 00:07:43.957 Running for 1 seconds... 00:07:43.957 00:07:43.957 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.957 ------------------------------------------------------------------------------------ 00:07:43.957 0,0 55232/s 101 MiB/s 0 0 00:07:43.957 ==================================================================================== 00:07:43.957 Total 55232/s 215 MiB/s 0 0' 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:43.957 17:00:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.957 17:00:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.957 17:00:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.957 17:00:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.957 17:00:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.957 17:00:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.957 17:00:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.957 17:00:40 -- accel/accel.sh@42 -- # jq -r . 00:07:43.957 [2024-11-27 17:00:40.552634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:43.957 [2024-11-27 17:00:40.552711] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633824 ] 00:07:43.957 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.957 [2024-11-27 17:00:40.614669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.957 [2024-11-27 17:00:40.705600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=0x1 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=decompress 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=software 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=32 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=32 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=1 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.957 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.957 17:00:40 -- accel/accel.sh@21 -- # val=Yes 00:07:43.957 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.958 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.958 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:43.958 17:00:40 -- accel/accel.sh@21 -- # val= 00:07:43.958 17:00:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # IFS=: 00:07:43.958 17:00:40 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@21 -- # val= 00:07:45.331 17:00:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # IFS=: 00:07:45.331 17:00:41 -- accel/accel.sh@20 -- # read -r var val 00:07:45.331 17:00:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:45.331 17:00:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:45.331 17:00:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:45.331 00:07:45.331 real 0m2.814s 00:07:45.331 user 0m2.515s 00:07:45.331 sys 0m0.292s 00:07:45.331 17:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:45.331 17:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.331 ************************************ 00:07:45.331 END TEST accel_decomp 00:07:45.331 ************************************ 00:07:45.331 17:00:41 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:45.331 17:00:41 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:45.331 17:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.331 17:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.331 ************************************ 00:07:45.331 START TEST accel_decmop_full 00:07:45.331 ************************************ 00:07:45.331 17:00:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:45.331 17:00:41 -- accel/accel.sh@16 -- # local accel_opc 00:07:45.331 17:00:41 -- accel/accel.sh@17 -- # local accel_module 00:07:45.331 17:00:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:45.331 17:00:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:45.331 17:00:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.331 17:00:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.331 17:00:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.331 17:00:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.331 17:00:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.331 17:00:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.331 17:00:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.331 17:00:41 -- accel/accel.sh@42 -- # jq -r . 00:07:45.331 [2024-11-27 17:00:41.989184] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:45.331 [2024-11-27 17:00:41.989266] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1633986 ] 00:07:45.331 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.331 [2024-11-27 17:00:42.050750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.331 [2024-11-27 17:00:42.141358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.705 17:00:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.705 00:07:46.705 SPDK Configuration: 00:07:46.705 Core mask: 0x1 00:07:46.705 00:07:46.705 Accel Perf Configuration: 00:07:46.705 Workload Type: decompress 00:07:46.705 Transfer size: 111250 bytes 00:07:46.705 Vector count 1 00:07:46.705 Module: software 00:07:46.705 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.705 Queue depth: 32 00:07:46.705 Allocate depth: 32 00:07:46.705 # threads/core: 1 00:07:46.705 Run time: 1 seconds 00:07:46.705 Verify: Yes 00:07:46.705 00:07:46.705 Running for 1 seconds... 00:07:46.705 00:07:46.705 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.705 ------------------------------------------------------------------------------------ 00:07:46.705 0,0 3808/s 157 MiB/s 0 0 00:07:46.705 ==================================================================================== 00:07:46.705 Total 3808/s 404 MiB/s 0 0' 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:46.705 17:00:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.705 17:00:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.705 17:00:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.705 17:00:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.705 17:00:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.705 17:00:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.705 17:00:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.705 17:00:43 -- accel/accel.sh@42 -- # jq -r . 00:07:46.705 [2024-11-27 17:00:43.404448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:46.705 [2024-11-27 17:00:43.404605] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1634128 ] 00:07:46.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.705 [2024-11-27 17:00:43.466690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.705 [2024-11-27 17:00:43.558965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=0x1 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=decompress 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=software 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=32 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=32 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=1 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val=Yes 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:46.705 17:00:43 -- accel/accel.sh@21 -- # val= 00:07:46.705 17:00:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # IFS=: 00:07:46.705 17:00:43 -- accel/accel.sh@20 -- # read -r var val 00:07:48.079 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.079 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.079 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.079 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.079 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.079 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.080 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.080 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.080 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.080 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.080 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.080 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.080 17:00:44 -- accel/accel.sh@21 -- # val= 00:07:48.080 17:00:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # IFS=: 00:07:48.080 17:00:44 -- accel/accel.sh@20 -- # read -r var val 00:07:48.080 17:00:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:48.080 17:00:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:48.080 17:00:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:48.080 00:07:48.080 real 0m2.832s 00:07:48.080 user 0m2.544s 00:07:48.080 sys 0m0.281s 00:07:48.080 17:00:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.080 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:07:48.080 ************************************ 00:07:48.080 END TEST accel_decmop_full 00:07:48.080 ************************************ 00:07:48.080 17:00:44 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:48.080 17:00:44 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:48.080 17:00:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.080 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:07:48.080 ************************************ 00:07:48.080 START TEST accel_decomp_mcore 00:07:48.080 ************************************ 00:07:48.080 17:00:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:48.080 17:00:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:48.080 17:00:44 -- accel/accel.sh@17 -- # local accel_module 00:07:48.080 17:00:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:48.080 17:00:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:48.080 17:00:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.080 17:00:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.080 17:00:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.080 17:00:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.080 17:00:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.080 17:00:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.080 17:00:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.080 17:00:44 -- accel/accel.sh@42 -- # jq -r . 00:07:48.080 [2024-11-27 17:00:44.850560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:48.080 [2024-11-27 17:00:44.850640] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1634403 ] 00:07:48.080 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.080 [2024-11-27 17:00:44.914169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:48.080 [2024-11-27 17:00:45.013825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:48.080 [2024-11-27 17:00:45.013878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:48.080 [2024-11-27 17:00:45.013930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:48.080 [2024-11-27 17:00:45.013933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.455 17:00:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:49.455 00:07:49.455 SPDK Configuration: 00:07:49.455 Core mask: 0xf 00:07:49.455 00:07:49.455 Accel Perf Configuration: 00:07:49.455 Workload Type: decompress 00:07:49.455 Transfer size: 4096 bytes 00:07:49.455 Vector count 1 00:07:49.455 Module: software 00:07:49.455 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:49.455 Queue depth: 32 00:07:49.455 Allocate depth: 32 00:07:49.455 # threads/core: 1 00:07:49.455 Run time: 1 seconds 00:07:49.455 Verify: Yes 00:07:49.455 00:07:49.455 Running for 1 seconds... 00:07:49.455 00:07:49.455 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:49.455 ------------------------------------------------------------------------------------ 00:07:49.455 0,0 50176/s 92 MiB/s 0 0 00:07:49.455 3,0 50592/s 93 MiB/s 0 0 00:07:49.455 2,0 50592/s 93 MiB/s 0 0 00:07:49.455 1,0 50528/s 93 MiB/s 0 0 00:07:49.455 ==================================================================================== 00:07:49.455 Total 201888/s 788 MiB/s 0 0' 00:07:49.455 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.455 17:00:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:49.455 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.455 17:00:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:49.455 17:00:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:49.455 17:00:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:49.455 17:00:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:49.455 17:00:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:49.455 17:00:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:49.455 17:00:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:49.455 17:00:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:49.455 17:00:46 -- accel/accel.sh@42 -- # jq -r . 00:07:49.455 [2024-11-27 17:00:46.270772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:49.455 [2024-11-27 17:00:46.270850] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1634554 ] 00:07:49.455 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.455 [2024-11-27 17:00:46.333314] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.713 [2024-11-27 17:00:46.431237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.713 [2024-11-27 17:00:46.431294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.713 [2024-11-27 17:00:46.431344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.713 [2024-11-27 17:00:46.431347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.713 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=0xf 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=decompress 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=software 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=32 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=32 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=1 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val=Yes 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:49.714 17:00:46 -- accel/accel.sh@21 -- # val= 00:07:49.714 17:00:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # IFS=: 00:07:49.714 17:00:46 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@21 -- # val= 00:07:51.089 17:00:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # IFS=: 00:07:51.089 17:00:47 -- accel/accel.sh@20 -- # read -r var val 00:07:51.089 17:00:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:51.089 17:00:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:51.089 17:00:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:51.089 00:07:51.089 real 0m2.850s 00:07:51.089 user 0m9.465s 00:07:51.089 sys 0m0.319s 00:07:51.089 17:00:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.089 17:00:47 -- common/autotest_common.sh@10 -- # set +x 00:07:51.089 ************************************ 00:07:51.089 END TEST accel_decomp_mcore 00:07:51.089 ************************************ 00:07:51.089 17:00:47 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:51.089 17:00:47 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:51.089 17:00:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.089 17:00:47 -- common/autotest_common.sh@10 -- # set +x 00:07:51.089 ************************************ 00:07:51.089 START TEST accel_decomp_full_mcore 00:07:51.089 ************************************ 00:07:51.089 17:00:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:51.089 17:00:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:51.089 17:00:47 -- accel/accel.sh@17 -- # local accel_module 00:07:51.089 17:00:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:51.089 17:00:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:51.089 17:00:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.089 17:00:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.089 17:00:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.089 17:00:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.089 17:00:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.089 17:00:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.089 17:00:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.089 17:00:47 -- accel/accel.sh@42 -- # jq -r . 00:07:51.089 [2024-11-27 17:00:47.730252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:51.089 [2024-11-27 17:00:47.730333] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1634713 ] 00:07:51.089 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.089 [2024-11-27 17:00:47.792681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:51.089 [2024-11-27 17:00:47.889704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:51.089 [2024-11-27 17:00:47.889761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:51.089 [2024-11-27 17:00:47.889814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:51.089 [2024-11-27 17:00:47.889817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.464 17:00:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:52.464 00:07:52.464 SPDK Configuration: 00:07:52.464 Core mask: 0xf 00:07:52.464 00:07:52.464 Accel Perf Configuration: 00:07:52.464 Workload Type: decompress 00:07:52.464 Transfer size: 111250 bytes 00:07:52.464 Vector count 1 00:07:52.464 Module: software 00:07:52.464 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:52.464 Queue depth: 32 00:07:52.464 Allocate depth: 32 00:07:52.464 # threads/core: 1 00:07:52.464 Run time: 1 seconds 00:07:52.464 Verify: Yes 00:07:52.464 00:07:52.464 Running for 1 seconds... 00:07:52.464 00:07:52.464 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:52.464 ------------------------------------------------------------------------------------ 00:07:52.464 0,0 3776/s 155 MiB/s 0 0 00:07:52.464 3,0 3776/s 155 MiB/s 0 0 00:07:52.464 2,0 3776/s 155 MiB/s 0 0 00:07:52.464 1,0 3776/s 155 MiB/s 0 0 00:07:52.464 ==================================================================================== 00:07:52.464 Total 15104/s 1602 MiB/s 0 0' 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.464 17:00:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:52.464 17:00:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:52.464 17:00:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:52.464 17:00:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:52.464 17:00:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:52.464 17:00:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:52.464 17:00:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:52.464 17:00:49 -- accel/accel.sh@42 -- # jq -r . 00:07:52.464 [2024-11-27 17:00:49.157063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:52.464 [2024-11-27 17:00:49.157144] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1634877 ] 00:07:52.464 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.464 [2024-11-27 17:00:49.220241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:52.464 [2024-11-27 17:00:49.317378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:52.464 [2024-11-27 17:00:49.317433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:52.464 [2024-11-27 17:00:49.317485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:52.464 [2024-11-27 17:00:49.317488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=0xf 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=decompress 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=software 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=32 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=32 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=1 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val=Yes 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:52.464 17:00:49 -- accel/accel.sh@21 -- # val= 00:07:52.464 17:00:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # IFS=: 00:07:52.464 17:00:49 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@21 -- # val= 00:07:53.839 17:00:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # IFS=: 00:07:53.839 17:00:50 -- accel/accel.sh@20 -- # read -r var val 00:07:53.839 17:00:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:53.839 17:00:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:53.839 17:00:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:53.839 00:07:53.839 real 0m2.870s 00:07:53.839 user 0m9.539s 00:07:53.839 sys 0m0.318s 00:07:53.839 17:00:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.839 17:00:50 -- common/autotest_common.sh@10 -- # set +x 00:07:53.839 ************************************ 00:07:53.839 END TEST accel_decomp_full_mcore 00:07:53.839 ************************************ 00:07:53.839 17:00:50 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:53.839 17:00:50 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:53.839 17:00:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.839 17:00:50 -- common/autotest_common.sh@10 -- # set +x 00:07:53.839 ************************************ 00:07:53.839 START TEST accel_decomp_mthread 00:07:53.839 ************************************ 00:07:53.839 17:00:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:53.839 17:00:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:53.839 17:00:50 -- accel/accel.sh@17 -- # local accel_module 00:07:53.839 17:00:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:53.839 17:00:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:53.839 17:00:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:53.839 17:00:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.839 17:00:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.839 17:00:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.839 17:00:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.839 17:00:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.839 17:00:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.839 17:00:50 -- accel/accel.sh@42 -- # jq -r . 00:07:53.839 [2024-11-27 17:00:50.626536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:53.839 [2024-11-27 17:00:50.626619] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1635142 ] 00:07:53.839 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.839 [2024-11-27 17:00:50.689044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:53.839 [2024-11-27 17:00:50.782854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.214 17:00:52 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:55.214 00:07:55.214 SPDK Configuration: 00:07:55.214 Core mask: 0x1 00:07:55.214 00:07:55.214 Accel Perf Configuration: 00:07:55.214 Workload Type: decompress 00:07:55.214 Transfer size: 4096 bytes 00:07:55.214 Vector count 1 00:07:55.214 Module: software 00:07:55.214 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:55.214 Queue depth: 32 00:07:55.214 Allocate depth: 32 00:07:55.214 # threads/core: 2 00:07:55.214 Run time: 1 seconds 00:07:55.214 Verify: Yes 00:07:55.214 00:07:55.214 Running for 1 seconds... 00:07:55.214 00:07:55.214 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:55.214 ------------------------------------------------------------------------------------ 00:07:55.214 0,1 28000/s 51 MiB/s 0 0 00:07:55.214 0,0 27904/s 51 MiB/s 0 0 00:07:55.214 ==================================================================================== 00:07:55.214 Total 55904/s 218 MiB/s 0 0' 00:07:55.214 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.214 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.214 17:00:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:55.214 17:00:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:55.214 17:00:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.214 17:00:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:55.214 17:00:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.214 17:00:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.214 17:00:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:55.214 17:00:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:55.214 17:00:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:55.214 17:00:52 -- accel/accel.sh@42 -- # jq -r . 00:07:55.214 [2024-11-27 17:00:52.031420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:55.214 [2024-11-27 17:00:52.031500] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1635284 ] 00:07:55.214 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.214 [2024-11-27 17:00:52.093698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.472 [2024-11-27 17:00:52.188502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=0x1 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=decompress 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=software 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=32 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=32 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=2 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val=Yes 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:55.472 17:00:52 -- accel/accel.sh@21 -- # val= 00:07:55.472 17:00:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # IFS=: 00:07:55.472 17:00:52 -- accel/accel.sh@20 -- # read -r var val 00:07:56.847 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.847 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.847 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.847 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.847 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.847 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.847 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.847 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.847 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.847 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.847 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.848 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.848 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.848 17:00:53 -- accel/accel.sh@21 -- # val= 00:07:56.848 17:00:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # IFS=: 00:07:56.848 17:00:53 -- accel/accel.sh@20 -- # read -r var val 00:07:56.848 17:00:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:56.848 17:00:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:56.848 17:00:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:56.848 00:07:56.848 real 0m2.830s 00:07:56.848 user 0m2.530s 00:07:56.848 sys 0m0.293s 00:07:56.848 17:00:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:56.848 17:00:53 -- common/autotest_common.sh@10 -- # set +x 00:07:56.848 ************************************ 00:07:56.848 END TEST accel_decomp_mthread 00:07:56.848 ************************************ 00:07:56.848 17:00:53 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:56.848 17:00:53 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:56.848 17:00:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.848 17:00:53 -- common/autotest_common.sh@10 -- # set +x 00:07:56.848 ************************************ 00:07:56.848 START TEST accel_deomp_full_mthread 00:07:56.848 ************************************ 00:07:56.848 17:00:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:56.848 17:00:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:56.848 17:00:53 -- accel/accel.sh@17 -- # local accel_module 00:07:56.848 17:00:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:56.848 17:00:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:56.848 17:00:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:56.848 17:00:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:56.848 17:00:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:56.848 17:00:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:56.848 17:00:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:56.848 17:00:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:56.848 17:00:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:56.848 17:00:53 -- accel/accel.sh@42 -- # jq -r . 00:07:56.848 [2024-11-27 17:00:53.482685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:56.848 [2024-11-27 17:00:53.482764] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1635446 ] 00:07:56.848 EAL: No free 2048 kB hugepages reported on node 1 00:07:56.848 [2024-11-27 17:00:53.542312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.848 [2024-11-27 17:00:53.636488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.222 17:00:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:58.222 00:07:58.222 SPDK Configuration: 00:07:58.222 Core mask: 0x1 00:07:58.222 00:07:58.222 Accel Perf Configuration: 00:07:58.222 Workload Type: decompress 00:07:58.222 Transfer size: 111250 bytes 00:07:58.222 Vector count 1 00:07:58.222 Module: software 00:07:58.222 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:58.222 Queue depth: 32 00:07:58.222 Allocate depth: 32 00:07:58.222 # threads/core: 2 00:07:58.222 Run time: 1 seconds 00:07:58.222 Verify: Yes 00:07:58.222 00:07:58.222 Running for 1 seconds... 00:07:58.222 00:07:58.222 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:58.222 ------------------------------------------------------------------------------------ 00:07:58.222 0,1 1952/s 80 MiB/s 0 0 00:07:58.222 0,0 1920/s 79 MiB/s 0 0 00:07:58.222 ==================================================================================== 00:07:58.222 Total 3872/s 410 MiB/s 0 0' 00:07:58.222 17:00:54 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:58.222 17:00:54 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:58.222 17:00:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:58.222 17:00:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:58.222 17:00:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:58.222 17:00:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:58.222 17:00:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:58.222 17:00:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:58.222 17:00:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:58.222 17:00:54 -- accel/accel.sh@42 -- # jq -r . 00:07:58.222 [2024-11-27 17:00:54.914508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:58.222 [2024-11-27 17:00:54.914611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1635707 ] 00:07:58.222 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.222 [2024-11-27 17:00:54.980393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.222 [2024-11-27 17:00:55.075109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val=0x1 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val=decompress 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.222 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.222 17:00:55 -- accel/accel.sh@21 -- # val=software 00:07:58.222 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.222 17:00:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val=32 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val=32 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val=2 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val=Yes 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:58.223 17:00:55 -- accel/accel.sh@21 -- # val= 00:07:58.223 17:00:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # IFS=: 00:07:58.223 17:00:55 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@21 -- # val= 00:07:59.598 17:00:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # IFS=: 00:07:59.598 17:00:56 -- accel/accel.sh@20 -- # read -r var val 00:07:59.598 17:00:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:59.598 17:00:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:59.598 17:00:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:59.598 00:07:59.598 real 0m2.890s 00:07:59.598 user 0m2.588s 00:07:59.598 sys 0m0.295s 00:07:59.598 17:00:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:59.598 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:07:59.598 ************************************ 00:07:59.598 END TEST accel_deomp_full_mthread 00:07:59.598 ************************************ 00:07:59.598 17:00:56 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:59.598 17:00:56 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:59.598 17:00:56 -- accel/accel.sh@129 -- # build_accel_config 00:07:59.598 17:00:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:59.598 17:00:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:59.598 17:00:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:59.598 17:00:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:59.598 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:07:59.598 17:00:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:59.598 17:00:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:59.598 17:00:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:59.598 17:00:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:59.598 17:00:56 -- accel/accel.sh@42 -- # jq -r . 00:07:59.598 ************************************ 00:07:59.598 START TEST accel_dif_functional_tests 00:07:59.598 ************************************ 00:07:59.598 17:00:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:59.598 [2024-11-27 17:00:56.419078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:59.598 [2024-11-27 17:00:56.419157] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1635868 ] 00:07:59.598 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.598 [2024-11-27 17:00:56.482935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:59.857 [2024-11-27 17:00:56.579806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:59.857 [2024-11-27 17:00:56.579863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:59.857 [2024-11-27 17:00:56.579866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.857 00:07:59.857 00:07:59.857 CUnit - A unit testing framework for C - Version 2.1-3 00:07:59.857 http://cunit.sourceforge.net/ 00:07:59.857 00:07:59.857 00:07:59.857 Suite: accel_dif 00:07:59.857 Test: verify: DIF generated, GUARD check ...passed 00:07:59.857 Test: verify: DIF generated, APPTAG check ...passed 00:07:59.857 Test: verify: DIF generated, REFTAG check ...passed 00:07:59.857 Test: verify: DIF not generated, GUARD check ...[2024-11-27 17:00:56.669910] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:59.857 [2024-11-27 17:00:56.669975] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:59.857 passed 00:07:59.857 Test: verify: DIF not generated, APPTAG check ...[2024-11-27 17:00:56.670018] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:59.857 [2024-11-27 17:00:56.670048] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:59.857 passed 00:07:59.857 Test: verify: DIF not generated, REFTAG check ...[2024-11-27 17:00:56.670087] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:59.857 [2024-11-27 17:00:56.670115] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:59.857 passed 00:07:59.857 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:59.857 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-27 17:00:56.670181] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:59.857 passed 00:07:59.857 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:59.857 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:59.857 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:59.857 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-27 17:00:56.670338] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:59.857 passed 00:07:59.857 Test: generate copy: DIF generated, GUARD check ...passed 00:07:59.857 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:59.857 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:59.857 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:59.857 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:59.857 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:59.857 Test: generate copy: iovecs-len validate ...[2024-11-27 17:00:56.670598] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:59.857 passed 00:07:59.857 Test: generate copy: buffer alignment validate ...passed 00:07:59.857 00:07:59.857 Run Summary: Type Total Ran Passed Failed Inactive 00:07:59.857 suites 1 1 n/a 0 0 00:07:59.857 tests 20 20 20 0 0 00:07:59.857 asserts 204 204 204 0 n/a 00:07:59.857 00:07:59.857 Elapsed time = 0.003 seconds 00:08:00.114 00:08:00.114 real 0m0.505s 00:08:00.114 user 0m0.769s 00:08:00.114 sys 0m0.189s 00:08:00.114 17:00:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.114 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:08:00.114 ************************************ 00:08:00.114 END TEST accel_dif_functional_tests 00:08:00.114 ************************************ 00:08:00.114 00:08:00.114 real 1m0.000s 00:08:00.114 user 1m7.741s 00:08:00.114 sys 0m7.351s 00:08:00.114 17:00:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.114 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:08:00.114 ************************************ 00:08:00.114 END TEST accel 00:08:00.114 ************************************ 00:08:00.114 17:00:56 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:00.114 17:00:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:00.114 17:00:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.114 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:08:00.114 ************************************ 00:08:00.114 START TEST accel_rpc 00:08:00.114 ************************************ 00:08:00.114 17:00:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:00.114 * Looking for test storage... 00:08:00.114 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:08:00.114 17:00:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:00.114 17:00:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:00.114 17:00:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:00.372 17:00:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:00.372 17:00:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:00.372 17:00:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:00.372 17:00:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:00.372 17:00:57 -- scripts/common.sh@335 -- # IFS=.-: 00:08:00.372 17:00:57 -- scripts/common.sh@335 -- # read -ra ver1 00:08:00.372 17:00:57 -- scripts/common.sh@336 -- # IFS=.-: 00:08:00.372 17:00:57 -- scripts/common.sh@336 -- # read -ra ver2 00:08:00.372 17:00:57 -- scripts/common.sh@337 -- # local 'op=<' 00:08:00.372 17:00:57 -- scripts/common.sh@339 -- # ver1_l=2 00:08:00.372 17:00:57 -- scripts/common.sh@340 -- # ver2_l=1 00:08:00.372 17:00:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:00.372 17:00:57 -- scripts/common.sh@343 -- # case "$op" in 00:08:00.372 17:00:57 -- scripts/common.sh@344 -- # : 1 00:08:00.372 17:00:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:00.372 17:00:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:00.372 17:00:57 -- scripts/common.sh@364 -- # decimal 1 00:08:00.372 17:00:57 -- scripts/common.sh@352 -- # local d=1 00:08:00.372 17:00:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:00.372 17:00:57 -- scripts/common.sh@354 -- # echo 1 00:08:00.372 17:00:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:00.372 17:00:57 -- scripts/common.sh@365 -- # decimal 2 00:08:00.372 17:00:57 -- scripts/common.sh@352 -- # local d=2 00:08:00.372 17:00:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:00.372 17:00:57 -- scripts/common.sh@354 -- # echo 2 00:08:00.372 17:00:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:00.372 17:00:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:00.372 17:00:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:00.372 17:00:57 -- scripts/common.sh@367 -- # return 0 00:08:00.372 17:00:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:00.372 17:00:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:00.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.372 --rc genhtml_branch_coverage=1 00:08:00.372 --rc genhtml_function_coverage=1 00:08:00.372 --rc genhtml_legend=1 00:08:00.372 --rc geninfo_all_blocks=1 00:08:00.372 --rc geninfo_unexecuted_blocks=1 00:08:00.372 00:08:00.372 ' 00:08:00.372 17:00:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:00.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.372 --rc genhtml_branch_coverage=1 00:08:00.372 --rc genhtml_function_coverage=1 00:08:00.372 --rc genhtml_legend=1 00:08:00.372 --rc geninfo_all_blocks=1 00:08:00.372 --rc geninfo_unexecuted_blocks=1 00:08:00.372 00:08:00.372 ' 00:08:00.372 17:00:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:00.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.372 --rc genhtml_branch_coverage=1 00:08:00.372 --rc genhtml_function_coverage=1 00:08:00.372 --rc genhtml_legend=1 00:08:00.372 --rc geninfo_all_blocks=1 00:08:00.372 --rc geninfo_unexecuted_blocks=1 00:08:00.372 00:08:00.372 ' 00:08:00.372 17:00:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:00.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.372 --rc genhtml_branch_coverage=1 00:08:00.372 --rc genhtml_function_coverage=1 00:08:00.372 --rc genhtml_legend=1 00:08:00.372 --rc geninfo_all_blocks=1 00:08:00.372 --rc geninfo_unexecuted_blocks=1 00:08:00.372 00:08:00.372 ' 00:08:00.372 17:00:57 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:00.372 17:00:57 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1636018 00:08:00.373 17:00:57 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:00.373 17:00:57 -- accel/accel_rpc.sh@15 -- # waitforlisten 1636018 00:08:00.373 17:00:57 -- common/autotest_common.sh@829 -- # '[' -z 1636018 ']' 00:08:00.373 17:00:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:00.373 17:00:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:00.373 17:00:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:00.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:00.373 17:00:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:00.373 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.373 [2024-11-27 17:00:57.135001] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:00.373 [2024-11-27 17:00:57.135106] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1636018 ] 00:08:00.373 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.373 [2024-11-27 17:00:57.196387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:00.373 [2024-11-27 17:00:57.285083] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:00.373 [2024-11-27 17:00:57.285255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.632 17:00:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:00.632 17:00:57 -- common/autotest_common.sh@862 -- # return 0 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:00.632 17:00:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:00.632 17:00:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.632 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.632 ************************************ 00:08:00.632 START TEST accel_assign_opcode 00:08:00.632 ************************************ 00:08:00.632 17:00:57 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:00.632 17:00:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.632 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.632 [2024-11-27 17:00:57.345842] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:00.632 17:00:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:00.632 17:00:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.632 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.632 [2024-11-27 17:00:57.353863] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:00.632 17:00:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.632 17:00:57 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:00.632 17:00:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.632 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.889 17:00:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.889 17:00:57 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:00.889 17:00:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.889 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.889 17:00:57 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:00.889 17:00:57 -- accel/accel_rpc.sh@42 -- # grep software 00:08:00.889 17:00:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.889 software 00:08:00.889 00:08:00.889 real 0m0.302s 00:08:00.889 user 0m0.040s 00:08:00.889 sys 0m0.007s 00:08:00.889 17:00:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.889 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:08:00.889 ************************************ 00:08:00.889 END TEST accel_assign_opcode 00:08:00.889 ************************************ 00:08:00.889 17:00:57 -- accel/accel_rpc.sh@55 -- # killprocess 1636018 00:08:00.889 17:00:57 -- common/autotest_common.sh@936 -- # '[' -z 1636018 ']' 00:08:00.889 17:00:57 -- common/autotest_common.sh@940 -- # kill -0 1636018 00:08:00.889 17:00:57 -- common/autotest_common.sh@941 -- # uname 00:08:00.889 17:00:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:00.889 17:00:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1636018 00:08:00.889 17:00:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:00.889 17:00:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:00.889 17:00:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1636018' 00:08:00.889 killing process with pid 1636018 00:08:00.889 17:00:57 -- common/autotest_common.sh@955 -- # kill 1636018 00:08:00.889 17:00:57 -- common/autotest_common.sh@960 -- # wait 1636018 00:08:01.456 00:08:01.456 real 0m1.171s 00:08:01.456 user 0m1.052s 00:08:01.456 sys 0m0.474s 00:08:01.456 17:00:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:01.456 17:00:58 -- common/autotest_common.sh@10 -- # set +x 00:08:01.456 ************************************ 00:08:01.456 END TEST accel_rpc 00:08:01.456 ************************************ 00:08:01.456 17:00:58 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:01.456 17:00:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.456 17:00:58 -- common/autotest_common.sh@10 -- # set +x 00:08:01.456 ************************************ 00:08:01.456 START TEST app_cmdline 00:08:01.456 ************************************ 00:08:01.456 17:00:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:01.456 * Looking for test storage... 00:08:01.456 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:01.456 17:00:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:01.456 17:00:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:01.456 17:00:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:01.456 17:00:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:01.456 17:00:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:01.456 17:00:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:01.456 17:00:58 -- scripts/common.sh@335 -- # IFS=.-: 00:08:01.456 17:00:58 -- scripts/common.sh@335 -- # read -ra ver1 00:08:01.456 17:00:58 -- scripts/common.sh@336 -- # IFS=.-: 00:08:01.456 17:00:58 -- scripts/common.sh@336 -- # read -ra ver2 00:08:01.456 17:00:58 -- scripts/common.sh@337 -- # local 'op=<' 00:08:01.456 17:00:58 -- scripts/common.sh@339 -- # ver1_l=2 00:08:01.456 17:00:58 -- scripts/common.sh@340 -- # ver2_l=1 00:08:01.456 17:00:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:01.456 17:00:58 -- scripts/common.sh@343 -- # case "$op" in 00:08:01.456 17:00:58 -- scripts/common.sh@344 -- # : 1 00:08:01.456 17:00:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:01.456 17:00:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:01.456 17:00:58 -- scripts/common.sh@364 -- # decimal 1 00:08:01.456 17:00:58 -- scripts/common.sh@352 -- # local d=1 00:08:01.456 17:00:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:01.456 17:00:58 -- scripts/common.sh@354 -- # echo 1 00:08:01.456 17:00:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:01.456 17:00:58 -- scripts/common.sh@365 -- # decimal 2 00:08:01.456 17:00:58 -- scripts/common.sh@352 -- # local d=2 00:08:01.456 17:00:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:01.456 17:00:58 -- scripts/common.sh@354 -- # echo 2 00:08:01.456 17:00:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:01.456 17:00:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:01.456 17:00:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:01.456 17:00:58 -- scripts/common.sh@367 -- # return 0 00:08:01.456 17:00:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:01.456 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:01.456 --rc genhtml_branch_coverage=1 00:08:01.456 --rc genhtml_function_coverage=1 00:08:01.456 --rc genhtml_legend=1 00:08:01.456 --rc geninfo_all_blocks=1 00:08:01.456 --rc geninfo_unexecuted_blocks=1 00:08:01.456 00:08:01.456 ' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:01.456 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:01.456 --rc genhtml_branch_coverage=1 00:08:01.456 --rc genhtml_function_coverage=1 00:08:01.456 --rc genhtml_legend=1 00:08:01.456 --rc geninfo_all_blocks=1 00:08:01.456 --rc geninfo_unexecuted_blocks=1 00:08:01.456 00:08:01.456 ' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:01.456 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:01.456 --rc genhtml_branch_coverage=1 00:08:01.456 --rc genhtml_function_coverage=1 00:08:01.456 --rc genhtml_legend=1 00:08:01.456 --rc geninfo_all_blocks=1 00:08:01.456 --rc geninfo_unexecuted_blocks=1 00:08:01.456 00:08:01.456 ' 00:08:01.456 17:00:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:01.456 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:01.456 --rc genhtml_branch_coverage=1 00:08:01.456 --rc genhtml_function_coverage=1 00:08:01.456 --rc genhtml_legend=1 00:08:01.456 --rc geninfo_all_blocks=1 00:08:01.456 --rc geninfo_unexecuted_blocks=1 00:08:01.456 00:08:01.456 ' 00:08:01.456 17:00:58 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:01.456 17:00:58 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1636279 00:08:01.456 17:00:58 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:01.456 17:00:58 -- app/cmdline.sh@18 -- # waitforlisten 1636279 00:08:01.456 17:00:58 -- common/autotest_common.sh@829 -- # '[' -z 1636279 ']' 00:08:01.456 17:00:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:01.456 17:00:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:01.456 17:00:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:01.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:01.456 17:00:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:01.456 17:00:58 -- common/autotest_common.sh@10 -- # set +x 00:08:01.456 [2024-11-27 17:00:58.331233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:01.456 [2024-11-27 17:00:58.331318] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1636279 ] 00:08:01.456 EAL: No free 2048 kB hugepages reported on node 1 00:08:01.456 [2024-11-27 17:00:58.387928] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:01.715 [2024-11-27 17:00:58.474964] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:01.715 [2024-11-27 17:00:58.475143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:02.648 17:00:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:02.649 17:00:59 -- common/autotest_common.sh@862 -- # return 0 00:08:02.649 17:00:59 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:02.649 { 00:08:02.649 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:08:02.649 "fields": { 00:08:02.649 "major": 24, 00:08:02.649 "minor": 1, 00:08:02.649 "patch": 1, 00:08:02.649 "suffix": "-pre", 00:08:02.649 "commit": "c13c99a5e" 00:08:02.649 } 00:08:02.649 } 00:08:02.649 17:00:59 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:02.649 17:00:59 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:02.649 17:00:59 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:02.649 17:00:59 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:02.649 17:00:59 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:02.649 17:00:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:02.649 17:00:59 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:02.649 17:00:59 -- common/autotest_common.sh@10 -- # set +x 00:08:02.649 17:00:59 -- app/cmdline.sh@26 -- # sort 00:08:02.649 17:00:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:02.649 17:00:59 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:02.649 17:00:59 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:02.649 17:00:59 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:02.649 17:00:59 -- common/autotest_common.sh@650 -- # local es=0 00:08:02.649 17:00:59 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:02.649 17:00:59 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:02.649 17:00:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:02.649 17:00:59 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:02.649 17:00:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:02.649 17:00:59 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:02.649 17:00:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:02.649 17:00:59 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:02.649 17:00:59 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:08:02.649 17:00:59 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:02.907 request: 00:08:02.907 { 00:08:02.907 "method": "env_dpdk_get_mem_stats", 00:08:02.907 "req_id": 1 00:08:02.907 } 00:08:02.907 Got JSON-RPC error response 00:08:02.907 response: 00:08:02.907 { 00:08:02.907 "code": -32601, 00:08:02.907 "message": "Method not found" 00:08:02.907 } 00:08:02.907 17:00:59 -- common/autotest_common.sh@653 -- # es=1 00:08:02.907 17:00:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:02.907 17:00:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:02.908 17:00:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:02.908 17:00:59 -- app/cmdline.sh@1 -- # killprocess 1636279 00:08:02.908 17:00:59 -- common/autotest_common.sh@936 -- # '[' -z 1636279 ']' 00:08:02.908 17:00:59 -- common/autotest_common.sh@940 -- # kill -0 1636279 00:08:02.908 17:00:59 -- common/autotest_common.sh@941 -- # uname 00:08:02.908 17:00:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:02.908 17:00:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1636279 00:08:02.908 17:00:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:02.908 17:00:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:02.908 17:00:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1636279' 00:08:02.908 killing process with pid 1636279 00:08:02.908 17:00:59 -- common/autotest_common.sh@955 -- # kill 1636279 00:08:02.908 17:00:59 -- common/autotest_common.sh@960 -- # wait 1636279 00:08:03.474 00:08:03.474 real 0m2.122s 00:08:03.474 user 0m2.637s 00:08:03.474 sys 0m0.520s 00:08:03.474 17:01:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:03.474 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.474 ************************************ 00:08:03.474 END TEST app_cmdline 00:08:03.474 ************************************ 00:08:03.474 17:01:00 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:03.474 17:01:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:03.474 17:01:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.474 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.474 ************************************ 00:08:03.474 START TEST version 00:08:03.474 ************************************ 00:08:03.474 17:01:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:03.474 * Looking for test storage... 00:08:03.474 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:03.474 17:01:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:03.474 17:01:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:03.474 17:01:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:03.734 17:01:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:03.734 17:01:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:03.734 17:01:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:03.734 17:01:00 -- scripts/common.sh@335 -- # IFS=.-: 00:08:03.734 17:01:00 -- scripts/common.sh@335 -- # read -ra ver1 00:08:03.734 17:01:00 -- scripts/common.sh@336 -- # IFS=.-: 00:08:03.734 17:01:00 -- scripts/common.sh@336 -- # read -ra ver2 00:08:03.734 17:01:00 -- scripts/common.sh@337 -- # local 'op=<' 00:08:03.734 17:01:00 -- scripts/common.sh@339 -- # ver1_l=2 00:08:03.734 17:01:00 -- scripts/common.sh@340 -- # ver2_l=1 00:08:03.734 17:01:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:03.734 17:01:00 -- scripts/common.sh@343 -- # case "$op" in 00:08:03.734 17:01:00 -- scripts/common.sh@344 -- # : 1 00:08:03.734 17:01:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:03.734 17:01:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:03.734 17:01:00 -- scripts/common.sh@364 -- # decimal 1 00:08:03.734 17:01:00 -- scripts/common.sh@352 -- # local d=1 00:08:03.734 17:01:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:03.734 17:01:00 -- scripts/common.sh@354 -- # echo 1 00:08:03.734 17:01:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:03.734 17:01:00 -- scripts/common.sh@365 -- # decimal 2 00:08:03.734 17:01:00 -- scripts/common.sh@352 -- # local d=2 00:08:03.734 17:01:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:03.734 17:01:00 -- scripts/common.sh@354 -- # echo 2 00:08:03.734 17:01:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:03.734 17:01:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:03.734 17:01:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:03.734 17:01:00 -- scripts/common.sh@367 -- # return 0 00:08:03.734 17:01:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:03.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.734 --rc genhtml_branch_coverage=1 00:08:03.734 --rc genhtml_function_coverage=1 00:08:03.734 --rc genhtml_legend=1 00:08:03.734 --rc geninfo_all_blocks=1 00:08:03.734 --rc geninfo_unexecuted_blocks=1 00:08:03.734 00:08:03.734 ' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:03.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.734 --rc genhtml_branch_coverage=1 00:08:03.734 --rc genhtml_function_coverage=1 00:08:03.734 --rc genhtml_legend=1 00:08:03.734 --rc geninfo_all_blocks=1 00:08:03.734 --rc geninfo_unexecuted_blocks=1 00:08:03.734 00:08:03.734 ' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:03.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.734 --rc genhtml_branch_coverage=1 00:08:03.734 --rc genhtml_function_coverage=1 00:08:03.734 --rc genhtml_legend=1 00:08:03.734 --rc geninfo_all_blocks=1 00:08:03.734 --rc geninfo_unexecuted_blocks=1 00:08:03.734 00:08:03.734 ' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:03.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.734 --rc genhtml_branch_coverage=1 00:08:03.734 --rc genhtml_function_coverage=1 00:08:03.734 --rc genhtml_legend=1 00:08:03.734 --rc geninfo_all_blocks=1 00:08:03.734 --rc geninfo_unexecuted_blocks=1 00:08:03.734 00:08:03.734 ' 00:08:03.734 17:01:00 -- app/version.sh@17 -- # get_header_version major 00:08:03.734 17:01:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:03.734 17:01:00 -- app/version.sh@14 -- # cut -f2 00:08:03.734 17:01:00 -- app/version.sh@14 -- # tr -d '"' 00:08:03.734 17:01:00 -- app/version.sh@17 -- # major=24 00:08:03.734 17:01:00 -- app/version.sh@18 -- # get_header_version minor 00:08:03.734 17:01:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:03.734 17:01:00 -- app/version.sh@14 -- # cut -f2 00:08:03.734 17:01:00 -- app/version.sh@14 -- # tr -d '"' 00:08:03.734 17:01:00 -- app/version.sh@18 -- # minor=1 00:08:03.734 17:01:00 -- app/version.sh@19 -- # get_header_version patch 00:08:03.734 17:01:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:03.734 17:01:00 -- app/version.sh@14 -- # cut -f2 00:08:03.734 17:01:00 -- app/version.sh@14 -- # tr -d '"' 00:08:03.734 17:01:00 -- app/version.sh@19 -- # patch=1 00:08:03.734 17:01:00 -- app/version.sh@20 -- # get_header_version suffix 00:08:03.734 17:01:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:03.734 17:01:00 -- app/version.sh@14 -- # cut -f2 00:08:03.734 17:01:00 -- app/version.sh@14 -- # tr -d '"' 00:08:03.734 17:01:00 -- app/version.sh@20 -- # suffix=-pre 00:08:03.734 17:01:00 -- app/version.sh@22 -- # version=24.1 00:08:03.734 17:01:00 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:03.734 17:01:00 -- app/version.sh@25 -- # version=24.1.1 00:08:03.734 17:01:00 -- app/version.sh@28 -- # version=24.1.1rc0 00:08:03.734 17:01:00 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:03.734 17:01:00 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:03.734 17:01:00 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:08:03.734 17:01:00 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:08:03.734 00:08:03.734 real 0m0.206s 00:08:03.734 user 0m0.150s 00:08:03.734 sys 0m0.082s 00:08:03.734 17:01:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:03.734 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.734 ************************************ 00:08:03.734 END TEST version 00:08:03.734 ************************************ 00:08:03.734 17:01:00 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@191 -- # uname -s 00:08:03.734 17:01:00 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:08:03.734 17:01:00 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:03.734 17:01:00 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:03.734 17:01:00 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@255 -- # timing_exit lib 00:08:03.734 17:01:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:03.734 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.734 17:01:00 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:08:03.734 17:01:00 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:08:03.734 17:01:00 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:03.734 17:01:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:03.734 17:01:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.734 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.734 ************************************ 00:08:03.734 START TEST nvmf_tcp 00:08:03.734 ************************************ 00:08:03.734 17:01:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:03.734 * Looking for test storage... 00:08:03.734 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:08:03.735 17:01:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:03.735 17:01:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:03.735 17:01:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:03.735 17:01:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:03.735 17:01:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:03.735 17:01:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:03.735 17:01:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:03.735 17:01:00 -- scripts/common.sh@335 -- # IFS=.-: 00:08:03.735 17:01:00 -- scripts/common.sh@335 -- # read -ra ver1 00:08:03.735 17:01:00 -- scripts/common.sh@336 -- # IFS=.-: 00:08:03.735 17:01:00 -- scripts/common.sh@336 -- # read -ra ver2 00:08:03.735 17:01:00 -- scripts/common.sh@337 -- # local 'op=<' 00:08:03.735 17:01:00 -- scripts/common.sh@339 -- # ver1_l=2 00:08:03.735 17:01:00 -- scripts/common.sh@340 -- # ver2_l=1 00:08:03.735 17:01:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:03.735 17:01:00 -- scripts/common.sh@343 -- # case "$op" in 00:08:03.735 17:01:00 -- scripts/common.sh@344 -- # : 1 00:08:03.735 17:01:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:03.735 17:01:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:03.735 17:01:00 -- scripts/common.sh@364 -- # decimal 1 00:08:03.735 17:01:00 -- scripts/common.sh@352 -- # local d=1 00:08:03.735 17:01:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:03.735 17:01:00 -- scripts/common.sh@354 -- # echo 1 00:08:03.735 17:01:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:03.735 17:01:00 -- scripts/common.sh@365 -- # decimal 2 00:08:03.735 17:01:00 -- scripts/common.sh@352 -- # local d=2 00:08:03.735 17:01:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:03.735 17:01:00 -- scripts/common.sh@354 -- # echo 2 00:08:03.735 17:01:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:03.735 17:01:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:03.735 17:01:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:03.735 17:01:00 -- scripts/common.sh@367 -- # return 0 00:08:03.735 17:01:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:03.735 17:01:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:03.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.735 --rc genhtml_branch_coverage=1 00:08:03.735 --rc genhtml_function_coverage=1 00:08:03.735 --rc genhtml_legend=1 00:08:03.735 --rc geninfo_all_blocks=1 00:08:03.735 --rc geninfo_unexecuted_blocks=1 00:08:03.735 00:08:03.735 ' 00:08:03.735 17:01:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:03.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.735 --rc genhtml_branch_coverage=1 00:08:03.735 --rc genhtml_function_coverage=1 00:08:03.735 --rc genhtml_legend=1 00:08:03.735 --rc geninfo_all_blocks=1 00:08:03.735 --rc geninfo_unexecuted_blocks=1 00:08:03.735 00:08:03.735 ' 00:08:03.735 17:01:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:03.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.735 --rc genhtml_branch_coverage=1 00:08:03.735 --rc genhtml_function_coverage=1 00:08:03.735 --rc genhtml_legend=1 00:08:03.735 --rc geninfo_all_blocks=1 00:08:03.735 --rc geninfo_unexecuted_blocks=1 00:08:03.735 00:08:03.735 ' 00:08:03.735 17:01:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:03.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.735 --rc genhtml_branch_coverage=1 00:08:03.735 --rc genhtml_function_coverage=1 00:08:03.735 --rc genhtml_legend=1 00:08:03.735 --rc geninfo_all_blocks=1 00:08:03.735 --rc geninfo_unexecuted_blocks=1 00:08:03.735 00:08:03.735 ' 00:08:03.735 17:01:00 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:03.735 17:01:00 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:03.735 17:01:00 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:03.995 17:01:00 -- nvmf/common.sh@7 -- # uname -s 00:08:03.995 17:01:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:03.995 17:01:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:03.995 17:01:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:03.995 17:01:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:03.995 17:01:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:03.995 17:01:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:03.995 17:01:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:03.995 17:01:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:03.995 17:01:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:03.995 17:01:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:03.995 17:01:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:03.995 17:01:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:03.995 17:01:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:03.995 17:01:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:03.995 17:01:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:03.995 17:01:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:03.995 17:01:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:03.995 17:01:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:03.995 17:01:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:03.995 17:01:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.995 17:01:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.995 17:01:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.995 17:01:00 -- paths/export.sh@5 -- # export PATH 00:08:03.995 17:01:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.995 17:01:00 -- nvmf/common.sh@46 -- # : 0 00:08:03.995 17:01:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:03.995 17:01:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:03.995 17:01:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:03.995 17:01:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:03.995 17:01:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:03.995 17:01:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:03.995 17:01:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:03.995 17:01:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:03.995 17:01:00 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:03.995 17:01:00 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:03.995 17:01:00 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:03.995 17:01:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:03.995 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.995 17:01:00 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:03.995 17:01:00 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:03.995 17:01:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:03.995 17:01:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.995 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.995 ************************************ 00:08:03.995 START TEST nvmf_example 00:08:03.995 ************************************ 00:08:03.995 17:01:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:03.995 * Looking for test storage... 00:08:03.995 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:03.995 17:01:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:03.995 17:01:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:03.996 17:01:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:03.996 17:01:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:03.996 17:01:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:03.996 17:01:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:03.996 17:01:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:03.996 17:01:00 -- scripts/common.sh@335 -- # IFS=.-: 00:08:03.996 17:01:00 -- scripts/common.sh@335 -- # read -ra ver1 00:08:03.996 17:01:00 -- scripts/common.sh@336 -- # IFS=.-: 00:08:03.996 17:01:00 -- scripts/common.sh@336 -- # read -ra ver2 00:08:03.996 17:01:00 -- scripts/common.sh@337 -- # local 'op=<' 00:08:03.996 17:01:00 -- scripts/common.sh@339 -- # ver1_l=2 00:08:03.996 17:01:00 -- scripts/common.sh@340 -- # ver2_l=1 00:08:03.996 17:01:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:03.996 17:01:00 -- scripts/common.sh@343 -- # case "$op" in 00:08:03.996 17:01:00 -- scripts/common.sh@344 -- # : 1 00:08:03.996 17:01:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:03.996 17:01:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:03.996 17:01:00 -- scripts/common.sh@364 -- # decimal 1 00:08:03.996 17:01:00 -- scripts/common.sh@352 -- # local d=1 00:08:03.996 17:01:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:03.996 17:01:00 -- scripts/common.sh@354 -- # echo 1 00:08:03.996 17:01:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:03.996 17:01:00 -- scripts/common.sh@365 -- # decimal 2 00:08:03.996 17:01:00 -- scripts/common.sh@352 -- # local d=2 00:08:03.996 17:01:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:03.996 17:01:00 -- scripts/common.sh@354 -- # echo 2 00:08:03.996 17:01:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:03.996 17:01:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:03.996 17:01:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:03.996 17:01:00 -- scripts/common.sh@367 -- # return 0 00:08:03.996 17:01:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:03.996 17:01:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:03.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.996 --rc genhtml_branch_coverage=1 00:08:03.996 --rc genhtml_function_coverage=1 00:08:03.996 --rc genhtml_legend=1 00:08:03.996 --rc geninfo_all_blocks=1 00:08:03.996 --rc geninfo_unexecuted_blocks=1 00:08:03.996 00:08:03.996 ' 00:08:03.996 17:01:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:03.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.996 --rc genhtml_branch_coverage=1 00:08:03.996 --rc genhtml_function_coverage=1 00:08:03.996 --rc genhtml_legend=1 00:08:03.996 --rc geninfo_all_blocks=1 00:08:03.996 --rc geninfo_unexecuted_blocks=1 00:08:03.996 00:08:03.996 ' 00:08:03.996 17:01:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:03.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.996 --rc genhtml_branch_coverage=1 00:08:03.996 --rc genhtml_function_coverage=1 00:08:03.996 --rc genhtml_legend=1 00:08:03.996 --rc geninfo_all_blocks=1 00:08:03.996 --rc geninfo_unexecuted_blocks=1 00:08:03.996 00:08:03.996 ' 00:08:03.996 17:01:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:03.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.996 --rc genhtml_branch_coverage=1 00:08:03.996 --rc genhtml_function_coverage=1 00:08:03.996 --rc genhtml_legend=1 00:08:03.996 --rc geninfo_all_blocks=1 00:08:03.996 --rc geninfo_unexecuted_blocks=1 00:08:03.996 00:08:03.996 ' 00:08:03.996 17:01:00 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:03.996 17:01:00 -- nvmf/common.sh@7 -- # uname -s 00:08:03.996 17:01:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:03.996 17:01:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:03.996 17:01:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:03.996 17:01:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:03.996 17:01:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:03.996 17:01:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:03.996 17:01:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:03.996 17:01:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:03.996 17:01:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:03.996 17:01:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:03.996 17:01:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:03.996 17:01:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:03.996 17:01:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:03.996 17:01:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:03.996 17:01:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:03.996 17:01:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:03.996 17:01:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:03.996 17:01:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:03.996 17:01:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:03.996 17:01:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.996 17:01:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.996 17:01:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.996 17:01:00 -- paths/export.sh@5 -- # export PATH 00:08:03.996 17:01:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.996 17:01:00 -- nvmf/common.sh@46 -- # : 0 00:08:03.996 17:01:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:03.996 17:01:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:03.996 17:01:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:03.996 17:01:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:03.996 17:01:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:03.996 17:01:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:03.996 17:01:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:03.996 17:01:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:03.996 17:01:00 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:03.996 17:01:00 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:03.996 17:01:00 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:03.996 17:01:00 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:03.996 17:01:00 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:03.996 17:01:00 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:03.996 17:01:00 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:03.996 17:01:00 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:03.996 17:01:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:03.996 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:03.996 17:01:00 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:03.996 17:01:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:03.996 17:01:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:03.996 17:01:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:03.996 17:01:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:03.996 17:01:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:03.996 17:01:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:03.996 17:01:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:03.996 17:01:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:03.996 17:01:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:03.996 17:01:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:03.996 17:01:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:03.996 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:08:06.532 17:01:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:06.532 17:01:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:06.532 17:01:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:06.532 17:01:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:06.532 17:01:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:06.532 17:01:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:06.532 17:01:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:06.532 17:01:02 -- nvmf/common.sh@294 -- # net_devs=() 00:08:06.532 17:01:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:06.532 17:01:02 -- nvmf/common.sh@295 -- # e810=() 00:08:06.532 17:01:02 -- nvmf/common.sh@295 -- # local -ga e810 00:08:06.532 17:01:02 -- nvmf/common.sh@296 -- # x722=() 00:08:06.532 17:01:02 -- nvmf/common.sh@296 -- # local -ga x722 00:08:06.532 17:01:02 -- nvmf/common.sh@297 -- # mlx=() 00:08:06.532 17:01:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:06.532 17:01:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:06.532 17:01:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:06.532 17:01:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:06.532 17:01:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:06.532 17:01:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:06.532 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:06.532 17:01:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:06.532 17:01:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:06.532 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:06.532 17:01:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:06.532 17:01:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:06.532 17:01:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:06.532 17:01:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:06.532 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:06.532 17:01:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:06.532 17:01:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:06.532 17:01:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:06.532 17:01:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:06.532 17:01:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:06.532 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:06.532 17:01:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:06.532 17:01:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:06.532 17:01:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:06.532 17:01:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:06.532 17:01:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:06.532 17:01:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:06.532 17:01:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:06.532 17:01:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:06.532 17:01:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:06.532 17:01:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:06.532 17:01:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:06.532 17:01:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:06.532 17:01:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:06.532 17:01:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:06.532 17:01:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:06.532 17:01:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:06.532 17:01:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:06.532 17:01:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:06.532 17:01:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:06.532 17:01:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:06.532 17:01:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:06.532 17:01:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:06.532 17:01:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:06.532 17:01:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:06.532 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:06.532 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.348 ms 00:08:06.532 00:08:06.532 --- 10.0.0.2 ping statistics --- 00:08:06.532 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:06.532 rtt min/avg/max/mdev = 0.348/0.348/0.348/0.000 ms 00:08:06.532 17:01:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:06.532 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:06.532 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:08:06.532 00:08:06.532 --- 10.0.0.1 ping statistics --- 00:08:06.532 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:06.532 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:08:06.532 17:01:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:06.532 17:01:03 -- nvmf/common.sh@410 -- # return 0 00:08:06.532 17:01:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:06.532 17:01:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:06.532 17:01:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:06.532 17:01:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:06.532 17:01:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:06.532 17:01:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:06.532 17:01:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:06.532 17:01:03 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:06.532 17:01:03 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:06.532 17:01:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:06.532 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.532 17:01:03 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:06.532 17:01:03 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:06.532 17:01:03 -- target/nvmf_example.sh@34 -- # nvmfpid=1638339 00:08:06.532 17:01:03 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:06.532 17:01:03 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:06.532 17:01:03 -- target/nvmf_example.sh@36 -- # waitforlisten 1638339 00:08:06.532 17:01:03 -- common/autotest_common.sh@829 -- # '[' -z 1638339 ']' 00:08:06.532 17:01:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:06.532 17:01:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:06.532 17:01:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:06.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:06.533 17:01:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.533 17:01:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:06.533 17:01:03 -- common/autotest_common.sh@862 -- # return 0 00:08:06.533 17:01:03 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:06.533 17:01:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:06.533 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.533 17:01:03 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:06.533 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.533 17:01:03 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:06.533 17:01:03 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:06.533 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.533 17:01:03 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:06.533 17:01:03 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:06.533 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.533 17:01:03 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:06.533 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.533 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:08:06.533 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.533 17:01:03 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:06.533 17:01:03 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:06.791 EAL: No free 2048 kB hugepages reported on node 1 00:08:18.991 Initializing NVMe Controllers 00:08:18.991 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:18.991 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:18.991 Initialization complete. Launching workers. 00:08:18.991 ======================================================== 00:08:18.991 Latency(us) 00:08:18.991 Device Information : IOPS MiB/s Average min max 00:08:18.991 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15158.32 59.21 4221.51 750.78 23000.86 00:08:18.991 ======================================================== 00:08:18.991 Total : 15158.32 59.21 4221.51 750.78 23000.86 00:08:18.991 00:08:18.991 17:01:13 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:18.991 17:01:13 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:18.991 17:01:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:18.991 17:01:13 -- nvmf/common.sh@116 -- # sync 00:08:18.991 17:01:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:18.991 17:01:13 -- nvmf/common.sh@119 -- # set +e 00:08:18.991 17:01:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:18.991 17:01:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:18.991 rmmod nvme_tcp 00:08:18.991 rmmod nvme_fabrics 00:08:18.991 rmmod nvme_keyring 00:08:18.991 17:01:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:18.991 17:01:13 -- nvmf/common.sh@123 -- # set -e 00:08:18.992 17:01:13 -- nvmf/common.sh@124 -- # return 0 00:08:18.992 17:01:13 -- nvmf/common.sh@477 -- # '[' -n 1638339 ']' 00:08:18.992 17:01:13 -- nvmf/common.sh@478 -- # killprocess 1638339 00:08:18.992 17:01:13 -- common/autotest_common.sh@936 -- # '[' -z 1638339 ']' 00:08:18.992 17:01:13 -- common/autotest_common.sh@940 -- # kill -0 1638339 00:08:18.992 17:01:13 -- common/autotest_common.sh@941 -- # uname 00:08:18.992 17:01:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:18.992 17:01:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1638339 00:08:18.992 17:01:13 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:18.992 17:01:13 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:18.992 17:01:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1638339' 00:08:18.992 killing process with pid 1638339 00:08:18.992 17:01:13 -- common/autotest_common.sh@955 -- # kill 1638339 00:08:18.992 17:01:13 -- common/autotest_common.sh@960 -- # wait 1638339 00:08:18.992 nvmf threads initialize successfully 00:08:18.992 bdev subsystem init successfully 00:08:18.992 created a nvmf target service 00:08:18.992 create targets's poll groups done 00:08:18.992 all subsystems of target started 00:08:18.992 nvmf target is running 00:08:18.992 all subsystems of target stopped 00:08:18.992 destroy targets's poll groups done 00:08:18.992 destroyed the nvmf target service 00:08:18.992 bdev subsystem finish successfully 00:08:18.992 nvmf threads destroy successfully 00:08:18.992 17:01:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:18.992 17:01:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:18.992 17:01:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:18.992 17:01:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:18.992 17:01:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:18.992 17:01:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:18.992 17:01:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:18.992 17:01:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:19.250 17:01:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:19.250 17:01:16 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:19.250 17:01:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:19.250 17:01:16 -- common/autotest_common.sh@10 -- # set +x 00:08:19.250 00:08:19.250 real 0m15.445s 00:08:19.251 user 0m40.281s 00:08:19.251 sys 0m4.337s 00:08:19.251 17:01:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:19.251 17:01:16 -- common/autotest_common.sh@10 -- # set +x 00:08:19.251 ************************************ 00:08:19.251 END TEST nvmf_example 00:08:19.251 ************************************ 00:08:19.251 17:01:16 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:19.251 17:01:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:19.251 17:01:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:19.251 17:01:16 -- common/autotest_common.sh@10 -- # set +x 00:08:19.251 ************************************ 00:08:19.251 START TEST nvmf_filesystem 00:08:19.251 ************************************ 00:08:19.251 17:01:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:19.511 * Looking for test storage... 00:08:19.511 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.511 17:01:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:19.511 17:01:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:19.511 17:01:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:19.511 17:01:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:19.511 17:01:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:19.511 17:01:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:19.511 17:01:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:19.511 17:01:16 -- scripts/common.sh@335 -- # IFS=.-: 00:08:19.511 17:01:16 -- scripts/common.sh@335 -- # read -ra ver1 00:08:19.511 17:01:16 -- scripts/common.sh@336 -- # IFS=.-: 00:08:19.511 17:01:16 -- scripts/common.sh@336 -- # read -ra ver2 00:08:19.511 17:01:16 -- scripts/common.sh@337 -- # local 'op=<' 00:08:19.511 17:01:16 -- scripts/common.sh@339 -- # ver1_l=2 00:08:19.511 17:01:16 -- scripts/common.sh@340 -- # ver2_l=1 00:08:19.511 17:01:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:19.511 17:01:16 -- scripts/common.sh@343 -- # case "$op" in 00:08:19.511 17:01:16 -- scripts/common.sh@344 -- # : 1 00:08:19.511 17:01:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:19.511 17:01:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:19.511 17:01:16 -- scripts/common.sh@364 -- # decimal 1 00:08:19.511 17:01:16 -- scripts/common.sh@352 -- # local d=1 00:08:19.511 17:01:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:19.511 17:01:16 -- scripts/common.sh@354 -- # echo 1 00:08:19.511 17:01:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:19.511 17:01:16 -- scripts/common.sh@365 -- # decimal 2 00:08:19.511 17:01:16 -- scripts/common.sh@352 -- # local d=2 00:08:19.511 17:01:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:19.511 17:01:16 -- scripts/common.sh@354 -- # echo 2 00:08:19.511 17:01:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:19.511 17:01:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:19.511 17:01:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:19.511 17:01:16 -- scripts/common.sh@367 -- # return 0 00:08:19.511 17:01:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:19.511 17:01:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:19.511 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.511 --rc genhtml_branch_coverage=1 00:08:19.511 --rc genhtml_function_coverage=1 00:08:19.511 --rc genhtml_legend=1 00:08:19.511 --rc geninfo_all_blocks=1 00:08:19.511 --rc geninfo_unexecuted_blocks=1 00:08:19.511 00:08:19.511 ' 00:08:19.512 17:01:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:19.512 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.512 --rc genhtml_branch_coverage=1 00:08:19.512 --rc genhtml_function_coverage=1 00:08:19.512 --rc genhtml_legend=1 00:08:19.512 --rc geninfo_all_blocks=1 00:08:19.512 --rc geninfo_unexecuted_blocks=1 00:08:19.512 00:08:19.512 ' 00:08:19.512 17:01:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:19.512 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.512 --rc genhtml_branch_coverage=1 00:08:19.512 --rc genhtml_function_coverage=1 00:08:19.512 --rc genhtml_legend=1 00:08:19.512 --rc geninfo_all_blocks=1 00:08:19.512 --rc geninfo_unexecuted_blocks=1 00:08:19.512 00:08:19.512 ' 00:08:19.512 17:01:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:19.512 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.512 --rc genhtml_branch_coverage=1 00:08:19.512 --rc genhtml_function_coverage=1 00:08:19.512 --rc genhtml_legend=1 00:08:19.512 --rc geninfo_all_blocks=1 00:08:19.512 --rc geninfo_unexecuted_blocks=1 00:08:19.512 00:08:19.512 ' 00:08:19.512 17:01:16 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:19.512 17:01:16 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:19.512 17:01:16 -- common/autotest_common.sh@34 -- # set -e 00:08:19.512 17:01:16 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:19.512 17:01:16 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:19.512 17:01:16 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:19.512 17:01:16 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:19.512 17:01:16 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:19.512 17:01:16 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:19.512 17:01:16 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:19.512 17:01:16 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:19.512 17:01:16 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:19.512 17:01:16 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:19.512 17:01:16 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:19.512 17:01:16 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:19.512 17:01:16 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:19.512 17:01:16 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:19.512 17:01:16 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:19.512 17:01:16 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:19.512 17:01:16 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:19.512 17:01:16 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:19.512 17:01:16 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:19.512 17:01:16 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:19.512 17:01:16 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:19.512 17:01:16 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:19.512 17:01:16 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:19.512 17:01:16 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:19.512 17:01:16 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:19.512 17:01:16 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:19.512 17:01:16 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:19.512 17:01:16 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:19.512 17:01:16 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:19.512 17:01:16 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:19.512 17:01:16 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:19.512 17:01:16 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:19.512 17:01:16 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:19.512 17:01:16 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:19.512 17:01:16 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:19.512 17:01:16 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:19.512 17:01:16 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:19.512 17:01:16 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:19.512 17:01:16 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:19.512 17:01:16 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:19.512 17:01:16 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:19.512 17:01:16 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:19.512 17:01:16 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:19.512 17:01:16 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:19.512 17:01:16 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:19.512 17:01:16 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:19.512 17:01:16 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:19.512 17:01:16 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:19.512 17:01:16 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:19.512 17:01:16 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:19.512 17:01:16 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:19.512 17:01:16 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:19.512 17:01:16 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:19.512 17:01:16 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:19.512 17:01:16 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:19.512 17:01:16 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:19.512 17:01:16 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:19.512 17:01:16 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:19.512 17:01:16 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:19.512 17:01:16 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:19.512 17:01:16 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:19.512 17:01:16 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:19.512 17:01:16 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:19.512 17:01:16 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:19.512 17:01:16 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:19.512 17:01:16 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:19.512 17:01:16 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:19.512 17:01:16 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:19.512 17:01:16 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:19.512 17:01:16 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:19.512 17:01:16 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:19.512 17:01:16 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:19.512 17:01:16 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:19.512 17:01:16 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:19.512 17:01:16 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:19.512 17:01:16 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:19.512 17:01:16 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:19.512 17:01:16 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:19.512 17:01:16 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:19.512 17:01:16 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:19.512 17:01:16 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:19.512 17:01:16 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:19.512 17:01:16 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:19.512 17:01:16 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:19.512 17:01:16 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:19.512 17:01:16 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:19.512 17:01:16 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:19.512 17:01:16 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:19.512 17:01:16 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:19.512 17:01:16 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:19.512 17:01:16 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:19.512 17:01:16 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:19.512 17:01:16 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:19.512 17:01:16 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:19.512 17:01:16 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:19.512 17:01:16 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:19.512 17:01:16 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:19.512 17:01:16 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:19.512 17:01:16 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:19.512 #define SPDK_CONFIG_H 00:08:19.512 #define SPDK_CONFIG_APPS 1 00:08:19.512 #define SPDK_CONFIG_ARCH native 00:08:19.512 #undef SPDK_CONFIG_ASAN 00:08:19.512 #undef SPDK_CONFIG_AVAHI 00:08:19.512 #undef SPDK_CONFIG_CET 00:08:19.512 #define SPDK_CONFIG_COVERAGE 1 00:08:19.512 #define SPDK_CONFIG_CROSS_PREFIX 00:08:19.512 #undef SPDK_CONFIG_CRYPTO 00:08:19.512 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:19.512 #undef SPDK_CONFIG_CUSTOMOCF 00:08:19.512 #undef SPDK_CONFIG_DAOS 00:08:19.512 #define SPDK_CONFIG_DAOS_DIR 00:08:19.512 #define SPDK_CONFIG_DEBUG 1 00:08:19.512 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:19.512 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:19.512 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:19.512 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:19.512 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:19.512 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:19.512 #define SPDK_CONFIG_EXAMPLES 1 00:08:19.512 #undef SPDK_CONFIG_FC 00:08:19.513 #define SPDK_CONFIG_FC_PATH 00:08:19.513 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:19.513 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:19.513 #undef SPDK_CONFIG_FUSE 00:08:19.513 #undef SPDK_CONFIG_FUZZER 00:08:19.513 #define SPDK_CONFIG_FUZZER_LIB 00:08:19.513 #undef SPDK_CONFIG_GOLANG 00:08:19.513 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:19.513 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:19.513 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:19.513 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:19.513 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:19.513 #define SPDK_CONFIG_IDXD 1 00:08:19.513 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:19.513 #undef SPDK_CONFIG_IPSEC_MB 00:08:19.513 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:19.513 #define SPDK_CONFIG_ISAL 1 00:08:19.513 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:19.513 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:19.513 #define SPDK_CONFIG_LIBDIR 00:08:19.513 #undef SPDK_CONFIG_LTO 00:08:19.513 #define SPDK_CONFIG_MAX_LCORES 00:08:19.513 #define SPDK_CONFIG_NVME_CUSE 1 00:08:19.513 #undef SPDK_CONFIG_OCF 00:08:19.513 #define SPDK_CONFIG_OCF_PATH 00:08:19.513 #define SPDK_CONFIG_OPENSSL_PATH 00:08:19.513 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:19.513 #undef SPDK_CONFIG_PGO_USE 00:08:19.513 #define SPDK_CONFIG_PREFIX /usr/local 00:08:19.513 #undef SPDK_CONFIG_RAID5F 00:08:19.513 #undef SPDK_CONFIG_RBD 00:08:19.513 #define SPDK_CONFIG_RDMA 1 00:08:19.513 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:19.513 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:19.513 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:19.513 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:19.513 #define SPDK_CONFIG_SHARED 1 00:08:19.513 #undef SPDK_CONFIG_SMA 00:08:19.513 #define SPDK_CONFIG_TESTS 1 00:08:19.513 #undef SPDK_CONFIG_TSAN 00:08:19.513 #define SPDK_CONFIG_UBLK 1 00:08:19.513 #define SPDK_CONFIG_UBSAN 1 00:08:19.513 #undef SPDK_CONFIG_UNIT_TESTS 00:08:19.513 #undef SPDK_CONFIG_URING 00:08:19.513 #define SPDK_CONFIG_URING_PATH 00:08:19.513 #undef SPDK_CONFIG_URING_ZNS 00:08:19.513 #undef SPDK_CONFIG_USDT 00:08:19.513 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:19.513 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:19.513 #define SPDK_CONFIG_VFIO_USER 1 00:08:19.513 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:19.513 #define SPDK_CONFIG_VHOST 1 00:08:19.513 #define SPDK_CONFIG_VIRTIO 1 00:08:19.513 #undef SPDK_CONFIG_VTUNE 00:08:19.513 #define SPDK_CONFIG_VTUNE_DIR 00:08:19.513 #define SPDK_CONFIG_WERROR 1 00:08:19.513 #define SPDK_CONFIG_WPDK_DIR 00:08:19.513 #undef SPDK_CONFIG_XNVME 00:08:19.513 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:19.513 17:01:16 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:19.513 17:01:16 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:19.513 17:01:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:19.513 17:01:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:19.513 17:01:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:19.513 17:01:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.513 17:01:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.513 17:01:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.513 17:01:16 -- paths/export.sh@5 -- # export PATH 00:08:19.513 17:01:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.513 17:01:16 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:19.513 17:01:16 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:19.513 17:01:16 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:19.513 17:01:16 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:19.513 17:01:16 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:19.513 17:01:16 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:19.513 17:01:16 -- pm/common@16 -- # TEST_TAG=N/A 00:08:19.513 17:01:16 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:19.513 17:01:16 -- common/autotest_common.sh@52 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:19.513 17:01:16 -- common/autotest_common.sh@56 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:19.513 17:01:16 -- common/autotest_common.sh@58 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:19.513 17:01:16 -- common/autotest_common.sh@60 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:19.513 17:01:16 -- common/autotest_common.sh@62 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:19.513 17:01:16 -- common/autotest_common.sh@64 -- # : 00:08:19.513 17:01:16 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:19.513 17:01:16 -- common/autotest_common.sh@66 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:19.513 17:01:16 -- common/autotest_common.sh@68 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:19.513 17:01:16 -- common/autotest_common.sh@70 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:19.513 17:01:16 -- common/autotest_common.sh@72 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:19.513 17:01:16 -- common/autotest_common.sh@74 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:19.513 17:01:16 -- common/autotest_common.sh@76 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:19.513 17:01:16 -- common/autotest_common.sh@78 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:19.513 17:01:16 -- common/autotest_common.sh@80 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:19.513 17:01:16 -- common/autotest_common.sh@82 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:19.513 17:01:16 -- common/autotest_common.sh@84 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:19.513 17:01:16 -- common/autotest_common.sh@86 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:19.513 17:01:16 -- common/autotest_common.sh@88 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:19.513 17:01:16 -- common/autotest_common.sh@90 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:19.513 17:01:16 -- common/autotest_common.sh@92 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:19.513 17:01:16 -- common/autotest_common.sh@94 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:19.513 17:01:16 -- common/autotest_common.sh@96 -- # : tcp 00:08:19.513 17:01:16 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:19.513 17:01:16 -- common/autotest_common.sh@98 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:19.513 17:01:16 -- common/autotest_common.sh@100 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:19.513 17:01:16 -- common/autotest_common.sh@102 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:19.513 17:01:16 -- common/autotest_common.sh@104 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:19.513 17:01:16 -- common/autotest_common.sh@106 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:19.513 17:01:16 -- common/autotest_common.sh@108 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:19.513 17:01:16 -- common/autotest_common.sh@110 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:19.513 17:01:16 -- common/autotest_common.sh@112 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:19.513 17:01:16 -- common/autotest_common.sh@114 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:19.513 17:01:16 -- common/autotest_common.sh@116 -- # : 1 00:08:19.513 17:01:16 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:19.513 17:01:16 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:19.513 17:01:16 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:19.513 17:01:16 -- common/autotest_common.sh@120 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:19.513 17:01:16 -- common/autotest_common.sh@122 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:19.513 17:01:16 -- common/autotest_common.sh@124 -- # : 0 00:08:19.513 17:01:16 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:19.513 17:01:16 -- common/autotest_common.sh@126 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:19.514 17:01:16 -- common/autotest_common.sh@128 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:19.514 17:01:16 -- common/autotest_common.sh@130 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:19.514 17:01:16 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:19.514 17:01:16 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:19.514 17:01:16 -- common/autotest_common.sh@134 -- # : true 00:08:19.514 17:01:16 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:19.514 17:01:16 -- common/autotest_common.sh@136 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:19.514 17:01:16 -- common/autotest_common.sh@138 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:19.514 17:01:16 -- common/autotest_common.sh@140 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:19.514 17:01:16 -- common/autotest_common.sh@142 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:19.514 17:01:16 -- common/autotest_common.sh@144 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:19.514 17:01:16 -- common/autotest_common.sh@146 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:19.514 17:01:16 -- common/autotest_common.sh@148 -- # : e810 00:08:19.514 17:01:16 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:19.514 17:01:16 -- common/autotest_common.sh@150 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:19.514 17:01:16 -- common/autotest_common.sh@152 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:19.514 17:01:16 -- common/autotest_common.sh@154 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:19.514 17:01:16 -- common/autotest_common.sh@156 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:19.514 17:01:16 -- common/autotest_common.sh@158 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:19.514 17:01:16 -- common/autotest_common.sh@160 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:19.514 17:01:16 -- common/autotest_common.sh@163 -- # : 00:08:19.514 17:01:16 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:19.514 17:01:16 -- common/autotest_common.sh@165 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:19.514 17:01:16 -- common/autotest_common.sh@167 -- # : 0 00:08:19.514 17:01:16 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:19.514 17:01:16 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:19.514 17:01:16 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:19.514 17:01:16 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:19.514 17:01:16 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:19.514 17:01:16 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:19.514 17:01:16 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:19.514 17:01:16 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:19.514 17:01:16 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:19.514 17:01:16 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:19.514 17:01:16 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:19.514 17:01:16 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:19.514 17:01:16 -- common/autotest_common.sh@196 -- # cat 00:08:19.514 17:01:16 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:19.514 17:01:16 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:19.514 17:01:16 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:19.514 17:01:16 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:19.514 17:01:16 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:19.514 17:01:16 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:19.514 17:01:16 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:19.514 17:01:16 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:19.514 17:01:16 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:19.514 17:01:16 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:19.514 17:01:16 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:19.514 17:01:16 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:19.514 17:01:16 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:19.514 17:01:16 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:19.514 17:01:16 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:19.514 17:01:16 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:19.514 17:01:16 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:19.514 17:01:16 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:19.514 17:01:16 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:19.514 17:01:16 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:19.514 17:01:16 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:19.514 17:01:16 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:19.514 17:01:16 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:19.514 17:01:16 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:19.514 17:01:16 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:19.514 17:01:16 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:19.514 17:01:16 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:19.514 17:01:16 -- common/autotest_common.sh@259 -- # valgrind= 00:08:19.514 17:01:16 -- common/autotest_common.sh@265 -- # uname -s 00:08:19.514 17:01:16 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:19.514 17:01:16 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:19.514 17:01:16 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:19.514 17:01:16 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:19.514 17:01:16 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:19.514 17:01:16 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:19.514 17:01:16 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:19.514 17:01:16 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:19.514 17:01:16 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:19.514 17:01:16 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:19.514 17:01:16 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:19.515 17:01:16 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:19.515 17:01:16 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:19.515 17:01:16 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:19.515 17:01:16 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:19.515 17:01:16 -- common/autotest_common.sh@319 -- # [[ -z 1639954 ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@319 -- # kill -0 1639954 00:08:19.515 17:01:16 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:19.515 17:01:16 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:19.515 17:01:16 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:19.515 17:01:16 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:19.515 17:01:16 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:19.515 17:01:16 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:19.515 17:01:16 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:19.515 17:01:16 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.6TV0U2 00:08:19.515 17:01:16 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:19.515 17:01:16 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.6TV0U2/tests/target /tmp/spdk.6TV0U2 00:08:19.515 17:01:16 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@328 -- # df -T 00:08:19.515 17:01:16 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=53223194624 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=8765308928 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991659008 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993461248 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=790528 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:19.515 17:01:16 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:19.515 17:01:16 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:19.515 17:01:16 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:19.515 17:01:16 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:19.515 * Looking for test storage... 00:08:19.515 17:01:16 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:19.515 17:01:16 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:19.515 17:01:16 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.515 17:01:16 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:19.515 17:01:16 -- common/autotest_common.sh@373 -- # mount=/ 00:08:19.515 17:01:16 -- common/autotest_common.sh@375 -- # target_space=53223194624 00:08:19.515 17:01:16 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:19.515 17:01:16 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:19.515 17:01:16 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@382 -- # new_size=10979901440 00:08:19.515 17:01:16 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:19.515 17:01:16 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.515 17:01:16 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.515 17:01:16 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.515 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:19.515 17:01:16 -- common/autotest_common.sh@390 -- # return 0 00:08:19.515 17:01:16 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:19.515 17:01:16 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:19.515 17:01:16 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:19.515 17:01:16 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:19.515 17:01:16 -- common/autotest_common.sh@1682 -- # true 00:08:19.515 17:01:16 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:19.515 17:01:16 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@27 -- # exec 00:08:19.515 17:01:16 -- common/autotest_common.sh@29 -- # exec 00:08:19.515 17:01:16 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:19.515 17:01:16 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:19.515 17:01:16 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:19.515 17:01:16 -- common/autotest_common.sh@18 -- # set -x 00:08:19.515 17:01:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:19.515 17:01:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:19.515 17:01:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:19.774 17:01:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:19.774 17:01:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:19.774 17:01:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:19.774 17:01:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:19.774 17:01:16 -- scripts/common.sh@335 -- # IFS=.-: 00:08:19.774 17:01:16 -- scripts/common.sh@335 -- # read -ra ver1 00:08:19.774 17:01:16 -- scripts/common.sh@336 -- # IFS=.-: 00:08:19.774 17:01:16 -- scripts/common.sh@336 -- # read -ra ver2 00:08:19.774 17:01:16 -- scripts/common.sh@337 -- # local 'op=<' 00:08:19.774 17:01:16 -- scripts/common.sh@339 -- # ver1_l=2 00:08:19.774 17:01:16 -- scripts/common.sh@340 -- # ver2_l=1 00:08:19.774 17:01:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:19.774 17:01:16 -- scripts/common.sh@343 -- # case "$op" in 00:08:19.774 17:01:16 -- scripts/common.sh@344 -- # : 1 00:08:19.774 17:01:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:19.774 17:01:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:19.774 17:01:16 -- scripts/common.sh@364 -- # decimal 1 00:08:19.774 17:01:16 -- scripts/common.sh@352 -- # local d=1 00:08:19.774 17:01:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:19.774 17:01:16 -- scripts/common.sh@354 -- # echo 1 00:08:19.774 17:01:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:19.774 17:01:16 -- scripts/common.sh@365 -- # decimal 2 00:08:19.774 17:01:16 -- scripts/common.sh@352 -- # local d=2 00:08:19.774 17:01:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:19.774 17:01:16 -- scripts/common.sh@354 -- # echo 2 00:08:19.774 17:01:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:19.774 17:01:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:19.774 17:01:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:19.774 17:01:16 -- scripts/common.sh@367 -- # return 0 00:08:19.774 17:01:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:19.774 17:01:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:19.774 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.775 --rc genhtml_branch_coverage=1 00:08:19.775 --rc genhtml_function_coverage=1 00:08:19.775 --rc genhtml_legend=1 00:08:19.775 --rc geninfo_all_blocks=1 00:08:19.775 --rc geninfo_unexecuted_blocks=1 00:08:19.775 00:08:19.775 ' 00:08:19.775 17:01:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:19.775 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.775 --rc genhtml_branch_coverage=1 00:08:19.775 --rc genhtml_function_coverage=1 00:08:19.775 --rc genhtml_legend=1 00:08:19.775 --rc geninfo_all_blocks=1 00:08:19.775 --rc geninfo_unexecuted_blocks=1 00:08:19.775 00:08:19.775 ' 00:08:19.775 17:01:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:19.775 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.775 --rc genhtml_branch_coverage=1 00:08:19.775 --rc genhtml_function_coverage=1 00:08:19.775 --rc genhtml_legend=1 00:08:19.775 --rc geninfo_all_blocks=1 00:08:19.775 --rc geninfo_unexecuted_blocks=1 00:08:19.775 00:08:19.775 ' 00:08:19.775 17:01:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:19.775 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:19.775 --rc genhtml_branch_coverage=1 00:08:19.775 --rc genhtml_function_coverage=1 00:08:19.775 --rc genhtml_legend=1 00:08:19.775 --rc geninfo_all_blocks=1 00:08:19.775 --rc geninfo_unexecuted_blocks=1 00:08:19.775 00:08:19.775 ' 00:08:19.775 17:01:16 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:19.775 17:01:16 -- nvmf/common.sh@7 -- # uname -s 00:08:19.775 17:01:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:19.775 17:01:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:19.775 17:01:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:19.775 17:01:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:19.775 17:01:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:19.775 17:01:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:19.775 17:01:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:19.775 17:01:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:19.775 17:01:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:19.775 17:01:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:19.775 17:01:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:19.775 17:01:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:19.775 17:01:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:19.775 17:01:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:19.775 17:01:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:19.775 17:01:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:19.775 17:01:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:19.775 17:01:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:19.775 17:01:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:19.775 17:01:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.775 17:01:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.775 17:01:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.775 17:01:16 -- paths/export.sh@5 -- # export PATH 00:08:19.775 17:01:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:19.775 17:01:16 -- nvmf/common.sh@46 -- # : 0 00:08:19.775 17:01:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:19.775 17:01:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:19.775 17:01:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:19.775 17:01:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:19.775 17:01:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:19.775 17:01:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:19.775 17:01:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:19.775 17:01:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:19.775 17:01:16 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:19.775 17:01:16 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:19.775 17:01:16 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:19.775 17:01:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:19.775 17:01:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:19.775 17:01:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:19.775 17:01:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:19.775 17:01:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:19.775 17:01:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:19.775 17:01:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:19.775 17:01:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:19.775 17:01:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:19.775 17:01:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:19.775 17:01:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:19.775 17:01:16 -- common/autotest_common.sh@10 -- # set +x 00:08:21.674 17:01:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:21.674 17:01:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:21.674 17:01:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:21.674 17:01:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:21.674 17:01:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:21.674 17:01:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:21.674 17:01:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:21.674 17:01:18 -- nvmf/common.sh@294 -- # net_devs=() 00:08:21.674 17:01:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:21.674 17:01:18 -- nvmf/common.sh@295 -- # e810=() 00:08:21.674 17:01:18 -- nvmf/common.sh@295 -- # local -ga e810 00:08:21.674 17:01:18 -- nvmf/common.sh@296 -- # x722=() 00:08:21.674 17:01:18 -- nvmf/common.sh@296 -- # local -ga x722 00:08:21.674 17:01:18 -- nvmf/common.sh@297 -- # mlx=() 00:08:21.674 17:01:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:21.674 17:01:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:21.674 17:01:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:21.674 17:01:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:21.674 17:01:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:21.674 17:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:21.674 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:21.674 17:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:21.674 17:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:21.674 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:21.674 17:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:21.674 17:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:21.674 17:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:21.674 17:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:21.674 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:21.674 17:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:21.674 17:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:21.674 17:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:21.674 17:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:21.674 17:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:21.674 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:21.674 17:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:21.674 17:01:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:21.674 17:01:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:21.674 17:01:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:21.674 17:01:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:21.674 17:01:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:21.674 17:01:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:21.674 17:01:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:21.674 17:01:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:21.674 17:01:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:21.674 17:01:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:21.674 17:01:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:21.674 17:01:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:21.674 17:01:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:21.674 17:01:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:21.674 17:01:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:21.674 17:01:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:21.933 17:01:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:21.933 17:01:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:21.933 17:01:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:21.933 17:01:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:21.933 17:01:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:21.933 17:01:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:21.933 17:01:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:21.933 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:21.933 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:08:21.933 00:08:21.933 --- 10.0.0.2 ping statistics --- 00:08:21.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:21.933 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:08:21.933 17:01:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:21.933 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:21.933 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:08:21.933 00:08:21.933 --- 10.0.0.1 ping statistics --- 00:08:21.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:21.933 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:08:21.933 17:01:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:21.933 17:01:18 -- nvmf/common.sh@410 -- # return 0 00:08:21.933 17:01:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:21.933 17:01:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:21.933 17:01:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:21.933 17:01:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:21.933 17:01:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:21.933 17:01:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:21.933 17:01:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:21.933 17:01:18 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:21.933 17:01:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:21.933 17:01:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.933 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:08:21.933 ************************************ 00:08:21.933 START TEST nvmf_filesystem_no_in_capsule 00:08:21.933 ************************************ 00:08:21.933 17:01:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:21.933 17:01:18 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:21.933 17:01:18 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:21.933 17:01:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:21.933 17:01:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:21.933 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:08:21.933 17:01:18 -- nvmf/common.sh@469 -- # nvmfpid=1641723 00:08:21.933 17:01:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:21.933 17:01:18 -- nvmf/common.sh@470 -- # waitforlisten 1641723 00:08:21.933 17:01:18 -- common/autotest_common.sh@829 -- # '[' -z 1641723 ']' 00:08:21.933 17:01:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:21.933 17:01:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:21.933 17:01:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:21.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:21.933 17:01:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:21.933 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:08:21.933 [2024-11-27 17:01:18.803610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:21.933 [2024-11-27 17:01:18.803693] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:21.933 EAL: No free 2048 kB hugepages reported on node 1 00:08:21.933 [2024-11-27 17:01:18.870109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:22.191 [2024-11-27 17:01:18.959373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:22.191 [2024-11-27 17:01:18.959538] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:22.191 [2024-11-27 17:01:18.959556] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:22.191 [2024-11-27 17:01:18.959583] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:22.191 [2024-11-27 17:01:18.959634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:22.191 [2024-11-27 17:01:18.959696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:22.191 [2024-11-27 17:01:18.959776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:22.191 [2024-11-27 17:01:18.959779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:23.161 17:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:23.161 17:01:19 -- common/autotest_common.sh@862 -- # return 0 00:08:23.161 17:01:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:23.161 17:01:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:23.161 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:08:23.161 17:01:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:23.161 17:01:19 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:23.161 17:01:19 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:23.161 17:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.161 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:08:23.161 [2024-11-27 17:01:19.862429] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:23.161 17:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.161 17:01:19 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:23.161 17:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.161 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:08:23.161 Malloc1 00:08:23.161 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.161 17:01:20 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:23.161 17:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.161 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:08:23.161 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.162 17:01:20 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:23.162 17:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.162 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:08:23.162 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.162 17:01:20 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:23.162 17:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.162 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:08:23.162 [2024-11-27 17:01:20.054634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:23.162 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.162 17:01:20 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:23.162 17:01:20 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:23.162 17:01:20 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:23.162 17:01:20 -- common/autotest_common.sh@1369 -- # local bs 00:08:23.162 17:01:20 -- common/autotest_common.sh@1370 -- # local nb 00:08:23.162 17:01:20 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:23.162 17:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:23.162 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:08:23.162 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:23.162 17:01:20 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:23.162 { 00:08:23.162 "name": "Malloc1", 00:08:23.162 "aliases": [ 00:08:23.162 "1ddc3824-5732-453b-8714-b8c77007a5a4" 00:08:23.162 ], 00:08:23.162 "product_name": "Malloc disk", 00:08:23.162 "block_size": 512, 00:08:23.162 "num_blocks": 1048576, 00:08:23.162 "uuid": "1ddc3824-5732-453b-8714-b8c77007a5a4", 00:08:23.162 "assigned_rate_limits": { 00:08:23.162 "rw_ios_per_sec": 0, 00:08:23.162 "rw_mbytes_per_sec": 0, 00:08:23.162 "r_mbytes_per_sec": 0, 00:08:23.162 "w_mbytes_per_sec": 0 00:08:23.162 }, 00:08:23.162 "claimed": true, 00:08:23.162 "claim_type": "exclusive_write", 00:08:23.162 "zoned": false, 00:08:23.162 "supported_io_types": { 00:08:23.162 "read": true, 00:08:23.162 "write": true, 00:08:23.162 "unmap": true, 00:08:23.162 "write_zeroes": true, 00:08:23.162 "flush": true, 00:08:23.162 "reset": true, 00:08:23.162 "compare": false, 00:08:23.162 "compare_and_write": false, 00:08:23.162 "abort": true, 00:08:23.162 "nvme_admin": false, 00:08:23.162 "nvme_io": false 00:08:23.162 }, 00:08:23.162 "memory_domains": [ 00:08:23.162 { 00:08:23.162 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:23.162 "dma_device_type": 2 00:08:23.162 } 00:08:23.162 ], 00:08:23.162 "driver_specific": {} 00:08:23.162 } 00:08:23.162 ]' 00:08:23.162 17:01:20 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:23.420 17:01:20 -- common/autotest_common.sh@1372 -- # bs=512 00:08:23.420 17:01:20 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:23.420 17:01:20 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:23.420 17:01:20 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:23.420 17:01:20 -- common/autotest_common.sh@1377 -- # echo 512 00:08:23.420 17:01:20 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:23.420 17:01:20 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:23.986 17:01:20 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:23.987 17:01:20 -- common/autotest_common.sh@1187 -- # local i=0 00:08:23.987 17:01:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:23.987 17:01:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:23.987 17:01:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:25.886 17:01:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:25.886 17:01:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:25.886 17:01:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:25.886 17:01:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:25.886 17:01:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:25.886 17:01:22 -- common/autotest_common.sh@1197 -- # return 0 00:08:25.886 17:01:22 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:25.886 17:01:22 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:25.886 17:01:22 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:25.886 17:01:22 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:25.886 17:01:22 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:25.886 17:01:22 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:25.886 17:01:22 -- setup/common.sh@80 -- # echo 536870912 00:08:25.886 17:01:22 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:25.886 17:01:22 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:25.886 17:01:22 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:25.886 17:01:22 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:26.452 17:01:23 -- target/filesystem.sh@69 -- # partprobe 00:08:27.018 17:01:23 -- target/filesystem.sh@70 -- # sleep 1 00:08:27.952 17:01:24 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:27.952 17:01:24 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:27.952 17:01:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:27.952 17:01:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:27.952 17:01:24 -- common/autotest_common.sh@10 -- # set +x 00:08:27.952 ************************************ 00:08:27.952 START TEST filesystem_ext4 00:08:27.952 ************************************ 00:08:27.952 17:01:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:27.952 17:01:24 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:27.952 17:01:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:27.952 17:01:24 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:27.952 17:01:24 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:27.952 17:01:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:27.952 17:01:24 -- common/autotest_common.sh@914 -- # local i=0 00:08:27.952 17:01:24 -- common/autotest_common.sh@915 -- # local force 00:08:27.952 17:01:24 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:27.952 17:01:24 -- common/autotest_common.sh@918 -- # force=-F 00:08:27.952 17:01:24 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:27.952 mke2fs 1.47.0 (5-Feb-2023) 00:08:27.952 Discarding device blocks: 0/522240 done 00:08:27.952 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:27.952 Filesystem UUID: 0281e61e-86fa-4f91-89ca-1e48073a7123 00:08:27.952 Superblock backups stored on blocks: 00:08:27.952 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:27.952 00:08:27.952 Allocating group tables: 0/64 done 00:08:27.952 Writing inode tables: 0/64 done 00:08:30.475 Creating journal (8192 blocks): done 00:08:31.556 Writing superblocks and filesystem accounting information: 0/64 4/64 done 00:08:31.556 00:08:31.556 17:01:28 -- common/autotest_common.sh@931 -- # return 0 00:08:31.556 17:01:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:38.111 17:01:34 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:38.111 17:01:34 -- target/filesystem.sh@25 -- # sync 00:08:38.111 17:01:34 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:38.111 17:01:34 -- target/filesystem.sh@27 -- # sync 00:08:38.111 17:01:34 -- target/filesystem.sh@29 -- # i=0 00:08:38.111 17:01:34 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:38.111 17:01:34 -- target/filesystem.sh@37 -- # kill -0 1641723 00:08:38.111 17:01:34 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:38.111 17:01:34 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:38.111 17:01:34 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:38.111 17:01:34 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:38.111 00:08:38.111 real 0m9.882s 00:08:38.111 user 0m0.018s 00:08:38.111 sys 0m0.065s 00:08:38.111 17:01:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:38.111 17:01:34 -- common/autotest_common.sh@10 -- # set +x 00:08:38.111 ************************************ 00:08:38.111 END TEST filesystem_ext4 00:08:38.111 ************************************ 00:08:38.111 17:01:34 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:38.111 17:01:34 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:38.111 17:01:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.111 17:01:34 -- common/autotest_common.sh@10 -- # set +x 00:08:38.111 ************************************ 00:08:38.111 START TEST filesystem_btrfs 00:08:38.111 ************************************ 00:08:38.111 17:01:34 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:38.111 17:01:34 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:38.111 17:01:34 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:38.111 17:01:34 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:38.111 17:01:34 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:38.111 17:01:34 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:38.111 17:01:34 -- common/autotest_common.sh@914 -- # local i=0 00:08:38.111 17:01:34 -- common/autotest_common.sh@915 -- # local force 00:08:38.111 17:01:34 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:38.111 17:01:34 -- common/autotest_common.sh@920 -- # force=-f 00:08:38.111 17:01:34 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:38.111 btrfs-progs v6.8.1 00:08:38.111 See https://btrfs.readthedocs.io for more information. 00:08:38.111 00:08:38.111 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:38.111 NOTE: several default settings have changed in version 5.15, please make sure 00:08:38.111 this does not affect your deployments: 00:08:38.111 - DUP for metadata (-m dup) 00:08:38.111 - enabled no-holes (-O no-holes) 00:08:38.111 - enabled free-space-tree (-R free-space-tree) 00:08:38.111 00:08:38.111 Label: (null) 00:08:38.111 UUID: 4eeb3c38-76d7-46fc-8c8f-f43f9305cb15 00:08:38.111 Node size: 16384 00:08:38.111 Sector size: 4096 (CPU page size: 4096) 00:08:38.111 Filesystem size: 510.00MiB 00:08:38.111 Block group profiles: 00:08:38.111 Data: single 8.00MiB 00:08:38.111 Metadata: DUP 32.00MiB 00:08:38.111 System: DUP 8.00MiB 00:08:38.111 SSD detected: yes 00:08:38.111 Zoned device: no 00:08:38.111 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:38.111 Checksum: crc32c 00:08:38.111 Number of devices: 1 00:08:38.111 Devices: 00:08:38.111 ID SIZE PATH 00:08:38.111 1 510.00MiB /dev/nvme0n1p1 00:08:38.111 00:08:38.111 17:01:34 -- common/autotest_common.sh@931 -- # return 0 00:08:38.111 17:01:34 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:38.676 17:01:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:38.676 17:01:35 -- target/filesystem.sh@25 -- # sync 00:08:38.676 17:01:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:38.676 17:01:35 -- target/filesystem.sh@27 -- # sync 00:08:38.676 17:01:35 -- target/filesystem.sh@29 -- # i=0 00:08:38.676 17:01:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:38.676 17:01:35 -- target/filesystem.sh@37 -- # kill -0 1641723 00:08:38.676 17:01:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:38.676 17:01:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:38.676 17:01:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:38.676 17:01:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:38.676 00:08:38.676 real 0m0.841s 00:08:38.676 user 0m0.017s 00:08:38.676 sys 0m0.113s 00:08:38.676 17:01:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:38.676 17:01:35 -- common/autotest_common.sh@10 -- # set +x 00:08:38.676 ************************************ 00:08:38.676 END TEST filesystem_btrfs 00:08:38.676 ************************************ 00:08:38.676 17:01:35 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:38.676 17:01:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:38.676 17:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.676 17:01:35 -- common/autotest_common.sh@10 -- # set +x 00:08:38.676 ************************************ 00:08:38.676 START TEST filesystem_xfs 00:08:38.676 ************************************ 00:08:38.676 17:01:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:38.676 17:01:35 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:38.676 17:01:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:38.676 17:01:35 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:38.676 17:01:35 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:38.676 17:01:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:38.676 17:01:35 -- common/autotest_common.sh@914 -- # local i=0 00:08:38.676 17:01:35 -- common/autotest_common.sh@915 -- # local force 00:08:38.676 17:01:35 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:38.676 17:01:35 -- common/autotest_common.sh@920 -- # force=-f 00:08:38.676 17:01:35 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:38.676 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:38.676 = sectsz=512 attr=2, projid32bit=1 00:08:38.676 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:38.676 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:38.676 data = bsize=4096 blocks=130560, imaxpct=25 00:08:38.676 = sunit=0 swidth=0 blks 00:08:38.676 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:38.676 log =internal log bsize=4096 blocks=16384, version=2 00:08:38.676 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:38.676 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:39.610 Discarding blocks...Done. 00:08:39.610 17:01:36 -- common/autotest_common.sh@931 -- # return 0 00:08:39.610 17:01:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:41.505 17:01:38 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:41.506 17:01:38 -- target/filesystem.sh@25 -- # sync 00:08:41.506 17:01:38 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:41.506 17:01:38 -- target/filesystem.sh@27 -- # sync 00:08:41.506 17:01:38 -- target/filesystem.sh@29 -- # i=0 00:08:41.506 17:01:38 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:41.506 17:01:38 -- target/filesystem.sh@37 -- # kill -0 1641723 00:08:41.506 17:01:38 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:41.506 17:01:38 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:41.506 17:01:38 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:41.506 17:01:38 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:41.506 00:08:41.506 real 0m2.728s 00:08:41.506 user 0m0.013s 00:08:41.506 sys 0m0.061s 00:08:41.506 17:01:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:41.506 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:41.506 ************************************ 00:08:41.506 END TEST filesystem_xfs 00:08:41.506 ************************************ 00:08:41.506 17:01:38 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:41.506 17:01:38 -- target/filesystem.sh@93 -- # sync 00:08:41.506 17:01:38 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:41.506 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.506 17:01:38 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:41.506 17:01:38 -- common/autotest_common.sh@1208 -- # local i=0 00:08:41.506 17:01:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:41.506 17:01:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:41.506 17:01:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:41.506 17:01:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:41.506 17:01:38 -- common/autotest_common.sh@1220 -- # return 0 00:08:41.506 17:01:38 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:41.506 17:01:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:41.506 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:41.506 17:01:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:41.506 17:01:38 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:41.506 17:01:38 -- target/filesystem.sh@101 -- # killprocess 1641723 00:08:41.506 17:01:38 -- common/autotest_common.sh@936 -- # '[' -z 1641723 ']' 00:08:41.506 17:01:38 -- common/autotest_common.sh@940 -- # kill -0 1641723 00:08:41.506 17:01:38 -- common/autotest_common.sh@941 -- # uname 00:08:41.506 17:01:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:41.506 17:01:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1641723 00:08:41.763 17:01:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:41.763 17:01:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:41.763 17:01:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1641723' 00:08:41.763 killing process with pid 1641723 00:08:41.763 17:01:38 -- common/autotest_common.sh@955 -- # kill 1641723 00:08:41.763 17:01:38 -- common/autotest_common.sh@960 -- # wait 1641723 00:08:42.022 17:01:38 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:42.022 00:08:42.022 real 0m20.181s 00:08:42.022 user 1m18.339s 00:08:42.022 sys 0m2.402s 00:08:42.022 17:01:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:42.022 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:42.022 ************************************ 00:08:42.022 END TEST nvmf_filesystem_no_in_capsule 00:08:42.022 ************************************ 00:08:42.022 17:01:38 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:42.022 17:01:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:42.022 17:01:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.022 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:42.022 ************************************ 00:08:42.022 START TEST nvmf_filesystem_in_capsule 00:08:42.022 ************************************ 00:08:42.022 17:01:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:42.022 17:01:38 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:42.022 17:01:38 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:42.022 17:01:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:42.022 17:01:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:42.022 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:42.281 17:01:38 -- nvmf/common.sh@469 -- # nvmfpid=1644314 00:08:42.281 17:01:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:42.281 17:01:38 -- nvmf/common.sh@470 -- # waitforlisten 1644314 00:08:42.281 17:01:38 -- common/autotest_common.sh@829 -- # '[' -z 1644314 ']' 00:08:42.281 17:01:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:42.281 17:01:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:42.281 17:01:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:42.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:42.281 17:01:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:42.281 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:08:42.281 [2024-11-27 17:01:39.018433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:42.281 [2024-11-27 17:01:39.018522] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:42.281 EAL: No free 2048 kB hugepages reported on node 1 00:08:42.281 [2024-11-27 17:01:39.087428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:42.281 [2024-11-27 17:01:39.181238] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:42.281 [2024-11-27 17:01:39.181407] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:42.281 [2024-11-27 17:01:39.181427] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:42.281 [2024-11-27 17:01:39.181441] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:42.281 [2024-11-27 17:01:39.181541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:42.281 [2024-11-27 17:01:39.181576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:42.281 [2024-11-27 17:01:39.181632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:42.281 [2024-11-27 17:01:39.181635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:43.214 17:01:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:43.214 17:01:40 -- common/autotest_common.sh@862 -- # return 0 00:08:43.214 17:01:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:43.214 17:01:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:43.214 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.214 17:01:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:43.214 17:01:40 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:43.214 17:01:40 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:43.214 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.214 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.214 [2024-11-27 17:01:40.073356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:43.214 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.214 17:01:40 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:43.214 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.214 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.473 Malloc1 00:08:43.473 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.473 17:01:40 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:43.473 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.473 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.473 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.473 17:01:40 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:43.473 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.473 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.473 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.473 17:01:40 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:43.473 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.473 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.473 [2024-11-27 17:01:40.259269] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:43.473 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.473 17:01:40 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:43.473 17:01:40 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:43.473 17:01:40 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:43.473 17:01:40 -- common/autotest_common.sh@1369 -- # local bs 00:08:43.473 17:01:40 -- common/autotest_common.sh@1370 -- # local nb 00:08:43.473 17:01:40 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:43.473 17:01:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.473 17:01:40 -- common/autotest_common.sh@10 -- # set +x 00:08:43.473 17:01:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.473 17:01:40 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:43.473 { 00:08:43.473 "name": "Malloc1", 00:08:43.473 "aliases": [ 00:08:43.473 "49d67dbf-dc2a-42a5-bd53-f1df074c608a" 00:08:43.473 ], 00:08:43.473 "product_name": "Malloc disk", 00:08:43.473 "block_size": 512, 00:08:43.473 "num_blocks": 1048576, 00:08:43.473 "uuid": "49d67dbf-dc2a-42a5-bd53-f1df074c608a", 00:08:43.473 "assigned_rate_limits": { 00:08:43.473 "rw_ios_per_sec": 0, 00:08:43.473 "rw_mbytes_per_sec": 0, 00:08:43.473 "r_mbytes_per_sec": 0, 00:08:43.473 "w_mbytes_per_sec": 0 00:08:43.473 }, 00:08:43.473 "claimed": true, 00:08:43.473 "claim_type": "exclusive_write", 00:08:43.473 "zoned": false, 00:08:43.473 "supported_io_types": { 00:08:43.473 "read": true, 00:08:43.473 "write": true, 00:08:43.473 "unmap": true, 00:08:43.473 "write_zeroes": true, 00:08:43.473 "flush": true, 00:08:43.473 "reset": true, 00:08:43.473 "compare": false, 00:08:43.473 "compare_and_write": false, 00:08:43.473 "abort": true, 00:08:43.473 "nvme_admin": false, 00:08:43.473 "nvme_io": false 00:08:43.473 }, 00:08:43.473 "memory_domains": [ 00:08:43.473 { 00:08:43.473 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:43.473 "dma_device_type": 2 00:08:43.473 } 00:08:43.473 ], 00:08:43.473 "driver_specific": {} 00:08:43.473 } 00:08:43.473 ]' 00:08:43.473 17:01:40 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:43.473 17:01:40 -- common/autotest_common.sh@1372 -- # bs=512 00:08:43.473 17:01:40 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:43.473 17:01:40 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:43.473 17:01:40 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:43.473 17:01:40 -- common/autotest_common.sh@1377 -- # echo 512 00:08:43.473 17:01:40 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:43.473 17:01:40 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:44.408 17:01:41 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:44.408 17:01:41 -- common/autotest_common.sh@1187 -- # local i=0 00:08:44.408 17:01:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:44.408 17:01:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:44.408 17:01:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:46.319 17:01:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:46.319 17:01:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:46.319 17:01:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:46.319 17:01:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:46.319 17:01:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:46.319 17:01:43 -- common/autotest_common.sh@1197 -- # return 0 00:08:46.319 17:01:43 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:46.319 17:01:43 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:46.319 17:01:43 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:46.319 17:01:43 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:46.320 17:01:43 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:46.320 17:01:43 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:46.320 17:01:43 -- setup/common.sh@80 -- # echo 536870912 00:08:46.320 17:01:43 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:46.320 17:01:43 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:46.320 17:01:43 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:46.320 17:01:43 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:46.578 17:01:43 -- target/filesystem.sh@69 -- # partprobe 00:08:47.511 17:01:44 -- target/filesystem.sh@70 -- # sleep 1 00:08:48.447 17:01:45 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:48.447 17:01:45 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:48.447 17:01:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:48.447 17:01:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:48.447 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:08:48.447 ************************************ 00:08:48.447 START TEST filesystem_in_capsule_ext4 00:08:48.447 ************************************ 00:08:48.447 17:01:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:48.447 17:01:45 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:48.447 17:01:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:48.447 17:01:45 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:48.447 17:01:45 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:48.447 17:01:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:48.447 17:01:45 -- common/autotest_common.sh@914 -- # local i=0 00:08:48.447 17:01:45 -- common/autotest_common.sh@915 -- # local force 00:08:48.447 17:01:45 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:48.447 17:01:45 -- common/autotest_common.sh@918 -- # force=-F 00:08:48.447 17:01:45 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:48.447 mke2fs 1.47.0 (5-Feb-2023) 00:08:48.447 Discarding device blocks: 0/522240 done 00:08:48.447 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:48.447 Filesystem UUID: 84f0539b-4962-440e-97a0-3c5883b0a1bd 00:08:48.447 Superblock backups stored on blocks: 00:08:48.447 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:48.447 00:08:48.447 Allocating group tables: 0/64 done 00:08:48.447 Writing inode tables: 0/64 done 00:08:48.706 Creating journal (8192 blocks): done 00:08:48.964 Writing superblocks and filesystem accounting information: 0/64 done 00:08:48.964 00:08:48.964 17:01:45 -- common/autotest_common.sh@931 -- # return 0 00:08:48.964 17:01:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:55.519 17:01:51 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:55.519 17:01:51 -- target/filesystem.sh@25 -- # sync 00:08:55.519 17:01:51 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:55.519 17:01:51 -- target/filesystem.sh@27 -- # sync 00:08:55.519 17:01:51 -- target/filesystem.sh@29 -- # i=0 00:08:55.519 17:01:51 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:55.519 17:01:51 -- target/filesystem.sh@37 -- # kill -0 1644314 00:08:55.519 17:01:51 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:55.519 17:01:51 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:55.519 17:01:51 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:55.519 17:01:51 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:55.519 00:08:55.519 real 0m6.318s 00:08:55.519 user 0m0.026s 00:08:55.519 sys 0m0.058s 00:08:55.519 17:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:55.519 17:01:51 -- common/autotest_common.sh@10 -- # set +x 00:08:55.519 ************************************ 00:08:55.519 END TEST filesystem_in_capsule_ext4 00:08:55.519 ************************************ 00:08:55.519 17:01:51 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:55.519 17:01:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:55.519 17:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:55.519 17:01:51 -- common/autotest_common.sh@10 -- # set +x 00:08:55.519 ************************************ 00:08:55.519 START TEST filesystem_in_capsule_btrfs 00:08:55.519 ************************************ 00:08:55.519 17:01:51 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:55.519 17:01:51 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:55.519 17:01:51 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:55.519 17:01:51 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:55.519 17:01:51 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:55.519 17:01:51 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:55.519 17:01:51 -- common/autotest_common.sh@914 -- # local i=0 00:08:55.519 17:01:51 -- common/autotest_common.sh@915 -- # local force 00:08:55.519 17:01:51 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:55.519 17:01:51 -- common/autotest_common.sh@920 -- # force=-f 00:08:55.519 17:01:51 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:55.519 btrfs-progs v6.8.1 00:08:55.519 See https://btrfs.readthedocs.io for more information. 00:08:55.519 00:08:55.519 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:55.519 NOTE: several default settings have changed in version 5.15, please make sure 00:08:55.519 this does not affect your deployments: 00:08:55.519 - DUP for metadata (-m dup) 00:08:55.519 - enabled no-holes (-O no-holes) 00:08:55.519 - enabled free-space-tree (-R free-space-tree) 00:08:55.519 00:08:55.519 Label: (null) 00:08:55.519 UUID: 491d52a5-1941-4a50-98ba-0f29b7a2c2ec 00:08:55.519 Node size: 16384 00:08:55.519 Sector size: 4096 (CPU page size: 4096) 00:08:55.519 Filesystem size: 510.00MiB 00:08:55.519 Block group profiles: 00:08:55.519 Data: single 8.00MiB 00:08:55.519 Metadata: DUP 32.00MiB 00:08:55.519 System: DUP 8.00MiB 00:08:55.519 SSD detected: yes 00:08:55.519 Zoned device: no 00:08:55.519 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:55.519 Checksum: crc32c 00:08:55.519 Number of devices: 1 00:08:55.519 Devices: 00:08:55.519 ID SIZE PATH 00:08:55.519 1 510.00MiB /dev/nvme0n1p1 00:08:55.519 00:08:55.519 17:01:51 -- common/autotest_common.sh@931 -- # return 0 00:08:55.519 17:01:51 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:56.086 17:01:52 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:56.086 17:01:52 -- target/filesystem.sh@25 -- # sync 00:08:56.086 17:01:52 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:56.086 17:01:52 -- target/filesystem.sh@27 -- # sync 00:08:56.086 17:01:52 -- target/filesystem.sh@29 -- # i=0 00:08:56.086 17:01:52 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:56.086 17:01:52 -- target/filesystem.sh@37 -- # kill -0 1644314 00:08:56.086 17:01:52 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:56.086 17:01:52 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:56.086 17:01:52 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:56.086 17:01:52 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:56.086 00:08:56.086 real 0m1.423s 00:08:56.086 user 0m0.013s 00:08:56.086 sys 0m0.108s 00:08:56.086 17:01:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:56.086 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:08:56.086 ************************************ 00:08:56.086 END TEST filesystem_in_capsule_btrfs 00:08:56.086 ************************************ 00:08:56.086 17:01:52 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:56.086 17:01:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:56.086 17:01:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:56.086 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:08:56.086 ************************************ 00:08:56.086 START TEST filesystem_in_capsule_xfs 00:08:56.086 ************************************ 00:08:56.086 17:01:52 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:56.086 17:01:52 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:56.086 17:01:52 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:56.086 17:01:52 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:56.086 17:01:52 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:56.086 17:01:52 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:56.086 17:01:52 -- common/autotest_common.sh@914 -- # local i=0 00:08:56.086 17:01:52 -- common/autotest_common.sh@915 -- # local force 00:08:56.086 17:01:52 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:56.086 17:01:52 -- common/autotest_common.sh@920 -- # force=-f 00:08:56.086 17:01:52 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:56.086 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:56.086 = sectsz=512 attr=2, projid32bit=1 00:08:56.086 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:56.086 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:56.086 data = bsize=4096 blocks=130560, imaxpct=25 00:08:56.086 = sunit=0 swidth=0 blks 00:08:56.086 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:56.086 log =internal log bsize=4096 blocks=16384, version=2 00:08:56.086 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:56.086 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:57.018 Discarding blocks...Done. 00:08:57.018 17:01:53 -- common/autotest_common.sh@931 -- # return 0 00:08:57.018 17:01:53 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:59.546 17:01:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:59.546 17:01:56 -- target/filesystem.sh@25 -- # sync 00:08:59.546 17:01:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:59.546 17:01:56 -- target/filesystem.sh@27 -- # sync 00:08:59.546 17:01:56 -- target/filesystem.sh@29 -- # i=0 00:08:59.546 17:01:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:59.546 17:01:56 -- target/filesystem.sh@37 -- # kill -0 1644314 00:08:59.546 17:01:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:59.546 17:01:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:59.546 17:01:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:59.546 17:01:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:59.546 00:08:59.546 real 0m3.442s 00:08:59.546 user 0m0.014s 00:08:59.546 sys 0m0.059s 00:08:59.546 17:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:59.546 17:01:56 -- common/autotest_common.sh@10 -- # set +x 00:08:59.546 ************************************ 00:08:59.546 END TEST filesystem_in_capsule_xfs 00:08:59.546 ************************************ 00:08:59.546 17:01:56 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:59.546 17:01:56 -- target/filesystem.sh@93 -- # sync 00:08:59.546 17:01:56 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:59.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.803 17:01:56 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:59.803 17:01:56 -- common/autotest_common.sh@1208 -- # local i=0 00:08:59.803 17:01:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:59.803 17:01:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:59.803 17:01:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:59.803 17:01:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:59.803 17:01:56 -- common/autotest_common.sh@1220 -- # return 0 00:08:59.803 17:01:56 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:59.803 17:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:59.803 17:01:56 -- common/autotest_common.sh@10 -- # set +x 00:08:59.803 17:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:59.803 17:01:56 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:59.803 17:01:56 -- target/filesystem.sh@101 -- # killprocess 1644314 00:08:59.803 17:01:56 -- common/autotest_common.sh@936 -- # '[' -z 1644314 ']' 00:08:59.803 17:01:56 -- common/autotest_common.sh@940 -- # kill -0 1644314 00:08:59.803 17:01:56 -- common/autotest_common.sh@941 -- # uname 00:08:59.803 17:01:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:59.803 17:01:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1644314 00:08:59.803 17:01:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:59.803 17:01:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:59.803 17:01:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1644314' 00:08:59.803 killing process with pid 1644314 00:08:59.803 17:01:56 -- common/autotest_common.sh@955 -- # kill 1644314 00:08:59.803 17:01:56 -- common/autotest_common.sh@960 -- # wait 1644314 00:09:00.371 17:01:57 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:00.371 00:09:00.371 real 0m18.054s 00:09:00.371 user 1m10.039s 00:09:00.371 sys 0m2.208s 00:09:00.371 17:01:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:00.371 17:01:57 -- common/autotest_common.sh@10 -- # set +x 00:09:00.371 ************************************ 00:09:00.371 END TEST nvmf_filesystem_in_capsule 00:09:00.371 ************************************ 00:09:00.371 17:01:57 -- target/filesystem.sh@108 -- # nvmftestfini 00:09:00.371 17:01:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:00.371 17:01:57 -- nvmf/common.sh@116 -- # sync 00:09:00.371 17:01:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:00.371 17:01:57 -- nvmf/common.sh@119 -- # set +e 00:09:00.371 17:01:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:00.371 17:01:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:00.371 rmmod nvme_tcp 00:09:00.371 rmmod nvme_fabrics 00:09:00.371 rmmod nvme_keyring 00:09:00.372 17:01:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:00.372 17:01:57 -- nvmf/common.sh@123 -- # set -e 00:09:00.372 17:01:57 -- nvmf/common.sh@124 -- # return 0 00:09:00.372 17:01:57 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:09:00.372 17:01:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:00.372 17:01:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:00.372 17:01:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:00.372 17:01:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:00.372 17:01:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:00.372 17:01:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:00.372 17:01:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:00.372 17:01:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:02.278 17:01:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:02.278 00:09:02.278 real 0m42.963s 00:09:02.278 user 2m29.499s 00:09:02.278 sys 0m6.226s 00:09:02.278 17:01:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:02.278 17:01:59 -- common/autotest_common.sh@10 -- # set +x 00:09:02.278 ************************************ 00:09:02.278 END TEST nvmf_filesystem 00:09:02.278 ************************************ 00:09:02.278 17:01:59 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:02.278 17:01:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:02.278 17:01:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:02.278 17:01:59 -- common/autotest_common.sh@10 -- # set +x 00:09:02.278 ************************************ 00:09:02.278 START TEST nvmf_discovery 00:09:02.278 ************************************ 00:09:02.278 17:01:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:02.278 * Looking for test storage... 00:09:02.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:02.536 17:01:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:02.536 17:01:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:02.536 17:01:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:02.536 17:01:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:02.536 17:01:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:02.536 17:01:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:02.536 17:01:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:02.536 17:01:59 -- scripts/common.sh@335 -- # IFS=.-: 00:09:02.536 17:01:59 -- scripts/common.sh@335 -- # read -ra ver1 00:09:02.536 17:01:59 -- scripts/common.sh@336 -- # IFS=.-: 00:09:02.536 17:01:59 -- scripts/common.sh@336 -- # read -ra ver2 00:09:02.536 17:01:59 -- scripts/common.sh@337 -- # local 'op=<' 00:09:02.536 17:01:59 -- scripts/common.sh@339 -- # ver1_l=2 00:09:02.536 17:01:59 -- scripts/common.sh@340 -- # ver2_l=1 00:09:02.536 17:01:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:02.536 17:01:59 -- scripts/common.sh@343 -- # case "$op" in 00:09:02.536 17:01:59 -- scripts/common.sh@344 -- # : 1 00:09:02.536 17:01:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:02.536 17:01:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:02.536 17:01:59 -- scripts/common.sh@364 -- # decimal 1 00:09:02.536 17:01:59 -- scripts/common.sh@352 -- # local d=1 00:09:02.536 17:01:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:02.536 17:01:59 -- scripts/common.sh@354 -- # echo 1 00:09:02.536 17:01:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:02.536 17:01:59 -- scripts/common.sh@365 -- # decimal 2 00:09:02.536 17:01:59 -- scripts/common.sh@352 -- # local d=2 00:09:02.536 17:01:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:02.536 17:01:59 -- scripts/common.sh@354 -- # echo 2 00:09:02.536 17:01:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:02.536 17:01:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:02.536 17:01:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:02.536 17:01:59 -- scripts/common.sh@367 -- # return 0 00:09:02.536 17:01:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:02.536 17:01:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:02.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.536 --rc genhtml_branch_coverage=1 00:09:02.536 --rc genhtml_function_coverage=1 00:09:02.536 --rc genhtml_legend=1 00:09:02.536 --rc geninfo_all_blocks=1 00:09:02.536 --rc geninfo_unexecuted_blocks=1 00:09:02.536 00:09:02.536 ' 00:09:02.536 17:01:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:02.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.536 --rc genhtml_branch_coverage=1 00:09:02.536 --rc genhtml_function_coverage=1 00:09:02.536 --rc genhtml_legend=1 00:09:02.536 --rc geninfo_all_blocks=1 00:09:02.536 --rc geninfo_unexecuted_blocks=1 00:09:02.536 00:09:02.536 ' 00:09:02.536 17:01:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:02.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.536 --rc genhtml_branch_coverage=1 00:09:02.536 --rc genhtml_function_coverage=1 00:09:02.536 --rc genhtml_legend=1 00:09:02.536 --rc geninfo_all_blocks=1 00:09:02.536 --rc geninfo_unexecuted_blocks=1 00:09:02.536 00:09:02.536 ' 00:09:02.536 17:01:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:02.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.536 --rc genhtml_branch_coverage=1 00:09:02.536 --rc genhtml_function_coverage=1 00:09:02.536 --rc genhtml_legend=1 00:09:02.536 --rc geninfo_all_blocks=1 00:09:02.536 --rc geninfo_unexecuted_blocks=1 00:09:02.536 00:09:02.536 ' 00:09:02.536 17:01:59 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:02.536 17:01:59 -- nvmf/common.sh@7 -- # uname -s 00:09:02.536 17:01:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:02.536 17:01:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:02.536 17:01:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:02.536 17:01:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:02.536 17:01:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:02.536 17:01:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:02.536 17:01:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:02.536 17:01:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:02.536 17:01:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:02.536 17:01:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:02.536 17:01:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:02.536 17:01:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:02.536 17:01:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:02.536 17:01:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:02.536 17:01:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:02.536 17:01:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:02.536 17:01:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:02.536 17:01:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:02.536 17:01:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:02.536 17:01:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.536 17:01:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.536 17:01:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.536 17:01:59 -- paths/export.sh@5 -- # export PATH 00:09:02.536 17:01:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.536 17:01:59 -- nvmf/common.sh@46 -- # : 0 00:09:02.536 17:01:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:02.536 17:01:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:02.536 17:01:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:02.536 17:01:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:02.536 17:01:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:02.536 17:01:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:02.536 17:01:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:02.536 17:01:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:02.536 17:01:59 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:09:02.536 17:01:59 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:09:02.536 17:01:59 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:09:02.536 17:01:59 -- target/discovery.sh@15 -- # hash nvme 00:09:02.536 17:01:59 -- target/discovery.sh@20 -- # nvmftestinit 00:09:02.536 17:01:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:02.536 17:01:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:02.536 17:01:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:02.536 17:01:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:02.536 17:01:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:02.536 17:01:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:02.536 17:01:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:02.536 17:01:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:02.536 17:01:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:02.536 17:01:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:02.536 17:01:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:02.536 17:01:59 -- common/autotest_common.sh@10 -- # set +x 00:09:05.164 17:02:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:05.164 17:02:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:05.164 17:02:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:05.164 17:02:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:05.164 17:02:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:05.164 17:02:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:05.164 17:02:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:05.164 17:02:01 -- nvmf/common.sh@294 -- # net_devs=() 00:09:05.164 17:02:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:05.164 17:02:01 -- nvmf/common.sh@295 -- # e810=() 00:09:05.164 17:02:01 -- nvmf/common.sh@295 -- # local -ga e810 00:09:05.164 17:02:01 -- nvmf/common.sh@296 -- # x722=() 00:09:05.164 17:02:01 -- nvmf/common.sh@296 -- # local -ga x722 00:09:05.164 17:02:01 -- nvmf/common.sh@297 -- # mlx=() 00:09:05.164 17:02:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:05.164 17:02:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:05.164 17:02:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:05.164 17:02:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:05.164 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:05.164 17:02:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:05.164 17:02:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:05.164 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:05.164 17:02:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:05.164 17:02:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:05.164 17:02:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:05.164 17:02:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:05.164 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:05.164 17:02:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:05.164 17:02:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:05.164 17:02:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:05.164 17:02:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:05.164 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:05.164 17:02:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:05.164 17:02:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:05.164 17:02:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:05.164 17:02:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:05.164 17:02:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:05.164 17:02:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:05.164 17:02:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:05.164 17:02:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:05.164 17:02:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:05.164 17:02:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:05.164 17:02:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:05.164 17:02:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:05.164 17:02:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:05.164 17:02:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:05.164 17:02:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:05.164 17:02:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:05.164 17:02:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:05.164 17:02:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:05.164 17:02:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:05.164 17:02:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:05.164 17:02:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:05.164 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:05.164 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.341 ms 00:09:05.164 00:09:05.164 --- 10.0.0.2 ping statistics --- 00:09:05.164 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:05.164 rtt min/avg/max/mdev = 0.341/0.341/0.341/0.000 ms 00:09:05.164 17:02:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:05.164 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:05.164 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:09:05.164 00:09:05.164 --- 10.0.0.1 ping statistics --- 00:09:05.164 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:05.164 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:09:05.164 17:02:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:05.164 17:02:01 -- nvmf/common.sh@410 -- # return 0 00:09:05.164 17:02:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:05.164 17:02:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:05.164 17:02:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:05.164 17:02:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:05.164 17:02:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:05.164 17:02:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:05.164 17:02:01 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:05.164 17:02:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:05.164 17:02:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:05.164 17:02:01 -- common/autotest_common.sh@10 -- # set +x 00:09:05.164 17:02:01 -- nvmf/common.sh@469 -- # nvmfpid=1648681 00:09:05.164 17:02:01 -- nvmf/common.sh@470 -- # waitforlisten 1648681 00:09:05.164 17:02:01 -- common/autotest_common.sh@829 -- # '[' -z 1648681 ']' 00:09:05.164 17:02:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:05.164 17:02:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:05.164 17:02:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:05.164 17:02:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:05.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:05.164 17:02:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:05.164 17:02:01 -- common/autotest_common.sh@10 -- # set +x 00:09:05.164 [2024-11-27 17:02:01.655256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:05.164 [2024-11-27 17:02:01.655349] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:05.164 EAL: No free 2048 kB hugepages reported on node 1 00:09:05.164 [2024-11-27 17:02:01.735936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:05.164 [2024-11-27 17:02:01.835934] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:05.164 [2024-11-27 17:02:01.836101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:05.164 [2024-11-27 17:02:01.836121] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:05.164 [2024-11-27 17:02:01.836136] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:05.164 [2024-11-27 17:02:01.839551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:05.164 [2024-11-27 17:02:01.839588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:05.164 [2024-11-27 17:02:01.839642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:05.164 [2024-11-27 17:02:01.839646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:06.098 17:02:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:06.098 17:02:02 -- common/autotest_common.sh@862 -- # return 0 00:09:06.098 17:02:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:06.098 17:02:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 17:02:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:06.098 17:02:02 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 [2024-11-27 17:02:02.716332] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@26 -- # seq 1 4 00:09:06.098 17:02:02 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:06.098 17:02:02 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 Null1 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 [2024-11-27 17:02:02.756698] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:06.098 17:02:02 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:06.098 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.098 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.098 Null2 00:09:06.098 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.098 17:02:02 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:06.099 17:02:02 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 Null3 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:06.099 17:02:02 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 Null4 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:09:06.099 17:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.099 17:02:02 -- common/autotest_common.sh@10 -- # set +x 00:09:06.099 17:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.099 17:02:02 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:09:06.357 00:09:06.357 Discovery Log Number of Records 6, Generation counter 6 00:09:06.357 =====Discovery Log Entry 0====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: current discovery subsystem 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4420 00:09:06.357 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: explicit discovery connections, duplicate discovery information 00:09:06.357 sectype: none 00:09:06.357 =====Discovery Log Entry 1====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: nvme subsystem 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4420 00:09:06.357 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: none 00:09:06.357 sectype: none 00:09:06.357 =====Discovery Log Entry 2====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: nvme subsystem 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4420 00:09:06.357 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: none 00:09:06.357 sectype: none 00:09:06.357 =====Discovery Log Entry 3====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: nvme subsystem 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4420 00:09:06.357 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: none 00:09:06.357 sectype: none 00:09:06.357 =====Discovery Log Entry 4====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: nvme subsystem 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4420 00:09:06.357 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: none 00:09:06.357 sectype: none 00:09:06.357 =====Discovery Log Entry 5====== 00:09:06.357 trtype: tcp 00:09:06.357 adrfam: ipv4 00:09:06.357 subtype: discovery subsystem referral 00:09:06.357 treq: not required 00:09:06.357 portid: 0 00:09:06.357 trsvcid: 4430 00:09:06.357 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:06.357 traddr: 10.0.0.2 00:09:06.357 eflags: none 00:09:06.357 sectype: none 00:09:06.357 17:02:03 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:06.357 Perform nvmf subsystem discovery via RPC 00:09:06.357 17:02:03 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:06.357 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.357 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.357 [2024-11-27 17:02:03.089556] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:06.357 [ 00:09:06.357 { 00:09:06.357 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:06.357 "subtype": "Discovery", 00:09:06.357 "listen_addresses": [ 00:09:06.357 { 00:09:06.357 "transport": "TCP", 00:09:06.357 "trtype": "TCP", 00:09:06.357 "adrfam": "IPv4", 00:09:06.357 "traddr": "10.0.0.2", 00:09:06.357 "trsvcid": "4420" 00:09:06.357 } 00:09:06.357 ], 00:09:06.357 "allow_any_host": true, 00:09:06.357 "hosts": [] 00:09:06.357 }, 00:09:06.357 { 00:09:06.357 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:06.357 "subtype": "NVMe", 00:09:06.357 "listen_addresses": [ 00:09:06.357 { 00:09:06.357 "transport": "TCP", 00:09:06.357 "trtype": "TCP", 00:09:06.357 "adrfam": "IPv4", 00:09:06.357 "traddr": "10.0.0.2", 00:09:06.357 "trsvcid": "4420" 00:09:06.357 } 00:09:06.357 ], 00:09:06.357 "allow_any_host": true, 00:09:06.357 "hosts": [], 00:09:06.357 "serial_number": "SPDK00000000000001", 00:09:06.357 "model_number": "SPDK bdev Controller", 00:09:06.357 "max_namespaces": 32, 00:09:06.357 "min_cntlid": 1, 00:09:06.357 "max_cntlid": 65519, 00:09:06.357 "namespaces": [ 00:09:06.357 { 00:09:06.357 "nsid": 1, 00:09:06.357 "bdev_name": "Null1", 00:09:06.357 "name": "Null1", 00:09:06.357 "nguid": "35F9D640F22F4623A2ACE656671E2C5B", 00:09:06.357 "uuid": "35f9d640-f22f-4623-a2ac-e656671e2c5b" 00:09:06.357 } 00:09:06.357 ] 00:09:06.357 }, 00:09:06.357 { 00:09:06.357 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:06.357 "subtype": "NVMe", 00:09:06.357 "listen_addresses": [ 00:09:06.357 { 00:09:06.358 "transport": "TCP", 00:09:06.358 "trtype": "TCP", 00:09:06.358 "adrfam": "IPv4", 00:09:06.358 "traddr": "10.0.0.2", 00:09:06.358 "trsvcid": "4420" 00:09:06.358 } 00:09:06.358 ], 00:09:06.358 "allow_any_host": true, 00:09:06.358 "hosts": [], 00:09:06.358 "serial_number": "SPDK00000000000002", 00:09:06.358 "model_number": "SPDK bdev Controller", 00:09:06.358 "max_namespaces": 32, 00:09:06.358 "min_cntlid": 1, 00:09:06.358 "max_cntlid": 65519, 00:09:06.358 "namespaces": [ 00:09:06.358 { 00:09:06.358 "nsid": 1, 00:09:06.358 "bdev_name": "Null2", 00:09:06.358 "name": "Null2", 00:09:06.358 "nguid": "AAEEEF19C94745468167A932C5ACCA82", 00:09:06.358 "uuid": "aaeeef19-c947-4546-8167-a932c5acca82" 00:09:06.358 } 00:09:06.358 ] 00:09:06.358 }, 00:09:06.358 { 00:09:06.358 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:06.358 "subtype": "NVMe", 00:09:06.358 "listen_addresses": [ 00:09:06.358 { 00:09:06.358 "transport": "TCP", 00:09:06.358 "trtype": "TCP", 00:09:06.358 "adrfam": "IPv4", 00:09:06.358 "traddr": "10.0.0.2", 00:09:06.358 "trsvcid": "4420" 00:09:06.358 } 00:09:06.358 ], 00:09:06.358 "allow_any_host": true, 00:09:06.358 "hosts": [], 00:09:06.358 "serial_number": "SPDK00000000000003", 00:09:06.358 "model_number": "SPDK bdev Controller", 00:09:06.358 "max_namespaces": 32, 00:09:06.358 "min_cntlid": 1, 00:09:06.358 "max_cntlid": 65519, 00:09:06.358 "namespaces": [ 00:09:06.358 { 00:09:06.358 "nsid": 1, 00:09:06.358 "bdev_name": "Null3", 00:09:06.358 "name": "Null3", 00:09:06.358 "nguid": "BD367275E5764A288F4E8CEBF669D96E", 00:09:06.358 "uuid": "bd367275-e576-4a28-8f4e-8cebf669d96e" 00:09:06.358 } 00:09:06.358 ] 00:09:06.358 }, 00:09:06.358 { 00:09:06.358 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:06.358 "subtype": "NVMe", 00:09:06.358 "listen_addresses": [ 00:09:06.358 { 00:09:06.358 "transport": "TCP", 00:09:06.358 "trtype": "TCP", 00:09:06.358 "adrfam": "IPv4", 00:09:06.358 "traddr": "10.0.0.2", 00:09:06.358 "trsvcid": "4420" 00:09:06.358 } 00:09:06.358 ], 00:09:06.358 "allow_any_host": true, 00:09:06.358 "hosts": [], 00:09:06.358 "serial_number": "SPDK00000000000004", 00:09:06.358 "model_number": "SPDK bdev Controller", 00:09:06.358 "max_namespaces": 32, 00:09:06.358 "min_cntlid": 1, 00:09:06.358 "max_cntlid": 65519, 00:09:06.358 "namespaces": [ 00:09:06.358 { 00:09:06.358 "nsid": 1, 00:09:06.358 "bdev_name": "Null4", 00:09:06.358 "name": "Null4", 00:09:06.358 "nguid": "DC1D78836FEC417CAC314DA8C61319E4", 00:09:06.358 "uuid": "dc1d7883-6fec-417c-ac31-4da8c61319e4" 00:09:06.358 } 00:09:06.358 ] 00:09:06.358 } 00:09:06.358 ] 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@42 -- # seq 1 4 00:09:06.358 17:02:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:06.358 17:02:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:06.358 17:02:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:06.358 17:02:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:06.358 17:02:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:06.358 17:02:03 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:06.358 17:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:06.358 17:02:03 -- common/autotest_common.sh@10 -- # set +x 00:09:06.358 17:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:06.358 17:02:03 -- target/discovery.sh@49 -- # check_bdevs= 00:09:06.358 17:02:03 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:06.358 17:02:03 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:06.358 17:02:03 -- target/discovery.sh@57 -- # nvmftestfini 00:09:06.358 17:02:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:06.358 17:02:03 -- nvmf/common.sh@116 -- # sync 00:09:06.358 17:02:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:06.358 17:02:03 -- nvmf/common.sh@119 -- # set +e 00:09:06.358 17:02:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:06.358 17:02:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:06.358 rmmod nvme_tcp 00:09:06.358 rmmod nvme_fabrics 00:09:06.358 rmmod nvme_keyring 00:09:06.358 17:02:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:06.358 17:02:03 -- nvmf/common.sh@123 -- # set -e 00:09:06.358 17:02:03 -- nvmf/common.sh@124 -- # return 0 00:09:06.358 17:02:03 -- nvmf/common.sh@477 -- # '[' -n 1648681 ']' 00:09:06.358 17:02:03 -- nvmf/common.sh@478 -- # killprocess 1648681 00:09:06.358 17:02:03 -- common/autotest_common.sh@936 -- # '[' -z 1648681 ']' 00:09:06.358 17:02:03 -- common/autotest_common.sh@940 -- # kill -0 1648681 00:09:06.358 17:02:03 -- common/autotest_common.sh@941 -- # uname 00:09:06.358 17:02:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:06.358 17:02:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1648681 00:09:06.358 17:02:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:06.358 17:02:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:06.358 17:02:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1648681' 00:09:06.358 killing process with pid 1648681 00:09:06.358 17:02:03 -- common/autotest_common.sh@955 -- # kill 1648681 00:09:06.358 [2024-11-27 17:02:03.302145] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:06.358 17:02:03 -- common/autotest_common.sh@960 -- # wait 1648681 00:09:06.617 17:02:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:06.617 17:02:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:06.617 17:02:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:06.617 17:02:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:06.617 17:02:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:06.617 17:02:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:06.617 17:02:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:06.617 17:02:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:09.158 17:02:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:09.158 00:09:09.158 real 0m6.382s 00:09:09.158 user 0m7.886s 00:09:09.158 sys 0m1.931s 00:09:09.158 17:02:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:09.158 17:02:05 -- common/autotest_common.sh@10 -- # set +x 00:09:09.159 ************************************ 00:09:09.159 END TEST nvmf_discovery 00:09:09.159 ************************************ 00:09:09.159 17:02:05 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:09.159 17:02:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:09.159 17:02:05 -- common/autotest_common.sh@10 -- # set +x 00:09:09.159 ************************************ 00:09:09.159 START TEST nvmf_referrals 00:09:09.159 ************************************ 00:09:09.159 17:02:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:09.159 * Looking for test storage... 00:09:09.159 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:09.159 17:02:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:09.159 17:02:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:09.159 17:02:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:09.159 17:02:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:09.159 17:02:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:09.159 17:02:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:09.159 17:02:05 -- scripts/common.sh@335 -- # IFS=.-: 00:09:09.159 17:02:05 -- scripts/common.sh@335 -- # read -ra ver1 00:09:09.159 17:02:05 -- scripts/common.sh@336 -- # IFS=.-: 00:09:09.159 17:02:05 -- scripts/common.sh@336 -- # read -ra ver2 00:09:09.159 17:02:05 -- scripts/common.sh@337 -- # local 'op=<' 00:09:09.159 17:02:05 -- scripts/common.sh@339 -- # ver1_l=2 00:09:09.159 17:02:05 -- scripts/common.sh@340 -- # ver2_l=1 00:09:09.159 17:02:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:09.159 17:02:05 -- scripts/common.sh@343 -- # case "$op" in 00:09:09.159 17:02:05 -- scripts/common.sh@344 -- # : 1 00:09:09.159 17:02:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:09.159 17:02:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:09.159 17:02:05 -- scripts/common.sh@364 -- # decimal 1 00:09:09.159 17:02:05 -- scripts/common.sh@352 -- # local d=1 00:09:09.159 17:02:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:09.159 17:02:05 -- scripts/common.sh@354 -- # echo 1 00:09:09.159 17:02:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:09.159 17:02:05 -- scripts/common.sh@365 -- # decimal 2 00:09:09.159 17:02:05 -- scripts/common.sh@352 -- # local d=2 00:09:09.159 17:02:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:09.159 17:02:05 -- scripts/common.sh@354 -- # echo 2 00:09:09.159 17:02:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:09.159 17:02:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:09.159 17:02:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:09.159 17:02:05 -- scripts/common.sh@367 -- # return 0 00:09:09.159 17:02:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:09.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.159 --rc genhtml_branch_coverage=1 00:09:09.159 --rc genhtml_function_coverage=1 00:09:09.159 --rc genhtml_legend=1 00:09:09.159 --rc geninfo_all_blocks=1 00:09:09.159 --rc geninfo_unexecuted_blocks=1 00:09:09.159 00:09:09.159 ' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:09.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.159 --rc genhtml_branch_coverage=1 00:09:09.159 --rc genhtml_function_coverage=1 00:09:09.159 --rc genhtml_legend=1 00:09:09.159 --rc geninfo_all_blocks=1 00:09:09.159 --rc geninfo_unexecuted_blocks=1 00:09:09.159 00:09:09.159 ' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:09.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.159 --rc genhtml_branch_coverage=1 00:09:09.159 --rc genhtml_function_coverage=1 00:09:09.159 --rc genhtml_legend=1 00:09:09.159 --rc geninfo_all_blocks=1 00:09:09.159 --rc geninfo_unexecuted_blocks=1 00:09:09.159 00:09:09.159 ' 00:09:09.159 17:02:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:09.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.159 --rc genhtml_branch_coverage=1 00:09:09.159 --rc genhtml_function_coverage=1 00:09:09.159 --rc genhtml_legend=1 00:09:09.159 --rc geninfo_all_blocks=1 00:09:09.159 --rc geninfo_unexecuted_blocks=1 00:09:09.159 00:09:09.159 ' 00:09:09.159 17:02:05 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:09.159 17:02:05 -- nvmf/common.sh@7 -- # uname -s 00:09:09.159 17:02:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:09.159 17:02:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:09.159 17:02:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:09.159 17:02:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:09.159 17:02:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:09.159 17:02:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:09.159 17:02:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:09.159 17:02:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:09.159 17:02:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:09.159 17:02:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:09.159 17:02:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:09.159 17:02:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:09.159 17:02:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:09.159 17:02:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:09.159 17:02:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:09.159 17:02:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:09.159 17:02:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:09.159 17:02:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:09.159 17:02:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:09.159 17:02:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.159 17:02:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.159 17:02:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.159 17:02:05 -- paths/export.sh@5 -- # export PATH 00:09:09.159 17:02:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.159 17:02:05 -- nvmf/common.sh@46 -- # : 0 00:09:09.159 17:02:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:09.159 17:02:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:09.159 17:02:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:09.159 17:02:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:09.159 17:02:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:09.159 17:02:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:09.159 17:02:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:09.159 17:02:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:09.159 17:02:05 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:09.159 17:02:05 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:09.159 17:02:05 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:09.159 17:02:05 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:09.159 17:02:05 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:09.159 17:02:05 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:09.159 17:02:05 -- target/referrals.sh@37 -- # nvmftestinit 00:09:09.159 17:02:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:09.159 17:02:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:09.159 17:02:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:09.159 17:02:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:09.159 17:02:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:09.159 17:02:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:09.159 17:02:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:09.159 17:02:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:09.159 17:02:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:09.159 17:02:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:09.159 17:02:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:09.159 17:02:05 -- common/autotest_common.sh@10 -- # set +x 00:09:11.062 17:02:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:11.062 17:02:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:11.062 17:02:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:11.062 17:02:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:11.062 17:02:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:11.062 17:02:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:11.062 17:02:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:11.062 17:02:07 -- nvmf/common.sh@294 -- # net_devs=() 00:09:11.062 17:02:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:11.062 17:02:07 -- nvmf/common.sh@295 -- # e810=() 00:09:11.062 17:02:07 -- nvmf/common.sh@295 -- # local -ga e810 00:09:11.062 17:02:07 -- nvmf/common.sh@296 -- # x722=() 00:09:11.062 17:02:07 -- nvmf/common.sh@296 -- # local -ga x722 00:09:11.062 17:02:07 -- nvmf/common.sh@297 -- # mlx=() 00:09:11.062 17:02:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:11.062 17:02:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:11.062 17:02:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:11.062 17:02:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:11.062 17:02:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:11.062 17:02:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:11.062 17:02:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:11.062 17:02:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:11.062 17:02:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:11.062 17:02:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:11.062 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:11.062 17:02:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:11.062 17:02:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:11.062 17:02:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:11.063 17:02:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:11.063 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:11.063 17:02:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:11.063 17:02:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:11.063 17:02:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:11.063 17:02:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:11.063 17:02:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:11.063 17:02:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:11.063 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:11.063 17:02:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:11.063 17:02:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:11.063 17:02:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:11.063 17:02:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:11.063 17:02:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:11.063 17:02:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:11.063 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:11.063 17:02:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:11.063 17:02:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:11.063 17:02:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:11.063 17:02:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:11.063 17:02:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:11.063 17:02:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:11.063 17:02:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:11.063 17:02:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:11.063 17:02:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:11.063 17:02:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:11.063 17:02:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:11.063 17:02:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:11.063 17:02:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:11.063 17:02:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:11.063 17:02:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:11.063 17:02:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:11.063 17:02:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:11.063 17:02:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:11.322 17:02:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:11.322 17:02:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:11.322 17:02:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:11.322 17:02:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:11.322 17:02:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:11.322 17:02:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:11.322 17:02:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:11.322 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:11.322 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:09:11.322 00:09:11.322 --- 10.0.0.2 ping statistics --- 00:09:11.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:11.322 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:09:11.322 17:02:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:11.322 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:11.322 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:09:11.322 00:09:11.322 --- 10.0.0.1 ping statistics --- 00:09:11.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:11.322 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:09:11.322 17:02:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:11.322 17:02:08 -- nvmf/common.sh@410 -- # return 0 00:09:11.322 17:02:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:11.322 17:02:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:11.322 17:02:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:11.322 17:02:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:11.322 17:02:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:11.322 17:02:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:11.322 17:02:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:11.322 17:02:08 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:11.322 17:02:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:11.322 17:02:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:11.322 17:02:08 -- common/autotest_common.sh@10 -- # set +x 00:09:11.322 17:02:08 -- nvmf/common.sh@469 -- # nvmfpid=1650935 00:09:11.322 17:02:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:11.322 17:02:08 -- nvmf/common.sh@470 -- # waitforlisten 1650935 00:09:11.322 17:02:08 -- common/autotest_common.sh@829 -- # '[' -z 1650935 ']' 00:09:11.322 17:02:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:11.322 17:02:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:11.322 17:02:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:11.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:11.322 17:02:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:11.322 17:02:08 -- common/autotest_common.sh@10 -- # set +x 00:09:11.322 [2024-11-27 17:02:08.154615] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:11.322 [2024-11-27 17:02:08.154683] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:11.322 EAL: No free 2048 kB hugepages reported on node 1 00:09:11.322 [2024-11-27 17:02:08.218044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:11.580 [2024-11-27 17:02:08.307448] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:11.581 [2024-11-27 17:02:08.307636] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:11.581 [2024-11-27 17:02:08.307657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:11.581 [2024-11-27 17:02:08.307672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:11.581 [2024-11-27 17:02:08.307751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:11.581 [2024-11-27 17:02:08.307820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:11.581 [2024-11-27 17:02:08.307870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:11.581 [2024-11-27 17:02:08.307873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:12.513 17:02:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:12.513 17:02:09 -- common/autotest_common.sh@862 -- # return 0 00:09:12.513 17:02:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:12.513 17:02:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 17:02:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:12.513 17:02:09 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 [2024-11-27 17:02:09.191361] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 [2024-11-27 17:02:09.203643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:12.513 17:02:09 -- target/referrals.sh@48 -- # jq length 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.513 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.513 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.513 17:02:09 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:12.513 17:02:09 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:12.513 17:02:09 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:12.513 17:02:09 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:12.513 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.514 17:02:09 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:12.514 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.514 17:02:09 -- target/referrals.sh@21 -- # sort 00:09:12.514 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.514 17:02:09 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:12.514 17:02:09 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:12.514 17:02:09 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:12.514 17:02:09 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:12.514 17:02:09 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:12.514 17:02:09 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:12.514 17:02:09 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:12.514 17:02:09 -- target/referrals.sh@26 -- # sort 00:09:12.771 17:02:09 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:12.771 17:02:09 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:12.771 17:02:09 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:12.771 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.771 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.771 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.771 17:02:09 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:12.771 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.771 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.771 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.771 17:02:09 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:12.771 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.771 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.771 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.771 17:02:09 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:12.771 17:02:09 -- target/referrals.sh@56 -- # jq length 00:09:12.771 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.771 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:12.771 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.771 17:02:09 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:12.771 17:02:09 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:12.771 17:02:09 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:12.771 17:02:09 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:12.771 17:02:09 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:12.771 17:02:09 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:12.771 17:02:09 -- target/referrals.sh@26 -- # sort 00:09:13.029 17:02:09 -- target/referrals.sh@26 -- # echo 00:09:13.029 17:02:09 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:13.029 17:02:09 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:13.029 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.029 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:13.029 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.029 17:02:09 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:13.029 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.029 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:13.029 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.029 17:02:09 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:13.029 17:02:09 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:13.029 17:02:09 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:13.029 17:02:09 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:13.029 17:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.029 17:02:09 -- common/autotest_common.sh@10 -- # set +x 00:09:13.029 17:02:09 -- target/referrals.sh@21 -- # sort 00:09:13.029 17:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.029 17:02:09 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:13.029 17:02:09 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:13.029 17:02:09 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:13.029 17:02:09 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:13.029 17:02:09 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:13.029 17:02:09 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.029 17:02:09 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:13.029 17:02:09 -- target/referrals.sh@26 -- # sort 00:09:13.287 17:02:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:13.287 17:02:10 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:13.287 17:02:10 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:13.287 17:02:10 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:13.287 17:02:10 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:13.287 17:02:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.287 17:02:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:13.287 17:02:10 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:13.287 17:02:10 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:13.287 17:02:10 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:13.287 17:02:10 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:13.287 17:02:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.287 17:02:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:13.545 17:02:10 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:13.545 17:02:10 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:13.545 17:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.545 17:02:10 -- common/autotest_common.sh@10 -- # set +x 00:09:13.545 17:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.545 17:02:10 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:13.545 17:02:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:13.545 17:02:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:13.545 17:02:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:13.545 17:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.545 17:02:10 -- common/autotest_common.sh@10 -- # set +x 00:09:13.545 17:02:10 -- target/referrals.sh@21 -- # sort 00:09:13.545 17:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.545 17:02:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:13.545 17:02:10 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:13.545 17:02:10 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:13.545 17:02:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:13.545 17:02:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:13.545 17:02:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.545 17:02:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:13.545 17:02:10 -- target/referrals.sh@26 -- # sort 00:09:13.802 17:02:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:13.802 17:02:10 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:13.802 17:02:10 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:13.802 17:02:10 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:13.802 17:02:10 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:13.802 17:02:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.802 17:02:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:13.802 17:02:10 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:13.802 17:02:10 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:13.802 17:02:10 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:13.802 17:02:10 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:13.802 17:02:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:13.802 17:02:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:14.061 17:02:10 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:14.061 17:02:10 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:14.061 17:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:14.061 17:02:10 -- common/autotest_common.sh@10 -- # set +x 00:09:14.061 17:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:14.061 17:02:10 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:14.061 17:02:10 -- target/referrals.sh@82 -- # jq length 00:09:14.061 17:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:14.061 17:02:10 -- common/autotest_common.sh@10 -- # set +x 00:09:14.061 17:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:14.061 17:02:10 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:14.061 17:02:10 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:14.061 17:02:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:14.061 17:02:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:14.061 17:02:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:14.061 17:02:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:14.061 17:02:10 -- target/referrals.sh@26 -- # sort 00:09:14.319 17:02:11 -- target/referrals.sh@26 -- # echo 00:09:14.319 17:02:11 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:14.319 17:02:11 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:14.319 17:02:11 -- target/referrals.sh@86 -- # nvmftestfini 00:09:14.319 17:02:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:14.319 17:02:11 -- nvmf/common.sh@116 -- # sync 00:09:14.319 17:02:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:14.319 17:02:11 -- nvmf/common.sh@119 -- # set +e 00:09:14.319 17:02:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:14.319 17:02:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:14.319 rmmod nvme_tcp 00:09:14.319 rmmod nvme_fabrics 00:09:14.319 rmmod nvme_keyring 00:09:14.319 17:02:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:14.319 17:02:11 -- nvmf/common.sh@123 -- # set -e 00:09:14.319 17:02:11 -- nvmf/common.sh@124 -- # return 0 00:09:14.319 17:02:11 -- nvmf/common.sh@477 -- # '[' -n 1650935 ']' 00:09:14.319 17:02:11 -- nvmf/common.sh@478 -- # killprocess 1650935 00:09:14.319 17:02:11 -- common/autotest_common.sh@936 -- # '[' -z 1650935 ']' 00:09:14.319 17:02:11 -- common/autotest_common.sh@940 -- # kill -0 1650935 00:09:14.319 17:02:11 -- common/autotest_common.sh@941 -- # uname 00:09:14.319 17:02:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:14.319 17:02:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1650935 00:09:14.319 17:02:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:14.319 17:02:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:14.319 17:02:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1650935' 00:09:14.319 killing process with pid 1650935 00:09:14.319 17:02:11 -- common/autotest_common.sh@955 -- # kill 1650935 00:09:14.319 17:02:11 -- common/autotest_common.sh@960 -- # wait 1650935 00:09:14.577 17:02:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:14.577 17:02:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:14.577 17:02:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:14.577 17:02:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:14.577 17:02:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:14.577 17:02:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:14.577 17:02:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:14.577 17:02:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:17.111 17:02:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:17.111 00:09:17.111 real 0m7.848s 00:09:17.111 user 0m14.030s 00:09:17.111 sys 0m2.410s 00:09:17.111 17:02:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:17.111 17:02:13 -- common/autotest_common.sh@10 -- # set +x 00:09:17.111 ************************************ 00:09:17.111 END TEST nvmf_referrals 00:09:17.111 ************************************ 00:09:17.111 17:02:13 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:17.111 17:02:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:17.111 17:02:13 -- common/autotest_common.sh@10 -- # set +x 00:09:17.111 ************************************ 00:09:17.111 START TEST nvmf_connect_disconnect 00:09:17.111 ************************************ 00:09:17.111 17:02:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:17.111 * Looking for test storage... 00:09:17.111 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:17.111 17:02:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:17.111 17:02:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:17.111 17:02:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:17.111 17:02:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:17.111 17:02:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:17.111 17:02:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:17.111 17:02:13 -- scripts/common.sh@335 -- # IFS=.-: 00:09:17.111 17:02:13 -- scripts/common.sh@335 -- # read -ra ver1 00:09:17.111 17:02:13 -- scripts/common.sh@336 -- # IFS=.-: 00:09:17.111 17:02:13 -- scripts/common.sh@336 -- # read -ra ver2 00:09:17.111 17:02:13 -- scripts/common.sh@337 -- # local 'op=<' 00:09:17.111 17:02:13 -- scripts/common.sh@339 -- # ver1_l=2 00:09:17.111 17:02:13 -- scripts/common.sh@340 -- # ver2_l=1 00:09:17.111 17:02:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:17.111 17:02:13 -- scripts/common.sh@343 -- # case "$op" in 00:09:17.111 17:02:13 -- scripts/common.sh@344 -- # : 1 00:09:17.111 17:02:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:17.111 17:02:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:17.111 17:02:13 -- scripts/common.sh@364 -- # decimal 1 00:09:17.111 17:02:13 -- scripts/common.sh@352 -- # local d=1 00:09:17.111 17:02:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:17.111 17:02:13 -- scripts/common.sh@354 -- # echo 1 00:09:17.111 17:02:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:17.111 17:02:13 -- scripts/common.sh@365 -- # decimal 2 00:09:17.111 17:02:13 -- scripts/common.sh@352 -- # local d=2 00:09:17.111 17:02:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:17.111 17:02:13 -- scripts/common.sh@354 -- # echo 2 00:09:17.111 17:02:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:17.111 17:02:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:17.111 17:02:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:17.111 17:02:13 -- scripts/common.sh@367 -- # return 0 00:09:17.111 17:02:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:17.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:17.111 --rc genhtml_branch_coverage=1 00:09:17.111 --rc genhtml_function_coverage=1 00:09:17.111 --rc genhtml_legend=1 00:09:17.111 --rc geninfo_all_blocks=1 00:09:17.111 --rc geninfo_unexecuted_blocks=1 00:09:17.111 00:09:17.111 ' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:17.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:17.111 --rc genhtml_branch_coverage=1 00:09:17.111 --rc genhtml_function_coverage=1 00:09:17.111 --rc genhtml_legend=1 00:09:17.111 --rc geninfo_all_blocks=1 00:09:17.111 --rc geninfo_unexecuted_blocks=1 00:09:17.111 00:09:17.111 ' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:17.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:17.111 --rc genhtml_branch_coverage=1 00:09:17.111 --rc genhtml_function_coverage=1 00:09:17.111 --rc genhtml_legend=1 00:09:17.111 --rc geninfo_all_blocks=1 00:09:17.111 --rc geninfo_unexecuted_blocks=1 00:09:17.111 00:09:17.111 ' 00:09:17.111 17:02:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:17.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:17.111 --rc genhtml_branch_coverage=1 00:09:17.112 --rc genhtml_function_coverage=1 00:09:17.112 --rc genhtml_legend=1 00:09:17.112 --rc geninfo_all_blocks=1 00:09:17.112 --rc geninfo_unexecuted_blocks=1 00:09:17.112 00:09:17.112 ' 00:09:17.112 17:02:13 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:17.112 17:02:13 -- nvmf/common.sh@7 -- # uname -s 00:09:17.112 17:02:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:17.112 17:02:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:17.112 17:02:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:17.112 17:02:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:17.112 17:02:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:17.112 17:02:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:17.112 17:02:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:17.112 17:02:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:17.112 17:02:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:17.112 17:02:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:17.112 17:02:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:17.112 17:02:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:17.112 17:02:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:17.112 17:02:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:17.112 17:02:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:17.112 17:02:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:17.112 17:02:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:17.112 17:02:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:17.112 17:02:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:17.112 17:02:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:17.112 17:02:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:17.112 17:02:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:17.112 17:02:13 -- paths/export.sh@5 -- # export PATH 00:09:17.112 17:02:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:17.112 17:02:13 -- nvmf/common.sh@46 -- # : 0 00:09:17.112 17:02:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:17.112 17:02:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:17.112 17:02:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:17.112 17:02:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:17.112 17:02:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:17.112 17:02:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:17.112 17:02:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:17.112 17:02:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:17.112 17:02:13 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:17.112 17:02:13 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:17.112 17:02:13 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:17.112 17:02:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:17.112 17:02:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:17.112 17:02:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:17.112 17:02:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:17.112 17:02:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:17.112 17:02:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:17.112 17:02:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:17.112 17:02:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:17.112 17:02:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:17.112 17:02:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:17.112 17:02:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:17.112 17:02:13 -- common/autotest_common.sh@10 -- # set +x 00:09:19.014 17:02:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:19.014 17:02:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:19.014 17:02:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:19.014 17:02:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:19.014 17:02:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:19.014 17:02:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:19.014 17:02:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:19.014 17:02:15 -- nvmf/common.sh@294 -- # net_devs=() 00:09:19.014 17:02:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:19.014 17:02:15 -- nvmf/common.sh@295 -- # e810=() 00:09:19.014 17:02:15 -- nvmf/common.sh@295 -- # local -ga e810 00:09:19.014 17:02:15 -- nvmf/common.sh@296 -- # x722=() 00:09:19.014 17:02:15 -- nvmf/common.sh@296 -- # local -ga x722 00:09:19.014 17:02:15 -- nvmf/common.sh@297 -- # mlx=() 00:09:19.014 17:02:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:19.014 17:02:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:19.014 17:02:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:19.014 17:02:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:19.014 17:02:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:19.014 17:02:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:19.014 17:02:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:19.014 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:19.014 17:02:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:19.014 17:02:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:19.014 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:19.014 17:02:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:19.014 17:02:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:19.014 17:02:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:19.014 17:02:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:19.014 17:02:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:19.014 17:02:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:19.014 17:02:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:19.014 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:19.014 17:02:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:19.014 17:02:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:19.014 17:02:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:19.014 17:02:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:19.014 17:02:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:19.014 17:02:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:19.014 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:19.014 17:02:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:19.014 17:02:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:19.014 17:02:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:19.014 17:02:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:19.015 17:02:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:19.015 17:02:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:19.015 17:02:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:19.015 17:02:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:19.015 17:02:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:19.015 17:02:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:19.015 17:02:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:19.015 17:02:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:19.015 17:02:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:19.015 17:02:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:19.015 17:02:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:19.015 17:02:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:19.015 17:02:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:19.015 17:02:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:19.015 17:02:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:19.015 17:02:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:19.015 17:02:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:19.015 17:02:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:19.015 17:02:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:19.015 17:02:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:19.015 17:02:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:19.015 17:02:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:19.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:19.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:09:19.015 00:09:19.015 --- 10.0.0.2 ping statistics --- 00:09:19.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:19.015 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:09:19.015 17:02:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:19.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:19.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:09:19.015 00:09:19.015 --- 10.0.0.1 ping statistics --- 00:09:19.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:19.015 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:09:19.015 17:02:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:19.015 17:02:15 -- nvmf/common.sh@410 -- # return 0 00:09:19.015 17:02:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:19.015 17:02:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:19.015 17:02:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:19.015 17:02:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:19.015 17:02:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:19.015 17:02:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:19.015 17:02:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:19.015 17:02:15 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:19.015 17:02:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:19.015 17:02:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:19.015 17:02:15 -- common/autotest_common.sh@10 -- # set +x 00:09:19.015 17:02:15 -- nvmf/common.sh@469 -- # nvmfpid=1653388 00:09:19.015 17:02:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:19.015 17:02:15 -- nvmf/common.sh@470 -- # waitforlisten 1653388 00:09:19.015 17:02:15 -- common/autotest_common.sh@829 -- # '[' -z 1653388 ']' 00:09:19.015 17:02:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:19.015 17:02:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:19.015 17:02:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:19.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:19.015 17:02:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:19.015 17:02:15 -- common/autotest_common.sh@10 -- # set +x 00:09:19.015 [2024-11-27 17:02:15.824013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:19.015 [2024-11-27 17:02:15.824108] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:19.015 EAL: No free 2048 kB hugepages reported on node 1 00:09:19.015 [2024-11-27 17:02:15.893304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:19.273 [2024-11-27 17:02:15.986693] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:19.273 [2024-11-27 17:02:15.986866] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:19.273 [2024-11-27 17:02:15.986886] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:19.273 [2024-11-27 17:02:15.986900] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:19.273 [2024-11-27 17:02:15.986999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:19.273 [2024-11-27 17:02:15.987057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:19.273 [2024-11-27 17:02:15.987113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:19.273 [2024-11-27 17:02:15.987116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:20.208 17:02:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:20.208 17:02:16 -- common/autotest_common.sh@862 -- # return 0 00:09:20.208 17:02:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:20.208 17:02:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 17:02:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:20.208 17:02:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 [2024-11-27 17:02:16.824174] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:20.208 17:02:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:20.208 17:02:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 17:02:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:20.208 17:02:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 17:02:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:20.208 17:02:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 17:02:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:20.208 17:02:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:20.208 17:02:16 -- common/autotest_common.sh@10 -- # set +x 00:09:20.208 [2024-11-27 17:02:16.877197] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:20.208 17:02:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:20.208 17:02:16 -- target/connect_disconnect.sh@34 -- # set +x 00:09:22.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.640 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.699 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.238 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.196 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.633 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.159 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.014 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.067 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.338 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.864 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.392 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.818 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.195 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.308 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.627 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.150 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.102 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.640 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.066 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.499 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.099 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.048 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.025 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.471 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.009 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.988 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.433 [2024-11-27 17:05:27.119357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe10a0 is same with the state(5) to be set 00:12:30.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:47.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.447 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.351 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.339 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.859 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.761 17:06:08 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:11.761 17:06:08 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:11.761 17:06:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:11.761 17:06:08 -- nvmf/common.sh@116 -- # sync 00:13:11.761 17:06:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:11.761 17:06:08 -- nvmf/common.sh@119 -- # set +e 00:13:11.761 17:06:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:11.761 17:06:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:11.761 rmmod nvme_tcp 00:13:11.761 rmmod nvme_fabrics 00:13:12.019 rmmod nvme_keyring 00:13:12.019 17:06:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:12.019 17:06:08 -- nvmf/common.sh@123 -- # set -e 00:13:12.019 17:06:08 -- nvmf/common.sh@124 -- # return 0 00:13:12.019 17:06:08 -- nvmf/common.sh@477 -- # '[' -n 1653388 ']' 00:13:12.019 17:06:08 -- nvmf/common.sh@478 -- # killprocess 1653388 00:13:12.019 17:06:08 -- common/autotest_common.sh@936 -- # '[' -z 1653388 ']' 00:13:12.019 17:06:08 -- common/autotest_common.sh@940 -- # kill -0 1653388 00:13:12.019 17:06:08 -- common/autotest_common.sh@941 -- # uname 00:13:12.019 17:06:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:12.019 17:06:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1653388 00:13:12.019 17:06:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:12.019 17:06:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:12.019 17:06:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1653388' 00:13:12.019 killing process with pid 1653388 00:13:12.019 17:06:08 -- common/autotest_common.sh@955 -- # kill 1653388 00:13:12.019 17:06:08 -- common/autotest_common.sh@960 -- # wait 1653388 00:13:12.279 17:06:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:12.279 17:06:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:12.279 17:06:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:12.279 17:06:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:12.279 17:06:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:12.279 17:06:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:12.279 17:06:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:12.279 17:06:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:14.185 17:06:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:14.185 00:13:14.185 real 3m57.592s 00:13:14.185 user 15m7.183s 00:13:14.185 sys 0m33.954s 00:13:14.185 17:06:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:14.185 17:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:14.185 ************************************ 00:13:14.185 END TEST nvmf_connect_disconnect 00:13:14.185 ************************************ 00:13:14.185 17:06:11 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:14.185 17:06:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:14.185 17:06:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:14.185 17:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:14.185 ************************************ 00:13:14.185 START TEST nvmf_multitarget 00:13:14.185 ************************************ 00:13:14.185 17:06:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:14.444 * Looking for test storage... 00:13:14.444 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:14.444 17:06:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:14.444 17:06:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:14.444 17:06:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:14.444 17:06:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:14.444 17:06:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:14.444 17:06:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:14.444 17:06:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:14.444 17:06:11 -- scripts/common.sh@335 -- # IFS=.-: 00:13:14.444 17:06:11 -- scripts/common.sh@335 -- # read -ra ver1 00:13:14.444 17:06:11 -- scripts/common.sh@336 -- # IFS=.-: 00:13:14.444 17:06:11 -- scripts/common.sh@336 -- # read -ra ver2 00:13:14.444 17:06:11 -- scripts/common.sh@337 -- # local 'op=<' 00:13:14.444 17:06:11 -- scripts/common.sh@339 -- # ver1_l=2 00:13:14.444 17:06:11 -- scripts/common.sh@340 -- # ver2_l=1 00:13:14.444 17:06:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:14.444 17:06:11 -- scripts/common.sh@343 -- # case "$op" in 00:13:14.444 17:06:11 -- scripts/common.sh@344 -- # : 1 00:13:14.444 17:06:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:14.444 17:06:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:14.444 17:06:11 -- scripts/common.sh@364 -- # decimal 1 00:13:14.444 17:06:11 -- scripts/common.sh@352 -- # local d=1 00:13:14.444 17:06:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:14.444 17:06:11 -- scripts/common.sh@354 -- # echo 1 00:13:14.444 17:06:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:14.444 17:06:11 -- scripts/common.sh@365 -- # decimal 2 00:13:14.444 17:06:11 -- scripts/common.sh@352 -- # local d=2 00:13:14.444 17:06:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:14.444 17:06:11 -- scripts/common.sh@354 -- # echo 2 00:13:14.444 17:06:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:14.444 17:06:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:14.444 17:06:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:14.444 17:06:11 -- scripts/common.sh@367 -- # return 0 00:13:14.444 17:06:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:14.444 17:06:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:14.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.444 --rc genhtml_branch_coverage=1 00:13:14.444 --rc genhtml_function_coverage=1 00:13:14.444 --rc genhtml_legend=1 00:13:14.444 --rc geninfo_all_blocks=1 00:13:14.444 --rc geninfo_unexecuted_blocks=1 00:13:14.444 00:13:14.444 ' 00:13:14.444 17:06:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:14.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.444 --rc genhtml_branch_coverage=1 00:13:14.444 --rc genhtml_function_coverage=1 00:13:14.444 --rc genhtml_legend=1 00:13:14.444 --rc geninfo_all_blocks=1 00:13:14.444 --rc geninfo_unexecuted_blocks=1 00:13:14.444 00:13:14.444 ' 00:13:14.444 17:06:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:14.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.444 --rc genhtml_branch_coverage=1 00:13:14.444 --rc genhtml_function_coverage=1 00:13:14.444 --rc genhtml_legend=1 00:13:14.444 --rc geninfo_all_blocks=1 00:13:14.444 --rc geninfo_unexecuted_blocks=1 00:13:14.444 00:13:14.444 ' 00:13:14.444 17:06:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:14.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.444 --rc genhtml_branch_coverage=1 00:13:14.444 --rc genhtml_function_coverage=1 00:13:14.444 --rc genhtml_legend=1 00:13:14.444 --rc geninfo_all_blocks=1 00:13:14.444 --rc geninfo_unexecuted_blocks=1 00:13:14.444 00:13:14.444 ' 00:13:14.444 17:06:11 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:14.444 17:06:11 -- nvmf/common.sh@7 -- # uname -s 00:13:14.444 17:06:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:14.444 17:06:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:14.444 17:06:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:14.444 17:06:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:14.444 17:06:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:14.444 17:06:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:14.444 17:06:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:14.444 17:06:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:14.444 17:06:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:14.444 17:06:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:14.444 17:06:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:14.444 17:06:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:14.444 17:06:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:14.444 17:06:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:14.444 17:06:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:14.444 17:06:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:14.444 17:06:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:14.444 17:06:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:14.444 17:06:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:14.444 17:06:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.444 17:06:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.444 17:06:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.444 17:06:11 -- paths/export.sh@5 -- # export PATH 00:13:14.444 17:06:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.444 17:06:11 -- nvmf/common.sh@46 -- # : 0 00:13:14.444 17:06:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:14.444 17:06:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:14.444 17:06:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:14.444 17:06:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:14.444 17:06:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:14.444 17:06:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:14.444 17:06:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:14.444 17:06:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:14.444 17:06:11 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:14.444 17:06:11 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:14.444 17:06:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:14.444 17:06:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:14.444 17:06:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:14.444 17:06:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:14.444 17:06:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:14.444 17:06:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:14.444 17:06:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:14.444 17:06:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:14.444 17:06:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:14.444 17:06:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:14.444 17:06:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:14.444 17:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:16.992 17:06:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:16.992 17:06:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:16.992 17:06:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:16.992 17:06:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:16.992 17:06:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:16.992 17:06:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:16.992 17:06:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:16.992 17:06:13 -- nvmf/common.sh@294 -- # net_devs=() 00:13:16.992 17:06:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:16.992 17:06:13 -- nvmf/common.sh@295 -- # e810=() 00:13:16.992 17:06:13 -- nvmf/common.sh@295 -- # local -ga e810 00:13:16.992 17:06:13 -- nvmf/common.sh@296 -- # x722=() 00:13:16.992 17:06:13 -- nvmf/common.sh@296 -- # local -ga x722 00:13:16.992 17:06:13 -- nvmf/common.sh@297 -- # mlx=() 00:13:16.992 17:06:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:16.992 17:06:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:16.992 17:06:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:16.992 17:06:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:16.992 17:06:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:16.992 17:06:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:16.992 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:16.992 17:06:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:16.992 17:06:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:16.992 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:16.992 17:06:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:16.992 17:06:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.992 17:06:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.992 17:06:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:16.992 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:16.992 17:06:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.992 17:06:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:16.992 17:06:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.992 17:06:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.992 17:06:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:16.992 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:16.992 17:06:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.992 17:06:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:16.992 17:06:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:16.992 17:06:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:16.992 17:06:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:16.992 17:06:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:16.992 17:06:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:16.992 17:06:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:16.992 17:06:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:16.992 17:06:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:16.992 17:06:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:16.992 17:06:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:16.993 17:06:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:16.993 17:06:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:16.993 17:06:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:16.993 17:06:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:16.993 17:06:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:16.993 17:06:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:16.993 17:06:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:16.993 17:06:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:16.993 17:06:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:16.993 17:06:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:16.993 17:06:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:16.993 17:06:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:16.993 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:16.993 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.156 ms 00:13:16.993 00:13:16.993 --- 10.0.0.2 ping statistics --- 00:13:16.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:16.993 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:13:16.993 17:06:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:16.993 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:16.993 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:13:16.993 00:13:16.993 --- 10.0.0.1 ping statistics --- 00:13:16.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:16.993 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:13:16.993 17:06:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:16.993 17:06:13 -- nvmf/common.sh@410 -- # return 0 00:13:16.993 17:06:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:16.993 17:06:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:16.993 17:06:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:16.993 17:06:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:16.993 17:06:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:16.993 17:06:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:16.993 17:06:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:16.993 17:06:13 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:16.993 17:06:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:16.993 17:06:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:16.993 17:06:13 -- common/autotest_common.sh@10 -- # set +x 00:13:16.993 17:06:13 -- nvmf/common.sh@469 -- # nvmfpid=1686156 00:13:16.993 17:06:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:16.993 17:06:13 -- nvmf/common.sh@470 -- # waitforlisten 1686156 00:13:16.993 17:06:13 -- common/autotest_common.sh@829 -- # '[' -z 1686156 ']' 00:13:16.993 17:06:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:16.993 17:06:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:16.993 17:06:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:16.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:16.993 17:06:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:16.993 17:06:13 -- common/autotest_common.sh@10 -- # set +x 00:13:16.993 [2024-11-27 17:06:13.543396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:16.993 [2024-11-27 17:06:13.543465] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:16.993 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.993 [2024-11-27 17:06:13.611860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:16.993 [2024-11-27 17:06:13.705702] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:16.993 [2024-11-27 17:06:13.705861] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:16.993 [2024-11-27 17:06:13.705880] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:16.993 [2024-11-27 17:06:13.705894] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:16.993 [2024-11-27 17:06:13.705951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:16.993 [2024-11-27 17:06:13.705984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:16.993 [2024-11-27 17:06:13.706035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:16.993 [2024-11-27 17:06:13.706038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:17.926 17:06:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:17.926 17:06:14 -- common/autotest_common.sh@862 -- # return 0 00:13:17.926 17:06:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:17.926 17:06:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:17.926 17:06:14 -- common/autotest_common.sh@10 -- # set +x 00:13:17.926 17:06:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:17.926 17:06:14 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:17.926 17:06:14 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:17.926 17:06:14 -- target/multitarget.sh@21 -- # jq length 00:13:17.926 17:06:14 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:17.926 17:06:14 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:17.926 "nvmf_tgt_1" 00:13:17.926 17:06:14 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:18.183 "nvmf_tgt_2" 00:13:18.183 17:06:14 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:18.183 17:06:14 -- target/multitarget.sh@28 -- # jq length 00:13:18.183 17:06:15 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:18.183 17:06:15 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:18.441 true 00:13:18.441 17:06:15 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:18.441 true 00:13:18.441 17:06:15 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:18.441 17:06:15 -- target/multitarget.sh@35 -- # jq length 00:13:18.700 17:06:15 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:18.700 17:06:15 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:18.700 17:06:15 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:18.700 17:06:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:18.700 17:06:15 -- nvmf/common.sh@116 -- # sync 00:13:18.700 17:06:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:18.700 17:06:15 -- nvmf/common.sh@119 -- # set +e 00:13:18.700 17:06:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:18.700 17:06:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:18.700 rmmod nvme_tcp 00:13:18.700 rmmod nvme_fabrics 00:13:18.700 rmmod nvme_keyring 00:13:18.700 17:06:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:18.700 17:06:15 -- nvmf/common.sh@123 -- # set -e 00:13:18.700 17:06:15 -- nvmf/common.sh@124 -- # return 0 00:13:18.700 17:06:15 -- nvmf/common.sh@477 -- # '[' -n 1686156 ']' 00:13:18.700 17:06:15 -- nvmf/common.sh@478 -- # killprocess 1686156 00:13:18.700 17:06:15 -- common/autotest_common.sh@936 -- # '[' -z 1686156 ']' 00:13:18.700 17:06:15 -- common/autotest_common.sh@940 -- # kill -0 1686156 00:13:18.700 17:06:15 -- common/autotest_common.sh@941 -- # uname 00:13:18.700 17:06:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:18.700 17:06:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1686156 00:13:18.700 17:06:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:18.700 17:06:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:18.700 17:06:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1686156' 00:13:18.700 killing process with pid 1686156 00:13:18.700 17:06:15 -- common/autotest_common.sh@955 -- # kill 1686156 00:13:18.700 17:06:15 -- common/autotest_common.sh@960 -- # wait 1686156 00:13:18.958 17:06:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:18.958 17:06:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:18.958 17:06:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:18.958 17:06:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:18.958 17:06:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:18.958 17:06:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.958 17:06:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.958 17:06:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:20.859 17:06:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:20.859 00:13:20.859 real 0m6.691s 00:13:20.859 user 0m9.937s 00:13:20.859 sys 0m2.037s 00:13:20.860 17:06:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:20.860 17:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:20.860 ************************************ 00:13:20.860 END TEST nvmf_multitarget 00:13:20.860 ************************************ 00:13:20.860 17:06:17 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:20.860 17:06:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:20.860 17:06:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:20.860 17:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:20.860 ************************************ 00:13:20.860 START TEST nvmf_rpc 00:13:20.860 ************************************ 00:13:20.860 17:06:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:21.118 * Looking for test storage... 00:13:21.118 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:21.118 17:06:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:21.119 17:06:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:21.119 17:06:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:21.119 17:06:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:21.119 17:06:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:21.119 17:06:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:21.119 17:06:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:21.119 17:06:17 -- scripts/common.sh@335 -- # IFS=.-: 00:13:21.119 17:06:17 -- scripts/common.sh@335 -- # read -ra ver1 00:13:21.119 17:06:17 -- scripts/common.sh@336 -- # IFS=.-: 00:13:21.119 17:06:17 -- scripts/common.sh@336 -- # read -ra ver2 00:13:21.119 17:06:17 -- scripts/common.sh@337 -- # local 'op=<' 00:13:21.119 17:06:17 -- scripts/common.sh@339 -- # ver1_l=2 00:13:21.119 17:06:17 -- scripts/common.sh@340 -- # ver2_l=1 00:13:21.119 17:06:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:21.119 17:06:17 -- scripts/common.sh@343 -- # case "$op" in 00:13:21.119 17:06:17 -- scripts/common.sh@344 -- # : 1 00:13:21.119 17:06:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:21.119 17:06:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:21.119 17:06:17 -- scripts/common.sh@364 -- # decimal 1 00:13:21.119 17:06:17 -- scripts/common.sh@352 -- # local d=1 00:13:21.119 17:06:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:21.119 17:06:17 -- scripts/common.sh@354 -- # echo 1 00:13:21.119 17:06:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:21.119 17:06:17 -- scripts/common.sh@365 -- # decimal 2 00:13:21.119 17:06:17 -- scripts/common.sh@352 -- # local d=2 00:13:21.119 17:06:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:21.119 17:06:17 -- scripts/common.sh@354 -- # echo 2 00:13:21.119 17:06:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:21.119 17:06:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:21.119 17:06:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:21.119 17:06:17 -- scripts/common.sh@367 -- # return 0 00:13:21.119 17:06:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:21.119 17:06:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:21.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.119 --rc genhtml_branch_coverage=1 00:13:21.119 --rc genhtml_function_coverage=1 00:13:21.119 --rc genhtml_legend=1 00:13:21.119 --rc geninfo_all_blocks=1 00:13:21.119 --rc geninfo_unexecuted_blocks=1 00:13:21.119 00:13:21.119 ' 00:13:21.119 17:06:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:21.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.119 --rc genhtml_branch_coverage=1 00:13:21.119 --rc genhtml_function_coverage=1 00:13:21.119 --rc genhtml_legend=1 00:13:21.119 --rc geninfo_all_blocks=1 00:13:21.119 --rc geninfo_unexecuted_blocks=1 00:13:21.119 00:13:21.119 ' 00:13:21.119 17:06:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:21.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.119 --rc genhtml_branch_coverage=1 00:13:21.119 --rc genhtml_function_coverage=1 00:13:21.119 --rc genhtml_legend=1 00:13:21.119 --rc geninfo_all_blocks=1 00:13:21.119 --rc geninfo_unexecuted_blocks=1 00:13:21.119 00:13:21.119 ' 00:13:21.119 17:06:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:21.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.119 --rc genhtml_branch_coverage=1 00:13:21.119 --rc genhtml_function_coverage=1 00:13:21.119 --rc genhtml_legend=1 00:13:21.119 --rc geninfo_all_blocks=1 00:13:21.119 --rc geninfo_unexecuted_blocks=1 00:13:21.119 00:13:21.119 ' 00:13:21.119 17:06:17 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:21.119 17:06:17 -- nvmf/common.sh@7 -- # uname -s 00:13:21.119 17:06:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:21.119 17:06:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:21.119 17:06:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:21.119 17:06:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:21.119 17:06:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:21.119 17:06:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:21.119 17:06:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:21.119 17:06:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:21.119 17:06:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:21.119 17:06:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:21.119 17:06:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:21.119 17:06:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:21.119 17:06:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:21.119 17:06:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:21.119 17:06:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:21.119 17:06:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:21.119 17:06:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:21.119 17:06:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:21.119 17:06:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:21.119 17:06:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.119 17:06:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.119 17:06:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.119 17:06:17 -- paths/export.sh@5 -- # export PATH 00:13:21.119 17:06:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.119 17:06:17 -- nvmf/common.sh@46 -- # : 0 00:13:21.119 17:06:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:21.119 17:06:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:21.119 17:06:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:21.119 17:06:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:21.119 17:06:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:21.119 17:06:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:21.119 17:06:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:21.119 17:06:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:21.119 17:06:17 -- target/rpc.sh@11 -- # loops=5 00:13:21.119 17:06:17 -- target/rpc.sh@23 -- # nvmftestinit 00:13:21.119 17:06:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:21.119 17:06:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:21.119 17:06:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:21.119 17:06:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:21.119 17:06:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:21.119 17:06:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.119 17:06:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.119 17:06:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:21.119 17:06:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:21.119 17:06:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:21.119 17:06:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:21.119 17:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:23.655 17:06:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:23.655 17:06:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:23.655 17:06:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:23.655 17:06:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:23.655 17:06:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:23.655 17:06:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:23.655 17:06:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:23.655 17:06:19 -- nvmf/common.sh@294 -- # net_devs=() 00:13:23.655 17:06:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:23.655 17:06:19 -- nvmf/common.sh@295 -- # e810=() 00:13:23.655 17:06:19 -- nvmf/common.sh@295 -- # local -ga e810 00:13:23.655 17:06:19 -- nvmf/common.sh@296 -- # x722=() 00:13:23.655 17:06:19 -- nvmf/common.sh@296 -- # local -ga x722 00:13:23.655 17:06:19 -- nvmf/common.sh@297 -- # mlx=() 00:13:23.655 17:06:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:23.655 17:06:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:23.655 17:06:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:23.656 17:06:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:23.656 17:06:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:23.656 17:06:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:23.656 17:06:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:23.656 17:06:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:23.656 17:06:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:23.656 17:06:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:23.656 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:23.656 17:06:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:23.656 17:06:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:23.656 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:23.656 17:06:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:23.656 17:06:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:23.656 17:06:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:23.656 17:06:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:23.656 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:23.656 17:06:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:23.656 17:06:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:23.656 17:06:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:23.656 17:06:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:23.656 17:06:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:23.656 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:23.656 17:06:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:23.656 17:06:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:23.656 17:06:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:23.656 17:06:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:23.656 17:06:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:23.656 17:06:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:23.656 17:06:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:23.656 17:06:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:23.656 17:06:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:23.656 17:06:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:23.656 17:06:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:23.656 17:06:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:23.656 17:06:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:23.656 17:06:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:23.656 17:06:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:23.656 17:06:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:23.656 17:06:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:23.656 17:06:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:23.656 17:06:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:23.656 17:06:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:23.656 17:06:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:23.656 17:06:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:23.656 17:06:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:23.656 17:06:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:23.656 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:23.656 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:13:23.656 00:13:23.656 --- 10.0.0.2 ping statistics --- 00:13:23.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:23.656 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:13:23.656 17:06:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:23.656 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:23.656 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:13:23.656 00:13:23.656 --- 10.0.0.1 ping statistics --- 00:13:23.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:23.656 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:13:23.656 17:06:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:23.656 17:06:20 -- nvmf/common.sh@410 -- # return 0 00:13:23.656 17:06:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:23.656 17:06:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:23.656 17:06:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:23.656 17:06:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:23.656 17:06:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:23.656 17:06:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:23.656 17:06:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:23.656 17:06:20 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:23.656 17:06:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:23.656 17:06:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:23.656 17:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:23.656 17:06:20 -- nvmf/common.sh@469 -- # nvmfpid=1688403 00:13:23.656 17:06:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:23.656 17:06:20 -- nvmf/common.sh@470 -- # waitforlisten 1688403 00:13:23.656 17:06:20 -- common/autotest_common.sh@829 -- # '[' -z 1688403 ']' 00:13:23.656 17:06:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:23.656 17:06:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:23.656 17:06:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:23.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:23.656 17:06:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:23.656 17:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:23.656 [2024-11-27 17:06:20.223463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:23.656 [2024-11-27 17:06:20.223556] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:23.656 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.656 [2024-11-27 17:06:20.297385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:23.656 [2024-11-27 17:06:20.389972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:23.656 [2024-11-27 17:06:20.390135] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:23.656 [2024-11-27 17:06:20.390153] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:23.657 [2024-11-27 17:06:20.390168] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:23.657 [2024-11-27 17:06:20.390250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:23.657 [2024-11-27 17:06:20.390309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:23.657 [2024-11-27 17:06:20.390359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:23.657 [2024-11-27 17:06:20.390362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:24.314 17:06:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:24.314 17:06:21 -- common/autotest_common.sh@862 -- # return 0 00:13:24.314 17:06:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:24.314 17:06:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:24.314 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.314 17:06:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:24.314 17:06:21 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:24.314 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.314 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.314 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.314 17:06:21 -- target/rpc.sh@26 -- # stats='{ 00:13:24.314 "tick_rate": 2700000000, 00:13:24.314 "poll_groups": [ 00:13:24.314 { 00:13:24.314 "name": "nvmf_tgt_poll_group_0", 00:13:24.314 "admin_qpairs": 0, 00:13:24.314 "io_qpairs": 0, 00:13:24.314 "current_admin_qpairs": 0, 00:13:24.314 "current_io_qpairs": 0, 00:13:24.314 "pending_bdev_io": 0, 00:13:24.314 "completed_nvme_io": 0, 00:13:24.314 "transports": [] 00:13:24.314 }, 00:13:24.314 { 00:13:24.314 "name": "nvmf_tgt_poll_group_1", 00:13:24.314 "admin_qpairs": 0, 00:13:24.314 "io_qpairs": 0, 00:13:24.314 "current_admin_qpairs": 0, 00:13:24.314 "current_io_qpairs": 0, 00:13:24.314 "pending_bdev_io": 0, 00:13:24.314 "completed_nvme_io": 0, 00:13:24.314 "transports": [] 00:13:24.314 }, 00:13:24.314 { 00:13:24.314 "name": "nvmf_tgt_poll_group_2", 00:13:24.314 "admin_qpairs": 0, 00:13:24.314 "io_qpairs": 0, 00:13:24.314 "current_admin_qpairs": 0, 00:13:24.314 "current_io_qpairs": 0, 00:13:24.314 "pending_bdev_io": 0, 00:13:24.314 "completed_nvme_io": 0, 00:13:24.314 "transports": [] 00:13:24.314 }, 00:13:24.314 { 00:13:24.314 "name": "nvmf_tgt_poll_group_3", 00:13:24.314 "admin_qpairs": 0, 00:13:24.314 "io_qpairs": 0, 00:13:24.314 "current_admin_qpairs": 0, 00:13:24.314 "current_io_qpairs": 0, 00:13:24.314 "pending_bdev_io": 0, 00:13:24.314 "completed_nvme_io": 0, 00:13:24.314 "transports": [] 00:13:24.314 } 00:13:24.314 ] 00:13:24.314 }' 00:13:24.314 17:06:21 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:24.314 17:06:21 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:24.314 17:06:21 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:24.314 17:06:21 -- target/rpc.sh@15 -- # wc -l 00:13:24.572 17:06:21 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:24.572 17:06:21 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:24.572 17:06:21 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:24.572 17:06:21 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:24.572 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.572 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.572 [2024-11-27 17:06:21.320573] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:24.572 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.572 17:06:21 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:24.572 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.572 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.572 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.572 17:06:21 -- target/rpc.sh@33 -- # stats='{ 00:13:24.572 "tick_rate": 2700000000, 00:13:24.572 "poll_groups": [ 00:13:24.572 { 00:13:24.572 "name": "nvmf_tgt_poll_group_0", 00:13:24.572 "admin_qpairs": 0, 00:13:24.572 "io_qpairs": 0, 00:13:24.572 "current_admin_qpairs": 0, 00:13:24.572 "current_io_qpairs": 0, 00:13:24.572 "pending_bdev_io": 0, 00:13:24.572 "completed_nvme_io": 0, 00:13:24.572 "transports": [ 00:13:24.572 { 00:13:24.572 "trtype": "TCP" 00:13:24.572 } 00:13:24.572 ] 00:13:24.572 }, 00:13:24.572 { 00:13:24.572 "name": "nvmf_tgt_poll_group_1", 00:13:24.573 "admin_qpairs": 0, 00:13:24.573 "io_qpairs": 0, 00:13:24.573 "current_admin_qpairs": 0, 00:13:24.573 "current_io_qpairs": 0, 00:13:24.573 "pending_bdev_io": 0, 00:13:24.573 "completed_nvme_io": 0, 00:13:24.573 "transports": [ 00:13:24.573 { 00:13:24.573 "trtype": "TCP" 00:13:24.573 } 00:13:24.573 ] 00:13:24.573 }, 00:13:24.573 { 00:13:24.573 "name": "nvmf_tgt_poll_group_2", 00:13:24.573 "admin_qpairs": 0, 00:13:24.573 "io_qpairs": 0, 00:13:24.573 "current_admin_qpairs": 0, 00:13:24.573 "current_io_qpairs": 0, 00:13:24.573 "pending_bdev_io": 0, 00:13:24.573 "completed_nvme_io": 0, 00:13:24.573 "transports": [ 00:13:24.573 { 00:13:24.573 "trtype": "TCP" 00:13:24.573 } 00:13:24.573 ] 00:13:24.573 }, 00:13:24.573 { 00:13:24.573 "name": "nvmf_tgt_poll_group_3", 00:13:24.573 "admin_qpairs": 0, 00:13:24.573 "io_qpairs": 0, 00:13:24.573 "current_admin_qpairs": 0, 00:13:24.573 "current_io_qpairs": 0, 00:13:24.573 "pending_bdev_io": 0, 00:13:24.573 "completed_nvme_io": 0, 00:13:24.573 "transports": [ 00:13:24.573 { 00:13:24.573 "trtype": "TCP" 00:13:24.573 } 00:13:24.573 ] 00:13:24.573 } 00:13:24.573 ] 00:13:24.573 }' 00:13:24.573 17:06:21 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:24.573 17:06:21 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:24.573 17:06:21 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:24.573 17:06:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:24.573 17:06:21 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:24.573 17:06:21 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:24.573 17:06:21 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:24.573 17:06:21 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:24.573 17:06:21 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:24.573 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.573 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.573 Malloc1 00:13:24.573 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.573 17:06:21 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:24.573 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.573 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.573 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.573 17:06:21 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:24.573 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.573 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.573 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.573 17:06:21 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:24.573 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.573 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.573 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.573 17:06:21 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.573 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.573 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.573 [2024-11-27 17:06:21.470137] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.573 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.573 17:06:21 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:24.573 17:06:21 -- common/autotest_common.sh@650 -- # local es=0 00:13:24.573 17:06:21 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:24.573 17:06:21 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:24.573 17:06:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.573 17:06:21 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:24.573 17:06:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.573 17:06:21 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:24.573 17:06:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.573 17:06:21 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:24.573 17:06:21 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:24.573 17:06:21 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:24.573 [2024-11-27 17:06:21.492621] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:24.573 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:24.573 could not add new controller: failed to write to nvme-fabrics device 00:13:24.832 17:06:21 -- common/autotest_common.sh@653 -- # es=1 00:13:24.832 17:06:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:24.832 17:06:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:24.832 17:06:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:24.832 17:06:21 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.832 17:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.832 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:24.832 17:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.832 17:06:21 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:25.403 17:06:22 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:25.403 17:06:22 -- common/autotest_common.sh@1187 -- # local i=0 00:13:25.403 17:06:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:25.403 17:06:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:25.403 17:06:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:27.311 17:06:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:27.311 17:06:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:27.311 17:06:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:27.311 17:06:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:27.311 17:06:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:27.311 17:06:24 -- common/autotest_common.sh@1197 -- # return 0 00:13:27.311 17:06:24 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:27.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:27.568 17:06:24 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:27.568 17:06:24 -- common/autotest_common.sh@1208 -- # local i=0 00:13:27.568 17:06:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:27.568 17:06:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.568 17:06:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:27.568 17:06:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.568 17:06:24 -- common/autotest_common.sh@1220 -- # return 0 00:13:27.568 17:06:24 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.568 17:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.568 17:06:24 -- common/autotest_common.sh@10 -- # set +x 00:13:27.568 17:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.568 17:06:24 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.568 17:06:24 -- common/autotest_common.sh@650 -- # local es=0 00:13:27.568 17:06:24 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.568 17:06:24 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:27.568 17:06:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:27.568 17:06:24 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:27.568 17:06:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:27.568 17:06:24 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:27.568 17:06:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:27.568 17:06:24 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:27.569 17:06:24 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:27.569 17:06:24 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.569 [2024-11-27 17:06:24.366846] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:27.569 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:27.569 could not add new controller: failed to write to nvme-fabrics device 00:13:27.569 17:06:24 -- common/autotest_common.sh@653 -- # es=1 00:13:27.569 17:06:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:27.569 17:06:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:27.569 17:06:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:27.569 17:06:24 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:27.569 17:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.569 17:06:24 -- common/autotest_common.sh@10 -- # set +x 00:13:27.569 17:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.569 17:06:24 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:28.139 17:06:24 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:28.139 17:06:24 -- common/autotest_common.sh@1187 -- # local i=0 00:13:28.139 17:06:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:28.139 17:06:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:28.139 17:06:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:30.679 17:06:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:30.679 17:06:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:30.679 17:06:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:30.679 17:06:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:30.679 17:06:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:30.679 17:06:27 -- common/autotest_common.sh@1197 -- # return 0 00:13:30.679 17:06:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:30.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.679 17:06:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:30.679 17:06:27 -- common/autotest_common.sh@1208 -- # local i=0 00:13:30.679 17:06:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:30.679 17:06:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.679 17:06:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:30.679 17:06:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.679 17:06:27 -- common/autotest_common.sh@1220 -- # return 0 00:13:30.679 17:06:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:30.679 17:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.679 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:13:30.679 17:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.679 17:06:27 -- target/rpc.sh@81 -- # seq 1 5 00:13:30.679 17:06:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:30.679 17:06:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:30.679 17:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.679 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:13:30.679 17:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.679 17:06:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:30.679 17:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.679 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:13:30.679 [2024-11-27 17:06:27.100061] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:30.679 17:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.679 17:06:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:30.679 17:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.679 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:13:30.679 17:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.679 17:06:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:30.679 17:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.679 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:13:30.679 17:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.679 17:06:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:30.939 17:06:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:30.939 17:06:27 -- common/autotest_common.sh@1187 -- # local i=0 00:13:30.939 17:06:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:30.939 17:06:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:30.939 17:06:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:32.857 17:06:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:32.857 17:06:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:32.857 17:06:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:32.857 17:06:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:32.857 17:06:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:32.857 17:06:29 -- common/autotest_common.sh@1197 -- # return 0 00:13:32.857 17:06:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:33.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:33.115 17:06:29 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:33.115 17:06:29 -- common/autotest_common.sh@1208 -- # local i=0 00:13:33.115 17:06:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:33.115 17:06:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:33.115 17:06:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:33.115 17:06:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:33.115 17:06:29 -- common/autotest_common.sh@1220 -- # return 0 00:13:33.115 17:06:29 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:33.115 17:06:29 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 [2024-11-27 17:06:29.863607] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.115 17:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.115 17:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.115 17:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.115 17:06:29 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:33.686 17:06:30 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:33.686 17:06:30 -- common/autotest_common.sh@1187 -- # local i=0 00:13:33.686 17:06:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:33.686 17:06:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:33.686 17:06:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:36.239 17:06:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:36.239 17:06:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:36.239 17:06:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:36.239 17:06:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:36.239 17:06:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:36.239 17:06:32 -- common/autotest_common.sh@1197 -- # return 0 00:13:36.239 17:06:32 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:36.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:36.239 17:06:32 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:36.239 17:06:32 -- common/autotest_common.sh@1208 -- # local i=0 00:13:36.239 17:06:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:36.239 17:06:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:36.239 17:06:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:36.239 17:06:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:36.239 17:06:32 -- common/autotest_common.sh@1220 -- # return 0 00:13:36.239 17:06:32 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:36.239 17:06:32 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 [2024-11-27 17:06:32.726426] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:36.239 17:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.239 17:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.239 17:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.239 17:06:32 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:36.498 17:06:33 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:36.498 17:06:33 -- common/autotest_common.sh@1187 -- # local i=0 00:13:36.498 17:06:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:36.498 17:06:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:36.498 17:06:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:39.035 17:06:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:39.035 17:06:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:39.035 17:06:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:39.035 17:06:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:39.035 17:06:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:39.035 17:06:35 -- common/autotest_common.sh@1197 -- # return 0 00:13:39.035 17:06:35 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:39.035 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:39.035 17:06:35 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:39.035 17:06:35 -- common/autotest_common.sh@1208 -- # local i=0 00:13:39.035 17:06:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:39.035 17:06:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.035 17:06:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:39.035 17:06:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.035 17:06:35 -- common/autotest_common.sh@1220 -- # return 0 00:13:39.035 17:06:35 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:39.035 17:06:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 [2024-11-27 17:06:35.541306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:39.035 17:06:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.035 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.035 17:06:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.035 17:06:35 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.295 17:06:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:39.295 17:06:36 -- common/autotest_common.sh@1187 -- # local i=0 00:13:39.295 17:06:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:39.296 17:06:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:39.296 17:06:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:41.836 17:06:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:41.836 17:06:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:41.836 17:06:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:41.836 17:06:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:41.836 17:06:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:41.836 17:06:38 -- common/autotest_common.sh@1197 -- # return 0 00:13:41.836 17:06:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:41.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:41.836 17:06:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:41.836 17:06:38 -- common/autotest_common.sh@1208 -- # local i=0 00:13:41.836 17:06:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:41.836 17:06:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:41.836 17:06:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:41.836 17:06:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:41.836 17:06:38 -- common/autotest_common.sh@1220 -- # return 0 00:13:41.836 17:06:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:41.836 17:06:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 [2024-11-27 17:06:38.288139] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:41.836 17:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.836 17:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.836 17:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.836 17:06:38 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:42.098 17:06:38 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:42.098 17:06:38 -- common/autotest_common.sh@1187 -- # local i=0 00:13:42.098 17:06:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:42.098 17:06:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:42.098 17:06:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:44.003 17:06:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:44.003 17:06:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:44.003 17:06:40 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:44.003 17:06:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:44.003 17:06:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:44.003 17:06:40 -- common/autotest_common.sh@1197 -- # return 0 00:13:44.003 17:06:40 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:44.264 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:44.264 17:06:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@1208 -- # local i=0 00:13:44.264 17:06:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:44.264 17:06:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:44.264 17:06:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@1220 -- # return 0 00:13:44.264 17:06:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@99 -- # seq 1 5 00:13:44.264 17:06:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:44.264 17:06:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 [2024-11-27 17:06:41.064220] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:44.264 17:06:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 [2024-11-27 17:06:41.112296] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:44.264 17:06:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 [2024-11-27 17:06:41.164482] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:44.264 17:06:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.264 17:06:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.264 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.264 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.264 [2024-11-27 17:06:41.212652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:44.524 17:06:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 [2024-11-27 17:06:41.260843] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:44.524 17:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.524 17:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:44.524 17:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.524 17:06:41 -- target/rpc.sh@110 -- # stats='{ 00:13:44.524 "tick_rate": 2700000000, 00:13:44.524 "poll_groups": [ 00:13:44.524 { 00:13:44.524 "name": "nvmf_tgt_poll_group_0", 00:13:44.524 "admin_qpairs": 2, 00:13:44.524 "io_qpairs": 84, 00:13:44.524 "current_admin_qpairs": 0, 00:13:44.524 "current_io_qpairs": 0, 00:13:44.524 "pending_bdev_io": 0, 00:13:44.524 "completed_nvme_io": 136, 00:13:44.524 "transports": [ 00:13:44.524 { 00:13:44.524 "trtype": "TCP" 00:13:44.524 } 00:13:44.524 ] 00:13:44.524 }, 00:13:44.524 { 00:13:44.524 "name": "nvmf_tgt_poll_group_1", 00:13:44.524 "admin_qpairs": 2, 00:13:44.524 "io_qpairs": 84, 00:13:44.524 "current_admin_qpairs": 0, 00:13:44.524 "current_io_qpairs": 0, 00:13:44.524 "pending_bdev_io": 0, 00:13:44.524 "completed_nvme_io": 135, 00:13:44.524 "transports": [ 00:13:44.524 { 00:13:44.524 "trtype": "TCP" 00:13:44.524 } 00:13:44.524 ] 00:13:44.524 }, 00:13:44.524 { 00:13:44.524 "name": "nvmf_tgt_poll_group_2", 00:13:44.524 "admin_qpairs": 1, 00:13:44.524 "io_qpairs": 84, 00:13:44.524 "current_admin_qpairs": 0, 00:13:44.524 "current_io_qpairs": 0, 00:13:44.524 "pending_bdev_io": 0, 00:13:44.524 "completed_nvme_io": 184, 00:13:44.524 "transports": [ 00:13:44.524 { 00:13:44.524 "trtype": "TCP" 00:13:44.524 } 00:13:44.524 ] 00:13:44.524 }, 00:13:44.524 { 00:13:44.524 "name": "nvmf_tgt_poll_group_3", 00:13:44.524 "admin_qpairs": 2, 00:13:44.524 "io_qpairs": 84, 00:13:44.524 "current_admin_qpairs": 0, 00:13:44.524 "current_io_qpairs": 0, 00:13:44.524 "pending_bdev_io": 0, 00:13:44.524 "completed_nvme_io": 231, 00:13:44.524 "transports": [ 00:13:44.524 { 00:13:44.524 "trtype": "TCP" 00:13:44.524 } 00:13:44.524 ] 00:13:44.524 } 00:13:44.524 ] 00:13:44.524 }' 00:13:44.524 17:06:41 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:44.524 17:06:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:44.524 17:06:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:44.524 17:06:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:44.524 17:06:41 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:44.524 17:06:41 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:44.524 17:06:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:44.524 17:06:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:44.525 17:06:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:44.525 17:06:41 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:44.525 17:06:41 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:44.525 17:06:41 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:44.525 17:06:41 -- target/rpc.sh@123 -- # nvmftestfini 00:13:44.525 17:06:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.525 17:06:41 -- nvmf/common.sh@116 -- # sync 00:13:44.525 17:06:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.525 17:06:41 -- nvmf/common.sh@119 -- # set +e 00:13:44.525 17:06:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.525 17:06:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.525 rmmod nvme_tcp 00:13:44.525 rmmod nvme_fabrics 00:13:44.525 rmmod nvme_keyring 00:13:44.525 17:06:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.784 17:06:41 -- nvmf/common.sh@123 -- # set -e 00:13:44.784 17:06:41 -- nvmf/common.sh@124 -- # return 0 00:13:44.784 17:06:41 -- nvmf/common.sh@477 -- # '[' -n 1688403 ']' 00:13:44.784 17:06:41 -- nvmf/common.sh@478 -- # killprocess 1688403 00:13:44.784 17:06:41 -- common/autotest_common.sh@936 -- # '[' -z 1688403 ']' 00:13:44.784 17:06:41 -- common/autotest_common.sh@940 -- # kill -0 1688403 00:13:44.784 17:06:41 -- common/autotest_common.sh@941 -- # uname 00:13:44.784 17:06:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.784 17:06:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1688403 00:13:44.784 17:06:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:44.784 17:06:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:44.784 17:06:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1688403' 00:13:44.784 killing process with pid 1688403 00:13:44.784 17:06:41 -- common/autotest_common.sh@955 -- # kill 1688403 00:13:44.784 17:06:41 -- common/autotest_common.sh@960 -- # wait 1688403 00:13:45.044 17:06:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:45.044 17:06:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:45.044 17:06:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:45.044 17:06:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:45.044 17:06:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:45.044 17:06:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:45.044 17:06:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:45.044 17:06:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.954 17:06:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.954 00:13:46.954 real 0m26.003s 00:13:46.954 user 1m24.999s 00:13:46.954 sys 0m4.180s 00:13:46.954 17:06:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.954 17:06:43 -- common/autotest_common.sh@10 -- # set +x 00:13:46.954 ************************************ 00:13:46.954 END TEST nvmf_rpc 00:13:46.954 ************************************ 00:13:46.954 17:06:43 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:46.954 17:06:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.954 17:06:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.954 17:06:43 -- common/autotest_common.sh@10 -- # set +x 00:13:46.954 ************************************ 00:13:46.954 START TEST nvmf_invalid 00:13:46.954 ************************************ 00:13:46.954 17:06:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:46.954 * Looking for test storage... 00:13:46.954 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.954 17:06:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.954 17:06:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.954 17:06:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:47.213 17:06:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:47.213 17:06:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:47.213 17:06:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:47.213 17:06:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:47.213 17:06:43 -- scripts/common.sh@335 -- # IFS=.-: 00:13:47.213 17:06:43 -- scripts/common.sh@335 -- # read -ra ver1 00:13:47.213 17:06:43 -- scripts/common.sh@336 -- # IFS=.-: 00:13:47.213 17:06:43 -- scripts/common.sh@336 -- # read -ra ver2 00:13:47.213 17:06:43 -- scripts/common.sh@337 -- # local 'op=<' 00:13:47.213 17:06:43 -- scripts/common.sh@339 -- # ver1_l=2 00:13:47.213 17:06:43 -- scripts/common.sh@340 -- # ver2_l=1 00:13:47.213 17:06:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:47.213 17:06:43 -- scripts/common.sh@343 -- # case "$op" in 00:13:47.213 17:06:43 -- scripts/common.sh@344 -- # : 1 00:13:47.213 17:06:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:47.213 17:06:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:47.213 17:06:43 -- scripts/common.sh@364 -- # decimal 1 00:13:47.213 17:06:43 -- scripts/common.sh@352 -- # local d=1 00:13:47.213 17:06:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:47.213 17:06:43 -- scripts/common.sh@354 -- # echo 1 00:13:47.213 17:06:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:47.213 17:06:43 -- scripts/common.sh@365 -- # decimal 2 00:13:47.213 17:06:43 -- scripts/common.sh@352 -- # local d=2 00:13:47.213 17:06:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:47.213 17:06:43 -- scripts/common.sh@354 -- # echo 2 00:13:47.213 17:06:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:47.213 17:06:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:47.213 17:06:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:47.213 17:06:43 -- scripts/common.sh@367 -- # return 0 00:13:47.213 17:06:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:47.213 17:06:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:47.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.213 --rc genhtml_branch_coverage=1 00:13:47.213 --rc genhtml_function_coverage=1 00:13:47.213 --rc genhtml_legend=1 00:13:47.213 --rc geninfo_all_blocks=1 00:13:47.213 --rc geninfo_unexecuted_blocks=1 00:13:47.213 00:13:47.213 ' 00:13:47.213 17:06:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:47.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.213 --rc genhtml_branch_coverage=1 00:13:47.213 --rc genhtml_function_coverage=1 00:13:47.213 --rc genhtml_legend=1 00:13:47.213 --rc geninfo_all_blocks=1 00:13:47.213 --rc geninfo_unexecuted_blocks=1 00:13:47.213 00:13:47.213 ' 00:13:47.213 17:06:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:47.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.213 --rc genhtml_branch_coverage=1 00:13:47.213 --rc genhtml_function_coverage=1 00:13:47.213 --rc genhtml_legend=1 00:13:47.213 --rc geninfo_all_blocks=1 00:13:47.213 --rc geninfo_unexecuted_blocks=1 00:13:47.213 00:13:47.213 ' 00:13:47.213 17:06:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:47.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.213 --rc genhtml_branch_coverage=1 00:13:47.213 --rc genhtml_function_coverage=1 00:13:47.213 --rc genhtml_legend=1 00:13:47.213 --rc geninfo_all_blocks=1 00:13:47.213 --rc geninfo_unexecuted_blocks=1 00:13:47.213 00:13:47.213 ' 00:13:47.213 17:06:43 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:47.213 17:06:43 -- nvmf/common.sh@7 -- # uname -s 00:13:47.213 17:06:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:47.213 17:06:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:47.213 17:06:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:47.213 17:06:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:47.213 17:06:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:47.213 17:06:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:47.213 17:06:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:47.213 17:06:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:47.213 17:06:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:47.213 17:06:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:47.213 17:06:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.213 17:06:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.213 17:06:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:47.213 17:06:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:47.213 17:06:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:47.213 17:06:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:47.213 17:06:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:47.213 17:06:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:47.213 17:06:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:47.213 17:06:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.213 17:06:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.213 17:06:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.214 17:06:43 -- paths/export.sh@5 -- # export PATH 00:13:47.214 17:06:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.214 17:06:43 -- nvmf/common.sh@46 -- # : 0 00:13:47.214 17:06:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:47.214 17:06:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:47.214 17:06:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:47.214 17:06:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:47.214 17:06:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:47.214 17:06:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:47.214 17:06:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:47.214 17:06:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:47.214 17:06:43 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:47.214 17:06:43 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:47.214 17:06:43 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:47.214 17:06:43 -- target/invalid.sh@14 -- # target=foobar 00:13:47.214 17:06:43 -- target/invalid.sh@16 -- # RANDOM=0 00:13:47.214 17:06:43 -- target/invalid.sh@34 -- # nvmftestinit 00:13:47.214 17:06:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:47.214 17:06:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:47.214 17:06:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:47.214 17:06:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:47.214 17:06:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:47.214 17:06:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.214 17:06:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.214 17:06:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.214 17:06:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:47.214 17:06:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:47.214 17:06:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:47.214 17:06:44 -- common/autotest_common.sh@10 -- # set +x 00:13:49.120 17:06:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:49.120 17:06:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:49.120 17:06:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:49.120 17:06:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:49.120 17:06:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:49.120 17:06:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:49.120 17:06:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:49.120 17:06:45 -- nvmf/common.sh@294 -- # net_devs=() 00:13:49.120 17:06:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:49.120 17:06:45 -- nvmf/common.sh@295 -- # e810=() 00:13:49.120 17:06:45 -- nvmf/common.sh@295 -- # local -ga e810 00:13:49.120 17:06:45 -- nvmf/common.sh@296 -- # x722=() 00:13:49.120 17:06:45 -- nvmf/common.sh@296 -- # local -ga x722 00:13:49.120 17:06:45 -- nvmf/common.sh@297 -- # mlx=() 00:13:49.120 17:06:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:49.120 17:06:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:49.120 17:06:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:49.120 17:06:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:49.120 17:06:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:49.120 17:06:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:49.120 17:06:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.120 17:06:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:49.120 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:49.120 17:06:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.120 17:06:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:49.120 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:49.120 17:06:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.120 17:06:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.120 17:06:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.120 17:06:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:49.120 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:49.120 17:06:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.120 17:06:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.120 17:06:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.120 17:06:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.120 17:06:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:49.120 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:49.120 17:06:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.120 17:06:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:49.120 17:06:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:49.120 17:06:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:49.120 17:06:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:49.120 17:06:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:49.120 17:06:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:49.120 17:06:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:49.120 17:06:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:49.120 17:06:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:49.120 17:06:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:49.120 17:06:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:49.120 17:06:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:49.120 17:06:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:49.120 17:06:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:49.120 17:06:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:49.120 17:06:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:49.380 17:06:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:49.380 17:06:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:49.380 17:06:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:49.380 17:06:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:49.380 17:06:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:49.380 17:06:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:49.380 17:06:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:49.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:49.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:13:49.380 00:13:49.380 --- 10.0.0.2 ping statistics --- 00:13:49.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.380 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:13:49.380 17:06:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:49.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:49.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:13:49.380 00:13:49.380 --- 10.0.0.1 ping statistics --- 00:13:49.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.380 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:13:49.380 17:06:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:49.380 17:06:46 -- nvmf/common.sh@410 -- # return 0 00:13:49.380 17:06:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:49.380 17:06:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:49.380 17:06:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:49.380 17:06:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:49.380 17:06:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:49.380 17:06:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:49.380 17:06:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:49.380 17:06:46 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:49.380 17:06:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:49.380 17:06:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:49.380 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:13:49.380 17:06:46 -- nvmf/common.sh@469 -- # nvmfpid=1693121 00:13:49.380 17:06:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:49.380 17:06:46 -- nvmf/common.sh@470 -- # waitforlisten 1693121 00:13:49.380 17:06:46 -- common/autotest_common.sh@829 -- # '[' -z 1693121 ']' 00:13:49.380 17:06:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.380 17:06:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:49.380 17:06:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.380 17:06:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:49.380 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:13:49.380 [2024-11-27 17:06:46.211996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:49.380 [2024-11-27 17:06:46.212072] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.380 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.380 [2024-11-27 17:06:46.283285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:49.639 [2024-11-27 17:06:46.378888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.639 [2024-11-27 17:06:46.379049] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.639 [2024-11-27 17:06:46.379076] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.639 [2024-11-27 17:06:46.379091] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.639 [2024-11-27 17:06:46.379159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.639 [2024-11-27 17:06:46.379218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:49.639 [2024-11-27 17:06:46.379271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.639 [2024-11-27 17:06:46.379274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.577 17:06:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:50.577 17:06:47 -- common/autotest_common.sh@862 -- # return 0 00:13:50.577 17:06:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:50.577 17:06:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:50.577 17:06:47 -- common/autotest_common.sh@10 -- # set +x 00:13:50.577 17:06:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.577 17:06:47 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:50.577 17:06:47 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode32443 00:13:50.577 [2024-11-27 17:06:47.525235] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:50.836 17:06:47 -- target/invalid.sh@40 -- # out='request: 00:13:50.836 { 00:13:50.836 "nqn": "nqn.2016-06.io.spdk:cnode32443", 00:13:50.836 "tgt_name": "foobar", 00:13:50.836 "method": "nvmf_create_subsystem", 00:13:50.836 "req_id": 1 00:13:50.836 } 00:13:50.836 Got JSON-RPC error response 00:13:50.836 response: 00:13:50.836 { 00:13:50.836 "code": -32603, 00:13:50.836 "message": "Unable to find target foobar" 00:13:50.836 }' 00:13:50.836 17:06:47 -- target/invalid.sh@41 -- # [[ request: 00:13:50.836 { 00:13:50.836 "nqn": "nqn.2016-06.io.spdk:cnode32443", 00:13:50.836 "tgt_name": "foobar", 00:13:50.836 "method": "nvmf_create_subsystem", 00:13:50.836 "req_id": 1 00:13:50.836 } 00:13:50.836 Got JSON-RPC error response 00:13:50.836 response: 00:13:50.836 { 00:13:50.836 "code": -32603, 00:13:50.836 "message": "Unable to find target foobar" 00:13:50.836 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:50.836 17:06:47 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:50.836 17:06:47 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode877 00:13:50.836 [2024-11-27 17:06:47.778057] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode877: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:51.097 17:06:47 -- target/invalid.sh@45 -- # out='request: 00:13:51.097 { 00:13:51.097 "nqn": "nqn.2016-06.io.spdk:cnode877", 00:13:51.097 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:51.097 "method": "nvmf_create_subsystem", 00:13:51.097 "req_id": 1 00:13:51.097 } 00:13:51.097 Got JSON-RPC error response 00:13:51.097 response: 00:13:51.097 { 00:13:51.097 "code": -32602, 00:13:51.097 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:51.097 }' 00:13:51.097 17:06:47 -- target/invalid.sh@46 -- # [[ request: 00:13:51.097 { 00:13:51.097 "nqn": "nqn.2016-06.io.spdk:cnode877", 00:13:51.097 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:51.097 "method": "nvmf_create_subsystem", 00:13:51.097 "req_id": 1 00:13:51.097 } 00:13:51.097 Got JSON-RPC error response 00:13:51.097 response: 00:13:51.097 { 00:13:51.097 "code": -32602, 00:13:51.097 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:51.097 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:51.097 17:06:47 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:51.097 17:06:47 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode17761 00:13:51.097 [2024-11-27 17:06:48.026898] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17761: invalid model number 'SPDK_Controller' 00:13:51.356 17:06:48 -- target/invalid.sh@50 -- # out='request: 00:13:51.356 { 00:13:51.356 "nqn": "nqn.2016-06.io.spdk:cnode17761", 00:13:51.356 "model_number": "SPDK_Controller\u001f", 00:13:51.356 "method": "nvmf_create_subsystem", 00:13:51.356 "req_id": 1 00:13:51.356 } 00:13:51.356 Got JSON-RPC error response 00:13:51.356 response: 00:13:51.356 { 00:13:51.356 "code": -32602, 00:13:51.356 "message": "Invalid MN SPDK_Controller\u001f" 00:13:51.356 }' 00:13:51.356 17:06:48 -- target/invalid.sh@51 -- # [[ request: 00:13:51.356 { 00:13:51.356 "nqn": "nqn.2016-06.io.spdk:cnode17761", 00:13:51.356 "model_number": "SPDK_Controller\u001f", 00:13:51.356 "method": "nvmf_create_subsystem", 00:13:51.356 "req_id": 1 00:13:51.356 } 00:13:51.356 Got JSON-RPC error response 00:13:51.356 response: 00:13:51.356 { 00:13:51.356 "code": -32602, 00:13:51.356 "message": "Invalid MN SPDK_Controller\u001f" 00:13:51.356 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:51.356 17:06:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:51.356 17:06:48 -- target/invalid.sh@19 -- # local length=21 ll 00:13:51.356 17:06:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:51.356 17:06:48 -- target/invalid.sh@21 -- # local chars 00:13:51.356 17:06:48 -- target/invalid.sh@22 -- # local string 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 90 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=Z 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 98 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=b 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 34 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+='"' 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 45 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=- 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 116 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=t 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 79 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=O 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 124 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+='|' 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # printf %x 104 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:51.356 17:06:48 -- target/invalid.sh@25 -- # string+=h 00:13:51.356 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 116 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=t 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 122 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=z 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 87 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=W 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 112 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=p 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 83 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=S 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 83 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=S 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 94 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+='^' 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 38 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+='&' 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 92 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+='\' 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 111 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=o 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 55 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+=7 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 60 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+='<' 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # printf %x 124 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:51.357 17:06:48 -- target/invalid.sh@25 -- # string+='|' 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.357 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.357 17:06:48 -- target/invalid.sh@28 -- # [[ Z == \- ]] 00:13:51.357 17:06:48 -- target/invalid.sh@31 -- # echo 'Zb"-tO|htzWpSS^&\o7<|' 00:13:51.357 17:06:48 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'Zb"-tO|htzWpSS^&\o7<|' nqn.2016-06.io.spdk:cnode15190 00:13:51.616 [2024-11-27 17:06:48.372017] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15190: invalid serial number 'Zb"-tO|htzWpSS^&\o7<|' 00:13:51.616 17:06:48 -- target/invalid.sh@54 -- # out='request: 00:13:51.616 { 00:13:51.616 "nqn": "nqn.2016-06.io.spdk:cnode15190", 00:13:51.616 "serial_number": "Zb\"-tO|htzWpSS^&\\o7<|", 00:13:51.616 "method": "nvmf_create_subsystem", 00:13:51.616 "req_id": 1 00:13:51.616 } 00:13:51.616 Got JSON-RPC error response 00:13:51.616 response: 00:13:51.616 { 00:13:51.616 "code": -32602, 00:13:51.616 "message": "Invalid SN Zb\"-tO|htzWpSS^&\\o7<|" 00:13:51.616 }' 00:13:51.616 17:06:48 -- target/invalid.sh@55 -- # [[ request: 00:13:51.616 { 00:13:51.616 "nqn": "nqn.2016-06.io.spdk:cnode15190", 00:13:51.616 "serial_number": "Zb\"-tO|htzWpSS^&\\o7<|", 00:13:51.616 "method": "nvmf_create_subsystem", 00:13:51.616 "req_id": 1 00:13:51.616 } 00:13:51.616 Got JSON-RPC error response 00:13:51.616 response: 00:13:51.616 { 00:13:51.616 "code": -32602, 00:13:51.616 "message": "Invalid SN Zb\"-tO|htzWpSS^&\\o7<|" 00:13:51.616 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:51.616 17:06:48 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:51.616 17:06:48 -- target/invalid.sh@19 -- # local length=41 ll 00:13:51.616 17:06:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:51.616 17:06:48 -- target/invalid.sh@21 -- # local chars 00:13:51.616 17:06:48 -- target/invalid.sh@22 -- # local string 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 70 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=F 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 97 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=a 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 39 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=\' 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 92 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+='\' 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 49 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=1 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 52 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x34' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=4 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 48 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=0 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 110 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=n 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 111 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=o 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 118 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=v 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 111 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=o 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 85 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=U 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 118 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=v 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 54 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=6 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 89 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=Y 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 99 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=c 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 117 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=u 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 53 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=5 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 125 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+='}' 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 43 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=+ 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 66 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=B 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 101 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=e 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 103 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # string+=g 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.616 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.616 17:06:48 -- target/invalid.sh@25 -- # printf %x 42 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+='*' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 35 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+='#' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 77 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=M 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 84 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=T 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 82 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=R 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 82 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=R 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 36 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+='$' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 59 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=';' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 51 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=3 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 32 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=' ' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 47 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=/ 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 116 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=t 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 76 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=L 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 48 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=0 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 53 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=5 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 62 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+='>' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 78 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=N 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # printf %x 39 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:51.617 17:06:48 -- target/invalid.sh@25 -- # string+=\' 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:51.617 17:06:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:51.617 17:06:48 -- target/invalid.sh@28 -- # [[ F == \- ]] 00:13:51.617 17:06:48 -- target/invalid.sh@31 -- # echo 'Fa'\''\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'\''' 00:13:51.617 17:06:48 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'Fa'\''\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'\''' nqn.2016-06.io.spdk:cnode14328 00:13:51.876 [2024-11-27 17:06:48.757335] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14328: invalid model number 'Fa'\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'' 00:13:51.876 17:06:48 -- target/invalid.sh@58 -- # out='request: 00:13:51.876 { 00:13:51.876 "nqn": "nqn.2016-06.io.spdk:cnode14328", 00:13:51.876 "model_number": "Fa'\''\\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'\''", 00:13:51.876 "method": "nvmf_create_subsystem", 00:13:51.876 "req_id": 1 00:13:51.876 } 00:13:51.876 Got JSON-RPC error response 00:13:51.876 response: 00:13:51.876 { 00:13:51.876 "code": -32602, 00:13:51.876 "message": "Invalid MN Fa'\''\\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'\''" 00:13:51.876 }' 00:13:51.876 17:06:48 -- target/invalid.sh@59 -- # [[ request: 00:13:51.876 { 00:13:51.876 "nqn": "nqn.2016-06.io.spdk:cnode14328", 00:13:51.876 "model_number": "Fa'\\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'", 00:13:51.876 "method": "nvmf_create_subsystem", 00:13:51.876 "req_id": 1 00:13:51.876 } 00:13:51.876 Got JSON-RPC error response 00:13:51.876 response: 00:13:51.876 { 00:13:51.876 "code": -32602, 00:13:51.876 "message": "Invalid MN Fa'\\140novoUv6Ycu5}+Beg*#MTRR$;3 /tL05>N'" 00:13:51.876 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:51.876 17:06:48 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:52.134 [2024-11-27 17:06:49.010277] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:52.134 17:06:49 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:52.403 17:06:49 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:52.403 17:06:49 -- target/invalid.sh@67 -- # echo '' 00:13:52.403 17:06:49 -- target/invalid.sh@67 -- # head -n 1 00:13:52.403 17:06:49 -- target/invalid.sh@67 -- # IP= 00:13:52.403 17:06:49 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:52.662 [2024-11-27 17:06:49.536108] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:52.662 17:06:49 -- target/invalid.sh@69 -- # out='request: 00:13:52.662 { 00:13:52.662 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:52.662 "listen_address": { 00:13:52.662 "trtype": "tcp", 00:13:52.662 "traddr": "", 00:13:52.662 "trsvcid": "4421" 00:13:52.662 }, 00:13:52.662 "method": "nvmf_subsystem_remove_listener", 00:13:52.662 "req_id": 1 00:13:52.662 } 00:13:52.662 Got JSON-RPC error response 00:13:52.662 response: 00:13:52.662 { 00:13:52.662 "code": -32602, 00:13:52.662 "message": "Invalid parameters" 00:13:52.662 }' 00:13:52.662 17:06:49 -- target/invalid.sh@70 -- # [[ request: 00:13:52.662 { 00:13:52.662 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:52.662 "listen_address": { 00:13:52.662 "trtype": "tcp", 00:13:52.662 "traddr": "", 00:13:52.662 "trsvcid": "4421" 00:13:52.662 }, 00:13:52.662 "method": "nvmf_subsystem_remove_listener", 00:13:52.662 "req_id": 1 00:13:52.662 } 00:13:52.662 Got JSON-RPC error response 00:13:52.662 response: 00:13:52.662 { 00:13:52.662 "code": -32602, 00:13:52.662 "message": "Invalid parameters" 00:13:52.662 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:52.662 17:06:49 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode20803 -i 0 00:13:52.919 [2024-11-27 17:06:49.792922] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20803: invalid cntlid range [0-65519] 00:13:52.919 17:06:49 -- target/invalid.sh@73 -- # out='request: 00:13:52.919 { 00:13:52.919 "nqn": "nqn.2016-06.io.spdk:cnode20803", 00:13:52.919 "min_cntlid": 0, 00:13:52.919 "method": "nvmf_create_subsystem", 00:13:52.919 "req_id": 1 00:13:52.919 } 00:13:52.919 Got JSON-RPC error response 00:13:52.919 response: 00:13:52.919 { 00:13:52.919 "code": -32602, 00:13:52.919 "message": "Invalid cntlid range [0-65519]" 00:13:52.919 }' 00:13:52.919 17:06:49 -- target/invalid.sh@74 -- # [[ request: 00:13:52.919 { 00:13:52.919 "nqn": "nqn.2016-06.io.spdk:cnode20803", 00:13:52.919 "min_cntlid": 0, 00:13:52.919 "method": "nvmf_create_subsystem", 00:13:52.919 "req_id": 1 00:13:52.919 } 00:13:52.919 Got JSON-RPC error response 00:13:52.919 response: 00:13:52.919 { 00:13:52.919 "code": -32602, 00:13:52.919 "message": "Invalid cntlid range [0-65519]" 00:13:52.919 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:52.919 17:06:49 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4219 -i 65520 00:13:53.176 [2024-11-27 17:06:50.049830] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4219: invalid cntlid range [65520-65519] 00:13:53.176 17:06:50 -- target/invalid.sh@75 -- # out='request: 00:13:53.176 { 00:13:53.176 "nqn": "nqn.2016-06.io.spdk:cnode4219", 00:13:53.176 "min_cntlid": 65520, 00:13:53.176 "method": "nvmf_create_subsystem", 00:13:53.176 "req_id": 1 00:13:53.176 } 00:13:53.176 Got JSON-RPC error response 00:13:53.176 response: 00:13:53.176 { 00:13:53.176 "code": -32602, 00:13:53.176 "message": "Invalid cntlid range [65520-65519]" 00:13:53.176 }' 00:13:53.176 17:06:50 -- target/invalid.sh@76 -- # [[ request: 00:13:53.176 { 00:13:53.176 "nqn": "nqn.2016-06.io.spdk:cnode4219", 00:13:53.176 "min_cntlid": 65520, 00:13:53.176 "method": "nvmf_create_subsystem", 00:13:53.176 "req_id": 1 00:13:53.176 } 00:13:53.176 Got JSON-RPC error response 00:13:53.176 response: 00:13:53.176 { 00:13:53.176 "code": -32602, 00:13:53.177 "message": "Invalid cntlid range [65520-65519]" 00:13:53.177 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:53.177 17:06:50 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8074 -I 0 00:13:53.434 [2024-11-27 17:06:50.306738] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8074: invalid cntlid range [1-0] 00:13:53.434 17:06:50 -- target/invalid.sh@77 -- # out='request: 00:13:53.434 { 00:13:53.434 "nqn": "nqn.2016-06.io.spdk:cnode8074", 00:13:53.434 "max_cntlid": 0, 00:13:53.434 "method": "nvmf_create_subsystem", 00:13:53.434 "req_id": 1 00:13:53.434 } 00:13:53.434 Got JSON-RPC error response 00:13:53.434 response: 00:13:53.434 { 00:13:53.434 "code": -32602, 00:13:53.434 "message": "Invalid cntlid range [1-0]" 00:13:53.434 }' 00:13:53.434 17:06:50 -- target/invalid.sh@78 -- # [[ request: 00:13:53.434 { 00:13:53.434 "nqn": "nqn.2016-06.io.spdk:cnode8074", 00:13:53.434 "max_cntlid": 0, 00:13:53.434 "method": "nvmf_create_subsystem", 00:13:53.434 "req_id": 1 00:13:53.434 } 00:13:53.434 Got JSON-RPC error response 00:13:53.434 response: 00:13:53.434 { 00:13:53.434 "code": -32602, 00:13:53.434 "message": "Invalid cntlid range [1-0]" 00:13:53.434 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:53.434 17:06:50 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17853 -I 65520 00:13:53.693 [2024-11-27 17:06:50.579705] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17853: invalid cntlid range [1-65520] 00:13:53.693 17:06:50 -- target/invalid.sh@79 -- # out='request: 00:13:53.693 { 00:13:53.693 "nqn": "nqn.2016-06.io.spdk:cnode17853", 00:13:53.693 "max_cntlid": 65520, 00:13:53.693 "method": "nvmf_create_subsystem", 00:13:53.693 "req_id": 1 00:13:53.693 } 00:13:53.693 Got JSON-RPC error response 00:13:53.693 response: 00:13:53.693 { 00:13:53.693 "code": -32602, 00:13:53.693 "message": "Invalid cntlid range [1-65520]" 00:13:53.693 }' 00:13:53.693 17:06:50 -- target/invalid.sh@80 -- # [[ request: 00:13:53.693 { 00:13:53.693 "nqn": "nqn.2016-06.io.spdk:cnode17853", 00:13:53.693 "max_cntlid": 65520, 00:13:53.693 "method": "nvmf_create_subsystem", 00:13:53.693 "req_id": 1 00:13:53.693 } 00:13:53.693 Got JSON-RPC error response 00:13:53.693 response: 00:13:53.693 { 00:13:53.693 "code": -32602, 00:13:53.693 "message": "Invalid cntlid range [1-65520]" 00:13:53.693 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:53.693 17:06:50 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23204 -i 6 -I 5 00:13:53.951 [2024-11-27 17:06:50.848638] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23204: invalid cntlid range [6-5] 00:13:53.951 17:06:50 -- target/invalid.sh@83 -- # out='request: 00:13:53.951 { 00:13:53.951 "nqn": "nqn.2016-06.io.spdk:cnode23204", 00:13:53.951 "min_cntlid": 6, 00:13:53.951 "max_cntlid": 5, 00:13:53.951 "method": "nvmf_create_subsystem", 00:13:53.951 "req_id": 1 00:13:53.951 } 00:13:53.951 Got JSON-RPC error response 00:13:53.951 response: 00:13:53.951 { 00:13:53.951 "code": -32602, 00:13:53.951 "message": "Invalid cntlid range [6-5]" 00:13:53.951 }' 00:13:53.951 17:06:50 -- target/invalid.sh@84 -- # [[ request: 00:13:53.951 { 00:13:53.951 "nqn": "nqn.2016-06.io.spdk:cnode23204", 00:13:53.951 "min_cntlid": 6, 00:13:53.951 "max_cntlid": 5, 00:13:53.951 "method": "nvmf_create_subsystem", 00:13:53.951 "req_id": 1 00:13:53.951 } 00:13:53.951 Got JSON-RPC error response 00:13:53.951 response: 00:13:53.951 { 00:13:53.951 "code": -32602, 00:13:53.951 "message": "Invalid cntlid range [6-5]" 00:13:53.951 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:53.951 17:06:50 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:54.210 17:06:50 -- target/invalid.sh@87 -- # out='request: 00:13:54.210 { 00:13:54.210 "name": "foobar", 00:13:54.210 "method": "nvmf_delete_target", 00:13:54.210 "req_id": 1 00:13:54.210 } 00:13:54.210 Got JSON-RPC error response 00:13:54.210 response: 00:13:54.210 { 00:13:54.210 "code": -32602, 00:13:54.210 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:54.210 }' 00:13:54.210 17:06:50 -- target/invalid.sh@88 -- # [[ request: 00:13:54.210 { 00:13:54.210 "name": "foobar", 00:13:54.210 "method": "nvmf_delete_target", 00:13:54.210 "req_id": 1 00:13:54.210 } 00:13:54.210 Got JSON-RPC error response 00:13:54.210 response: 00:13:54.210 { 00:13:54.210 "code": -32602, 00:13:54.210 "message": "The specified target doesn't exist, cannot delete it." 00:13:54.210 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:54.210 17:06:50 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:54.210 17:06:50 -- target/invalid.sh@91 -- # nvmftestfini 00:13:54.210 17:06:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:54.210 17:06:50 -- nvmf/common.sh@116 -- # sync 00:13:54.210 17:06:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:54.210 17:06:50 -- nvmf/common.sh@119 -- # set +e 00:13:54.210 17:06:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:54.210 17:06:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:54.210 rmmod nvme_tcp 00:13:54.210 rmmod nvme_fabrics 00:13:54.210 rmmod nvme_keyring 00:13:54.210 17:06:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:54.210 17:06:51 -- nvmf/common.sh@123 -- # set -e 00:13:54.210 17:06:51 -- nvmf/common.sh@124 -- # return 0 00:13:54.210 17:06:51 -- nvmf/common.sh@477 -- # '[' -n 1693121 ']' 00:13:54.210 17:06:51 -- nvmf/common.sh@478 -- # killprocess 1693121 00:13:54.210 17:06:51 -- common/autotest_common.sh@936 -- # '[' -z 1693121 ']' 00:13:54.210 17:06:51 -- common/autotest_common.sh@940 -- # kill -0 1693121 00:13:54.210 17:06:51 -- common/autotest_common.sh@941 -- # uname 00:13:54.210 17:06:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:54.210 17:06:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1693121 00:13:54.210 17:06:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:54.210 17:06:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:54.210 17:06:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1693121' 00:13:54.210 killing process with pid 1693121 00:13:54.210 17:06:51 -- common/autotest_common.sh@955 -- # kill 1693121 00:13:54.210 17:06:51 -- common/autotest_common.sh@960 -- # wait 1693121 00:13:54.470 17:06:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:54.470 17:06:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:54.470 17:06:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:54.470 17:06:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:54.470 17:06:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:54.470 17:06:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:54.470 17:06:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:54.470 17:06:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:57.003 17:06:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:57.003 00:13:57.003 real 0m9.535s 00:13:57.003 user 0m23.788s 00:13:57.003 sys 0m2.471s 00:13:57.003 17:06:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:57.003 17:06:53 -- common/autotest_common.sh@10 -- # set +x 00:13:57.003 ************************************ 00:13:57.003 END TEST nvmf_invalid 00:13:57.003 ************************************ 00:13:57.003 17:06:53 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:57.003 17:06:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:57.003 17:06:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:57.003 17:06:53 -- common/autotest_common.sh@10 -- # set +x 00:13:57.003 ************************************ 00:13:57.003 START TEST nvmf_abort 00:13:57.003 ************************************ 00:13:57.003 17:06:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:57.003 * Looking for test storage... 00:13:57.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:57.003 17:06:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:57.003 17:06:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:57.003 17:06:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:57.003 17:06:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:57.003 17:06:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:57.003 17:06:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:57.003 17:06:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:57.003 17:06:53 -- scripts/common.sh@335 -- # IFS=.-: 00:13:57.003 17:06:53 -- scripts/common.sh@335 -- # read -ra ver1 00:13:57.003 17:06:53 -- scripts/common.sh@336 -- # IFS=.-: 00:13:57.003 17:06:53 -- scripts/common.sh@336 -- # read -ra ver2 00:13:57.003 17:06:53 -- scripts/common.sh@337 -- # local 'op=<' 00:13:57.003 17:06:53 -- scripts/common.sh@339 -- # ver1_l=2 00:13:57.003 17:06:53 -- scripts/common.sh@340 -- # ver2_l=1 00:13:57.003 17:06:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:57.003 17:06:53 -- scripts/common.sh@343 -- # case "$op" in 00:13:57.003 17:06:53 -- scripts/common.sh@344 -- # : 1 00:13:57.003 17:06:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:57.003 17:06:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:57.003 17:06:53 -- scripts/common.sh@364 -- # decimal 1 00:13:57.003 17:06:53 -- scripts/common.sh@352 -- # local d=1 00:13:57.003 17:06:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:57.003 17:06:53 -- scripts/common.sh@354 -- # echo 1 00:13:57.003 17:06:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:57.003 17:06:53 -- scripts/common.sh@365 -- # decimal 2 00:13:57.003 17:06:53 -- scripts/common.sh@352 -- # local d=2 00:13:57.003 17:06:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:57.003 17:06:53 -- scripts/common.sh@354 -- # echo 2 00:13:57.003 17:06:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:57.003 17:06:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:57.003 17:06:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:57.003 17:06:53 -- scripts/common.sh@367 -- # return 0 00:13:57.003 17:06:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:57.003 17:06:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:57.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:57.003 --rc genhtml_branch_coverage=1 00:13:57.003 --rc genhtml_function_coverage=1 00:13:57.003 --rc genhtml_legend=1 00:13:57.003 --rc geninfo_all_blocks=1 00:13:57.003 --rc geninfo_unexecuted_blocks=1 00:13:57.003 00:13:57.003 ' 00:13:57.003 17:06:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:57.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:57.004 --rc genhtml_branch_coverage=1 00:13:57.004 --rc genhtml_function_coverage=1 00:13:57.004 --rc genhtml_legend=1 00:13:57.004 --rc geninfo_all_blocks=1 00:13:57.004 --rc geninfo_unexecuted_blocks=1 00:13:57.004 00:13:57.004 ' 00:13:57.004 17:06:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:57.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:57.004 --rc genhtml_branch_coverage=1 00:13:57.004 --rc genhtml_function_coverage=1 00:13:57.004 --rc genhtml_legend=1 00:13:57.004 --rc geninfo_all_blocks=1 00:13:57.004 --rc geninfo_unexecuted_blocks=1 00:13:57.004 00:13:57.004 ' 00:13:57.004 17:06:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:57.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:57.004 --rc genhtml_branch_coverage=1 00:13:57.004 --rc genhtml_function_coverage=1 00:13:57.004 --rc genhtml_legend=1 00:13:57.004 --rc geninfo_all_blocks=1 00:13:57.004 --rc geninfo_unexecuted_blocks=1 00:13:57.004 00:13:57.004 ' 00:13:57.004 17:06:53 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:57.004 17:06:53 -- nvmf/common.sh@7 -- # uname -s 00:13:57.004 17:06:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:57.004 17:06:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:57.004 17:06:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:57.004 17:06:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:57.004 17:06:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:57.004 17:06:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:57.004 17:06:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:57.004 17:06:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:57.004 17:06:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:57.004 17:06:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:57.004 17:06:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:57.004 17:06:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:57.004 17:06:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:57.004 17:06:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:57.004 17:06:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:57.004 17:06:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:57.004 17:06:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:57.004 17:06:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:57.004 17:06:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:57.004 17:06:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.004 17:06:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.004 17:06:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.004 17:06:53 -- paths/export.sh@5 -- # export PATH 00:13:57.004 17:06:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.004 17:06:53 -- nvmf/common.sh@46 -- # : 0 00:13:57.004 17:06:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:57.004 17:06:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:57.004 17:06:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:57.004 17:06:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:57.004 17:06:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:57.004 17:06:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:57.004 17:06:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:57.004 17:06:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:57.004 17:06:53 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:57.004 17:06:53 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:57.004 17:06:53 -- target/abort.sh@14 -- # nvmftestinit 00:13:57.004 17:06:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:57.004 17:06:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:57.004 17:06:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:57.004 17:06:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:57.004 17:06:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:57.004 17:06:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:57.004 17:06:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:57.004 17:06:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:57.004 17:06:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:57.004 17:06:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:57.004 17:06:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:57.004 17:06:53 -- common/autotest_common.sh@10 -- # set +x 00:13:58.908 17:06:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:58.908 17:06:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:58.908 17:06:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:58.908 17:06:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:58.908 17:06:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:58.908 17:06:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:58.908 17:06:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:58.908 17:06:55 -- nvmf/common.sh@294 -- # net_devs=() 00:13:58.908 17:06:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:58.908 17:06:55 -- nvmf/common.sh@295 -- # e810=() 00:13:58.908 17:06:55 -- nvmf/common.sh@295 -- # local -ga e810 00:13:58.908 17:06:55 -- nvmf/common.sh@296 -- # x722=() 00:13:58.908 17:06:55 -- nvmf/common.sh@296 -- # local -ga x722 00:13:58.908 17:06:55 -- nvmf/common.sh@297 -- # mlx=() 00:13:58.908 17:06:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:58.908 17:06:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:58.908 17:06:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:58.908 17:06:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:58.908 17:06:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:58.908 17:06:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:58.908 17:06:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:58.908 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:58.908 17:06:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:58.908 17:06:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:58.908 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:58.908 17:06:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:58.908 17:06:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:58.908 17:06:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:58.909 17:06:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:58.909 17:06:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:58.909 17:06:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:58.909 17:06:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:58.909 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:58.909 17:06:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:58.909 17:06:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:58.909 17:06:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:58.909 17:06:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:58.909 17:06:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:58.909 17:06:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:58.909 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:58.909 17:06:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:58.909 17:06:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:58.909 17:06:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:58.909 17:06:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:58.909 17:06:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:58.909 17:06:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:58.909 17:06:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:58.909 17:06:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:58.909 17:06:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:58.909 17:06:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:58.909 17:06:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:58.909 17:06:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:58.909 17:06:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:58.909 17:06:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:58.909 17:06:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:58.909 17:06:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:58.909 17:06:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:58.909 17:06:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:58.909 17:06:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:58.909 17:06:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:58.909 17:06:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:58.909 17:06:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:58.909 17:06:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:58.909 17:06:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:58.909 17:06:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:58.909 17:06:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:58.909 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:58.909 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:13:58.909 00:13:58.909 --- 10.0.0.2 ping statistics --- 00:13:58.909 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:58.909 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:13:58.909 17:06:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:58.909 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:58.909 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:13:58.909 00:13:58.909 --- 10.0.0.1 ping statistics --- 00:13:58.909 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:58.909 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:13:58.909 17:06:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:58.909 17:06:55 -- nvmf/common.sh@410 -- # return 0 00:13:58.909 17:06:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:58.909 17:06:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:58.909 17:06:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:58.909 17:06:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:58.909 17:06:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:58.909 17:06:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:58.909 17:06:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:58.909 17:06:55 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:58.909 17:06:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:58.909 17:06:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:58.909 17:06:55 -- common/autotest_common.sh@10 -- # set +x 00:13:58.909 17:06:55 -- nvmf/common.sh@469 -- # nvmfpid=1695798 00:13:58.909 17:06:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:58.909 17:06:55 -- nvmf/common.sh@470 -- # waitforlisten 1695798 00:13:58.909 17:06:55 -- common/autotest_common.sh@829 -- # '[' -z 1695798 ']' 00:13:58.909 17:06:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:58.909 17:06:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:58.909 17:06:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:58.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:58.909 17:06:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:58.909 17:06:55 -- common/autotest_common.sh@10 -- # set +x 00:13:58.909 [2024-11-27 17:06:55.731260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:58.909 [2024-11-27 17:06:55.731343] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:58.909 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.909 [2024-11-27 17:06:55.800177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:59.169 [2024-11-27 17:06:55.893743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:59.169 [2024-11-27 17:06:55.893915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:59.169 [2024-11-27 17:06:55.893935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:59.169 [2024-11-27 17:06:55.893950] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:59.169 [2024-11-27 17:06:55.894033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:59.169 [2024-11-27 17:06:55.894086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:59.169 [2024-11-27 17:06:55.894089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:59.740 17:06:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:59.740 17:06:56 -- common/autotest_common.sh@862 -- # return 0 00:13:59.740 17:06:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:59.740 17:06:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:59.740 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:13:59.999 17:06:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:59.999 17:06:56 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:59.999 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.999 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:13:59.999 [2024-11-27 17:06:56.715820] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:59.999 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.999 17:06:56 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:59.999 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.999 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:13:59.999 Malloc0 00:13:59.999 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.999 17:06:56 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:59.999 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.999 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:14:00.000 Delay0 00:14:00.000 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.000 17:06:56 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:00.000 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.000 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:14:00.000 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.000 17:06:56 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:14:00.000 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.000 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:14:00.000 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.000 17:06:56 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:00.000 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.000 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:14:00.000 [2024-11-27 17:06:56.790080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:00.000 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.000 17:06:56 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:00.000 17:06:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.000 17:06:56 -- common/autotest_common.sh@10 -- # set +x 00:14:00.000 17:06:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.000 17:06:56 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:14:00.000 EAL: No free 2048 kB hugepages reported on node 1 00:14:00.000 [2024-11-27 17:06:56.937686] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:02.679 Initializing NVMe Controllers 00:14:02.679 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:02.679 controller IO queue size 128 less than required 00:14:02.679 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:02.679 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:02.679 Initialization complete. Launching workers. 00:14:02.679 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 30189 00:14:02.679 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 30250, failed to submit 62 00:14:02.679 success 30189, unsuccess 61, failed 0 00:14:02.679 17:06:59 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:02.679 17:06:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.679 17:06:59 -- common/autotest_common.sh@10 -- # set +x 00:14:02.680 17:06:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.680 17:06:59 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:02.680 17:06:59 -- target/abort.sh@38 -- # nvmftestfini 00:14:02.680 17:06:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:02.680 17:06:59 -- nvmf/common.sh@116 -- # sync 00:14:02.680 17:06:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:02.680 17:06:59 -- nvmf/common.sh@119 -- # set +e 00:14:02.680 17:06:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:02.680 17:06:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:02.680 rmmod nvme_tcp 00:14:02.680 rmmod nvme_fabrics 00:14:02.680 rmmod nvme_keyring 00:14:02.680 17:06:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:02.680 17:06:59 -- nvmf/common.sh@123 -- # set -e 00:14:02.680 17:06:59 -- nvmf/common.sh@124 -- # return 0 00:14:02.680 17:06:59 -- nvmf/common.sh@477 -- # '[' -n 1695798 ']' 00:14:02.680 17:06:59 -- nvmf/common.sh@478 -- # killprocess 1695798 00:14:02.680 17:06:59 -- common/autotest_common.sh@936 -- # '[' -z 1695798 ']' 00:14:02.680 17:06:59 -- common/autotest_common.sh@940 -- # kill -0 1695798 00:14:02.680 17:06:59 -- common/autotest_common.sh@941 -- # uname 00:14:02.680 17:06:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:02.680 17:06:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1695798 00:14:02.680 17:06:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:02.680 17:06:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:02.680 17:06:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1695798' 00:14:02.680 killing process with pid 1695798 00:14:02.680 17:06:59 -- common/autotest_common.sh@955 -- # kill 1695798 00:14:02.680 17:06:59 -- common/autotest_common.sh@960 -- # wait 1695798 00:14:02.680 17:06:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:02.680 17:06:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:02.680 17:06:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:02.680 17:06:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:02.680 17:06:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:02.680 17:06:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:02.680 17:06:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:02.680 17:06:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:04.583 17:07:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:04.583 00:14:04.583 real 0m8.039s 00:14:04.583 user 0m12.933s 00:14:04.583 sys 0m2.592s 00:14:04.583 17:07:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:04.583 17:07:01 -- common/autotest_common.sh@10 -- # set +x 00:14:04.583 ************************************ 00:14:04.583 END TEST nvmf_abort 00:14:04.583 ************************************ 00:14:04.583 17:07:01 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:04.583 17:07:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:04.583 17:07:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:04.583 17:07:01 -- common/autotest_common.sh@10 -- # set +x 00:14:04.583 ************************************ 00:14:04.583 START TEST nvmf_ns_hotplug_stress 00:14:04.583 ************************************ 00:14:04.583 17:07:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:04.583 * Looking for test storage... 00:14:04.583 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:04.583 17:07:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:04.583 17:07:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:04.583 17:07:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:04.842 17:07:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:04.842 17:07:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:04.842 17:07:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:04.842 17:07:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:04.842 17:07:01 -- scripts/common.sh@335 -- # IFS=.-: 00:14:04.842 17:07:01 -- scripts/common.sh@335 -- # read -ra ver1 00:14:04.842 17:07:01 -- scripts/common.sh@336 -- # IFS=.-: 00:14:04.842 17:07:01 -- scripts/common.sh@336 -- # read -ra ver2 00:14:04.842 17:07:01 -- scripts/common.sh@337 -- # local 'op=<' 00:14:04.842 17:07:01 -- scripts/common.sh@339 -- # ver1_l=2 00:14:04.842 17:07:01 -- scripts/common.sh@340 -- # ver2_l=1 00:14:04.842 17:07:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:04.842 17:07:01 -- scripts/common.sh@343 -- # case "$op" in 00:14:04.842 17:07:01 -- scripts/common.sh@344 -- # : 1 00:14:04.842 17:07:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:04.842 17:07:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:04.842 17:07:01 -- scripts/common.sh@364 -- # decimal 1 00:14:04.842 17:07:01 -- scripts/common.sh@352 -- # local d=1 00:14:04.842 17:07:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:04.842 17:07:01 -- scripts/common.sh@354 -- # echo 1 00:14:04.842 17:07:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:04.842 17:07:01 -- scripts/common.sh@365 -- # decimal 2 00:14:04.842 17:07:01 -- scripts/common.sh@352 -- # local d=2 00:14:04.842 17:07:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:04.842 17:07:01 -- scripts/common.sh@354 -- # echo 2 00:14:04.842 17:07:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:04.842 17:07:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:04.842 17:07:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:04.842 17:07:01 -- scripts/common.sh@367 -- # return 0 00:14:04.842 17:07:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:04.842 17:07:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:04.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.842 --rc genhtml_branch_coverage=1 00:14:04.842 --rc genhtml_function_coverage=1 00:14:04.842 --rc genhtml_legend=1 00:14:04.842 --rc geninfo_all_blocks=1 00:14:04.842 --rc geninfo_unexecuted_blocks=1 00:14:04.842 00:14:04.842 ' 00:14:04.842 17:07:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:04.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.842 --rc genhtml_branch_coverage=1 00:14:04.842 --rc genhtml_function_coverage=1 00:14:04.842 --rc genhtml_legend=1 00:14:04.842 --rc geninfo_all_blocks=1 00:14:04.842 --rc geninfo_unexecuted_blocks=1 00:14:04.842 00:14:04.842 ' 00:14:04.842 17:07:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:04.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.842 --rc genhtml_branch_coverage=1 00:14:04.842 --rc genhtml_function_coverage=1 00:14:04.842 --rc genhtml_legend=1 00:14:04.842 --rc geninfo_all_blocks=1 00:14:04.842 --rc geninfo_unexecuted_blocks=1 00:14:04.842 00:14:04.842 ' 00:14:04.842 17:07:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:04.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.842 --rc genhtml_branch_coverage=1 00:14:04.842 --rc genhtml_function_coverage=1 00:14:04.842 --rc genhtml_legend=1 00:14:04.842 --rc geninfo_all_blocks=1 00:14:04.842 --rc geninfo_unexecuted_blocks=1 00:14:04.842 00:14:04.842 ' 00:14:04.842 17:07:01 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:04.842 17:07:01 -- nvmf/common.sh@7 -- # uname -s 00:14:04.842 17:07:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:04.842 17:07:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:04.842 17:07:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:04.842 17:07:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:04.842 17:07:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:04.842 17:07:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:04.843 17:07:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:04.843 17:07:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:04.843 17:07:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:04.843 17:07:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:04.843 17:07:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:04.843 17:07:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:04.843 17:07:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:04.843 17:07:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:04.843 17:07:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:04.843 17:07:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:04.843 17:07:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:04.843 17:07:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:04.843 17:07:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:04.843 17:07:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.843 17:07:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.843 17:07:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.843 17:07:01 -- paths/export.sh@5 -- # export PATH 00:14:04.843 17:07:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.843 17:07:01 -- nvmf/common.sh@46 -- # : 0 00:14:04.843 17:07:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:04.843 17:07:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:04.843 17:07:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:04.843 17:07:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:04.843 17:07:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:04.843 17:07:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:04.843 17:07:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:04.843 17:07:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:04.843 17:07:01 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:04.843 17:07:01 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:04.843 17:07:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:04.843 17:07:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:04.843 17:07:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:04.843 17:07:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:04.843 17:07:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:04.843 17:07:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:04.843 17:07:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:04.843 17:07:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:04.843 17:07:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:04.843 17:07:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:04.843 17:07:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:04.843 17:07:01 -- common/autotest_common.sh@10 -- # set +x 00:14:06.750 17:07:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:06.750 17:07:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:06.750 17:07:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:06.750 17:07:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:06.750 17:07:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:06.751 17:07:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:06.751 17:07:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:06.751 17:07:03 -- nvmf/common.sh@294 -- # net_devs=() 00:14:06.751 17:07:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:06.751 17:07:03 -- nvmf/common.sh@295 -- # e810=() 00:14:06.751 17:07:03 -- nvmf/common.sh@295 -- # local -ga e810 00:14:06.751 17:07:03 -- nvmf/common.sh@296 -- # x722=() 00:14:06.751 17:07:03 -- nvmf/common.sh@296 -- # local -ga x722 00:14:06.751 17:07:03 -- nvmf/common.sh@297 -- # mlx=() 00:14:06.751 17:07:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:06.751 17:07:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:06.751 17:07:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:06.751 17:07:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:06.751 17:07:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.751 17:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:06.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:06.751 17:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.751 17:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:06.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:06.751 17:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.751 17:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.751 17:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.751 17:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:06.751 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:06.751 17:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.751 17:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.751 17:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.751 17:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.751 17:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:06.751 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:06.751 17:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.751 17:07:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:06.751 17:07:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:06.751 17:07:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:06.751 17:07:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:06.751 17:07:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:06.751 17:07:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:06.751 17:07:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:06.751 17:07:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:06.751 17:07:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:06.751 17:07:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:06.751 17:07:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:06.751 17:07:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:06.751 17:07:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:06.751 17:07:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:06.751 17:07:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:06.751 17:07:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:07.011 17:07:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:07.011 17:07:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:07.011 17:07:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:07.011 17:07:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:07.011 17:07:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:07.011 17:07:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:07.011 17:07:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:07.011 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:07.011 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:14:07.011 00:14:07.011 --- 10.0.0.2 ping statistics --- 00:14:07.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.011 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:14:07.011 17:07:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:07.011 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:07.011 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:14:07.011 00:14:07.011 --- 10.0.0.1 ping statistics --- 00:14:07.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.011 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:14:07.011 17:07:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:07.011 17:07:03 -- nvmf/common.sh@410 -- # return 0 00:14:07.011 17:07:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:07.011 17:07:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:07.011 17:07:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:07.011 17:07:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:07.011 17:07:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:07.011 17:07:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:07.011 17:07:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:07.011 17:07:03 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:07.011 17:07:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:07.011 17:07:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:07.011 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.011 17:07:03 -- nvmf/common.sh@469 -- # nvmfpid=1698185 00:14:07.011 17:07:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:07.011 17:07:03 -- nvmf/common.sh@470 -- # waitforlisten 1698185 00:14:07.011 17:07:03 -- common/autotest_common.sh@829 -- # '[' -z 1698185 ']' 00:14:07.011 17:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:07.011 17:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:07.011 17:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:07.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:07.011 17:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:07.011 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.011 [2024-11-27 17:07:03.850413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:07.011 [2024-11-27 17:07:03.850511] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:07.011 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.011 [2024-11-27 17:07:03.918814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:07.270 [2024-11-27 17:07:04.010651] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:07.270 [2024-11-27 17:07:04.010829] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:07.270 [2024-11-27 17:07:04.010849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:07.270 [2024-11-27 17:07:04.010863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:07.270 [2024-11-27 17:07:04.010955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:07.270 [2024-11-27 17:07:04.011022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:07.270 [2024-11-27 17:07:04.011026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:08.203 17:07:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:08.203 17:07:04 -- common/autotest_common.sh@862 -- # return 0 00:14:08.203 17:07:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:08.203 17:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:08.203 17:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:08.203 17:07:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:08.203 17:07:04 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:08.203 17:07:04 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:08.203 [2024-11-27 17:07:05.047448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:08.203 17:07:05 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:08.461 17:07:05 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:08.719 [2024-11-27 17:07:05.550317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:08.719 17:07:05 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:08.977 17:07:05 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:09.235 Malloc0 00:14:09.235 17:07:06 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:09.492 Delay0 00:14:09.492 17:07:06 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.750 17:07:06 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:10.008 NULL1 00:14:10.008 17:07:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:10.267 17:07:07 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:10.267 17:07:07 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1698629 00:14:10.267 17:07:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:10.267 17:07:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.267 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.639 Read completed with error (sct=0, sc=11) 00:14:11.639 17:07:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.639 17:07:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:11.639 17:07:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:11.897 true 00:14:11.897 17:07:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:11.897 17:07:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.828 17:07:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.086 17:07:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:13.086 17:07:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:13.343 true 00:14:13.343 17:07:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:13.343 17:07:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.601 17:07:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.858 17:07:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:13.858 17:07:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:14.116 true 00:14:14.116 17:07:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:14.116 17:07:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.373 17:07:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.631 17:07:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:14.631 17:07:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:14.631 true 00:14:14.889 17:07:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:14.889 17:07:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.821 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:15.821 17:07:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.821 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.079 17:07:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:16.079 17:07:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:16.337 true 00:14:16.337 17:07:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:16.337 17:07:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.594 17:07:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.852 17:07:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:16.852 17:07:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:17.110 true 00:14:17.110 17:07:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:17.110 17:07:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.043 17:07:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.043 17:07:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:18.043 17:07:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:18.301 true 00:14:18.301 17:07:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:18.301 17:07:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.559 17:07:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.817 17:07:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:18.817 17:07:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:19.075 true 00:14:19.075 17:07:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:19.075 17:07:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.009 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.009 17:07:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.009 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.267 17:07:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:20.267 17:07:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:20.525 true 00:14:20.525 17:07:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:20.525 17:07:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.783 17:07:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.041 17:07:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:21.041 17:07:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:21.298 true 00:14:21.298 17:07:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:21.298 17:07:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.230 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.230 17:07:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.230 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.230 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.486 17:07:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:22.486 17:07:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:22.743 true 00:14:22.743 17:07:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:22.744 17:07:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.001 17:07:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.259 17:07:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:23.259 17:07:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:23.517 true 00:14:23.517 17:07:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:23.517 17:07:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.450 17:07:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.709 17:07:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:24.709 17:07:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:24.967 true 00:14:24.967 17:07:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:24.967 17:07:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.224 17:07:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.483 17:07:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:25.483 17:07:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:25.483 true 00:14:25.741 17:07:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:25.741 17:07:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.999 17:07:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.999 17:07:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:25.999 17:07:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:26.257 true 00:14:26.257 17:07:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:26.257 17:07:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 17:07:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.629 17:07:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:27.629 17:07:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:27.886 true 00:14:28.143 17:07:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:28.144 17:07:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.709 17:07:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.966 17:07:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:28.966 17:07:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:29.224 true 00:14:29.224 17:07:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:29.224 17:07:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.481 17:07:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.738 17:07:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:29.738 17:07:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:29.995 true 00:14:29.995 17:07:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:29.995 17:07:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.252 17:07:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.509 17:07:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:30.509 17:07:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:30.766 true 00:14:30.766 17:07:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:30.766 17:07:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.742 17:07:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.743 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.022 17:07:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:32.022 17:07:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:32.278 true 00:14:32.278 17:07:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:32.278 17:07:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.535 17:07:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.793 17:07:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:32.793 17:07:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:33.052 true 00:14:33.052 17:07:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:33.052 17:07:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.985 17:07:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:34.244 17:07:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:34.244 17:07:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:34.502 true 00:14:34.502 17:07:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:34.502 17:07:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.760 17:07:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.017 17:07:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:35.017 17:07:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:35.275 true 00:14:35.275 17:07:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:35.275 17:07:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.533 17:07:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.791 17:07:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:35.791 17:07:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:35.791 true 00:14:36.047 17:07:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:36.047 17:07:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.980 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.980 17:07:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.980 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:37.238 17:07:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:37.239 17:07:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:37.497 true 00:14:37.497 17:07:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:37.497 17:07:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.755 17:07:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.013 17:07:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:38.013 17:07:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:38.272 true 00:14:38.272 17:07:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:38.272 17:07:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.207 17:07:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.207 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:39.207 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:39.207 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:39.465 17:07:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:39.465 17:07:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:39.722 true 00:14:39.722 17:07:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:39.722 17:07:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.980 17:07:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.238 17:07:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:40.238 17:07:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:40.496 true 00:14:40.496 17:07:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:40.496 17:07:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.429 Initializing NVMe Controllers 00:14:41.429 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:41.429 Controller IO queue size 128, less than required. 00:14:41.429 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.429 Controller IO queue size 128, less than required. 00:14:41.429 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.429 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:41.429 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:41.429 Initialization complete. Launching workers. 00:14:41.429 ======================================================== 00:14:41.429 Latency(us) 00:14:41.429 Device Information : IOPS MiB/s Average min max 00:14:41.429 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1036.60 0.51 65212.12 2521.78 1155126.56 00:14:41.429 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11377.17 5.56 11250.45 2717.84 446253.64 00:14:41.429 ======================================================== 00:14:41.429 Total : 12413.77 6.06 15756.47 2521.78 1155126.56 00:14:41.429 00:14:41.429 17:07:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:41.688 17:07:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:41.688 17:07:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:41.946 true 00:14:41.946 17:07:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1698629 00:14:41.946 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1698629) - No such process 00:14:41.946 17:07:38 -- target/ns_hotplug_stress.sh@53 -- # wait 1698629 00:14:41.946 17:07:38 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:42.204 17:07:38 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:42.474 17:07:39 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:42.474 17:07:39 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:42.474 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:42.474 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:42.474 17:07:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:42.474 null0 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:42.731 null1 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:42.731 17:07:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:42.989 null2 00:14:42.989 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:42.989 17:07:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:42.989 17:07:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:43.247 null3 00:14:43.505 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.505 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.505 17:07:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:43.505 null4 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:43.762 null5 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.762 17:07:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:44.020 null6 00:14:44.279 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:44.279 17:07:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:44.279 17:07:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:44.279 null7 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@66 -- # wait 1702917 1702918 1702920 1702922 1702924 1702926 1702928 1702930 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.539 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:44.797 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:44.798 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:44.798 17:07:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.055 17:07:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.314 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.572 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.830 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.830 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.831 17:07:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.089 17:07:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.347 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.605 17:07:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.864 17:07:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.123 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.124 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:47.382 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.641 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.899 17:07:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:48.158 17:07:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.417 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:48.675 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.934 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.935 17:07:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:49.193 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:49.193 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.193 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:49.193 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:49.193 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:49.194 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:49.194 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:49.194 17:07:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.450 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.451 17:07:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:49.708 17:07:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:49.966 17:07:46 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:49.966 17:07:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:49.966 17:07:46 -- nvmf/common.sh@116 -- # sync 00:14:49.966 17:07:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:49.966 17:07:46 -- nvmf/common.sh@119 -- # set +e 00:14:49.966 17:07:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:49.966 17:07:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:49.966 rmmod nvme_tcp 00:14:49.966 rmmod nvme_fabrics 00:14:49.966 rmmod nvme_keyring 00:14:49.966 17:07:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:49.966 17:07:46 -- nvmf/common.sh@123 -- # set -e 00:14:49.966 17:07:46 -- nvmf/common.sh@124 -- # return 0 00:14:49.966 17:07:46 -- nvmf/common.sh@477 -- # '[' -n 1698185 ']' 00:14:49.966 17:07:46 -- nvmf/common.sh@478 -- # killprocess 1698185 00:14:49.966 17:07:46 -- common/autotest_common.sh@936 -- # '[' -z 1698185 ']' 00:14:49.966 17:07:46 -- common/autotest_common.sh@940 -- # kill -0 1698185 00:14:49.966 17:07:46 -- common/autotest_common.sh@941 -- # uname 00:14:49.966 17:07:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:49.966 17:07:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1698185 00:14:50.223 17:07:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:50.223 17:07:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:50.223 17:07:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1698185' 00:14:50.223 killing process with pid 1698185 00:14:50.223 17:07:46 -- common/autotest_common.sh@955 -- # kill 1698185 00:14:50.223 17:07:46 -- common/autotest_common.sh@960 -- # wait 1698185 00:14:50.223 17:07:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:50.223 17:07:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:50.223 17:07:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:50.223 17:07:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:50.223 17:07:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:50.223 17:07:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:50.223 17:07:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:50.223 17:07:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.758 17:07:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:52.758 00:14:52.758 real 0m47.718s 00:14:52.758 user 3m38.157s 00:14:52.758 sys 0m15.290s 00:14:52.758 17:07:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:52.758 17:07:49 -- common/autotest_common.sh@10 -- # set +x 00:14:52.758 ************************************ 00:14:52.758 END TEST nvmf_ns_hotplug_stress 00:14:52.758 ************************************ 00:14:52.758 17:07:49 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:52.758 17:07:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:52.758 17:07:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:52.758 17:07:49 -- common/autotest_common.sh@10 -- # set +x 00:14:52.758 ************************************ 00:14:52.758 START TEST nvmf_connect_stress 00:14:52.758 ************************************ 00:14:52.758 17:07:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:52.758 * Looking for test storage... 00:14:52.758 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:52.758 17:07:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:52.758 17:07:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:52.758 17:07:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:52.758 17:07:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:52.758 17:07:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:52.758 17:07:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:52.758 17:07:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:52.758 17:07:49 -- scripts/common.sh@335 -- # IFS=.-: 00:14:52.758 17:07:49 -- scripts/common.sh@335 -- # read -ra ver1 00:14:52.758 17:07:49 -- scripts/common.sh@336 -- # IFS=.-: 00:14:52.758 17:07:49 -- scripts/common.sh@336 -- # read -ra ver2 00:14:52.758 17:07:49 -- scripts/common.sh@337 -- # local 'op=<' 00:14:52.758 17:07:49 -- scripts/common.sh@339 -- # ver1_l=2 00:14:52.758 17:07:49 -- scripts/common.sh@340 -- # ver2_l=1 00:14:52.758 17:07:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:52.758 17:07:49 -- scripts/common.sh@343 -- # case "$op" in 00:14:52.758 17:07:49 -- scripts/common.sh@344 -- # : 1 00:14:52.758 17:07:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:52.758 17:07:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:52.758 17:07:49 -- scripts/common.sh@364 -- # decimal 1 00:14:52.758 17:07:49 -- scripts/common.sh@352 -- # local d=1 00:14:52.758 17:07:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:52.758 17:07:49 -- scripts/common.sh@354 -- # echo 1 00:14:52.758 17:07:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:52.758 17:07:49 -- scripts/common.sh@365 -- # decimal 2 00:14:52.758 17:07:49 -- scripts/common.sh@352 -- # local d=2 00:14:52.758 17:07:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:52.758 17:07:49 -- scripts/common.sh@354 -- # echo 2 00:14:52.758 17:07:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:52.758 17:07:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:52.758 17:07:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:52.758 17:07:49 -- scripts/common.sh@367 -- # return 0 00:14:52.758 17:07:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:52.758 17:07:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:52.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.759 --rc genhtml_branch_coverage=1 00:14:52.759 --rc genhtml_function_coverage=1 00:14:52.759 --rc genhtml_legend=1 00:14:52.759 --rc geninfo_all_blocks=1 00:14:52.759 --rc geninfo_unexecuted_blocks=1 00:14:52.759 00:14:52.759 ' 00:14:52.759 17:07:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:52.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.759 --rc genhtml_branch_coverage=1 00:14:52.759 --rc genhtml_function_coverage=1 00:14:52.759 --rc genhtml_legend=1 00:14:52.759 --rc geninfo_all_blocks=1 00:14:52.759 --rc geninfo_unexecuted_blocks=1 00:14:52.759 00:14:52.759 ' 00:14:52.759 17:07:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:52.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.759 --rc genhtml_branch_coverage=1 00:14:52.759 --rc genhtml_function_coverage=1 00:14:52.759 --rc genhtml_legend=1 00:14:52.759 --rc geninfo_all_blocks=1 00:14:52.759 --rc geninfo_unexecuted_blocks=1 00:14:52.759 00:14:52.759 ' 00:14:52.759 17:07:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:52.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.759 --rc genhtml_branch_coverage=1 00:14:52.759 --rc genhtml_function_coverage=1 00:14:52.759 --rc genhtml_legend=1 00:14:52.759 --rc geninfo_all_blocks=1 00:14:52.759 --rc geninfo_unexecuted_blocks=1 00:14:52.759 00:14:52.759 ' 00:14:52.759 17:07:49 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:52.759 17:07:49 -- nvmf/common.sh@7 -- # uname -s 00:14:52.759 17:07:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:52.759 17:07:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:52.759 17:07:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:52.759 17:07:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:52.759 17:07:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:52.759 17:07:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:52.759 17:07:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:52.759 17:07:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:52.759 17:07:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:52.759 17:07:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:52.759 17:07:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.759 17:07:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.759 17:07:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:52.759 17:07:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:52.759 17:07:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:52.759 17:07:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:52.759 17:07:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:52.759 17:07:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:52.759 17:07:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:52.759 17:07:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.759 17:07:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.759 17:07:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.759 17:07:49 -- paths/export.sh@5 -- # export PATH 00:14:52.759 17:07:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.759 17:07:49 -- nvmf/common.sh@46 -- # : 0 00:14:52.759 17:07:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:52.759 17:07:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:52.759 17:07:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:52.759 17:07:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:52.759 17:07:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:52.759 17:07:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:52.759 17:07:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:52.759 17:07:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:52.759 17:07:49 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:52.759 17:07:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:52.759 17:07:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:52.759 17:07:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:52.759 17:07:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:52.759 17:07:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:52.759 17:07:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.759 17:07:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.759 17:07:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.759 17:07:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:52.759 17:07:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:52.759 17:07:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:52.759 17:07:49 -- common/autotest_common.sh@10 -- # set +x 00:14:54.663 17:07:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:54.663 17:07:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:54.663 17:07:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:54.663 17:07:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:54.663 17:07:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:54.663 17:07:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:54.663 17:07:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:54.663 17:07:51 -- nvmf/common.sh@294 -- # net_devs=() 00:14:54.663 17:07:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:54.663 17:07:51 -- nvmf/common.sh@295 -- # e810=() 00:14:54.663 17:07:51 -- nvmf/common.sh@295 -- # local -ga e810 00:14:54.663 17:07:51 -- nvmf/common.sh@296 -- # x722=() 00:14:54.663 17:07:51 -- nvmf/common.sh@296 -- # local -ga x722 00:14:54.663 17:07:51 -- nvmf/common.sh@297 -- # mlx=() 00:14:54.663 17:07:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:54.663 17:07:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:54.663 17:07:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:54.663 17:07:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:54.663 17:07:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:54.663 17:07:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:54.663 17:07:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:54.663 17:07:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:54.663 17:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.664 17:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:54.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:54.664 17:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.664 17:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:54.664 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:54.664 17:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:54.664 17:07:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.664 17:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.664 17:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.664 17:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.664 17:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:54.664 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:54.664 17:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.664 17:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.664 17:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.664 17:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.664 17:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.664 17:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:54.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:54.664 17:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.664 17:07:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:54.664 17:07:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:54.664 17:07:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:54.664 17:07:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:54.664 17:07:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:54.664 17:07:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:54.664 17:07:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:54.664 17:07:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:54.664 17:07:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:54.664 17:07:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:54.664 17:07:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:54.664 17:07:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:54.664 17:07:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:54.664 17:07:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:54.664 17:07:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:54.664 17:07:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:54.664 17:07:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:54.664 17:07:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:54.664 17:07:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:54.664 17:07:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:54.664 17:07:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:54.664 17:07:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:54.664 17:07:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:54.664 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:54.664 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:14:54.664 00:14:54.664 --- 10.0.0.2 ping statistics --- 00:14:54.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.664 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:14:54.664 17:07:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:54.664 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:54.664 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:14:54.664 00:14:54.664 --- 10.0.0.1 ping statistics --- 00:14:54.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.664 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:14:54.664 17:07:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:54.664 17:07:51 -- nvmf/common.sh@410 -- # return 0 00:14:54.664 17:07:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:54.664 17:07:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:54.664 17:07:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:54.664 17:07:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:54.664 17:07:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:54.664 17:07:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:54.664 17:07:51 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:54.664 17:07:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:54.664 17:07:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:54.664 17:07:51 -- common/autotest_common.sh@10 -- # set +x 00:14:54.664 17:07:51 -- nvmf/common.sh@469 -- # nvmfpid=1705712 00:14:54.664 17:07:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:54.664 17:07:51 -- nvmf/common.sh@470 -- # waitforlisten 1705712 00:14:54.664 17:07:51 -- common/autotest_common.sh@829 -- # '[' -z 1705712 ']' 00:14:54.664 17:07:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.664 17:07:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:54.664 17:07:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.664 17:07:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:54.664 17:07:51 -- common/autotest_common.sh@10 -- # set +x 00:14:54.664 [2024-11-27 17:07:51.555759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:54.664 [2024-11-27 17:07:51.555852] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.664 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.923 [2024-11-27 17:07:51.622150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:54.923 [2024-11-27 17:07:51.710429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:54.923 [2024-11-27 17:07:51.710596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:54.923 [2024-11-27 17:07:51.710615] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:54.923 [2024-11-27 17:07:51.710627] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:54.923 [2024-11-27 17:07:51.710716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:54.923 [2024-11-27 17:07:51.710778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:54.923 [2024-11-27 17:07:51.710781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.856 17:07:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.856 17:07:52 -- common/autotest_common.sh@862 -- # return 0 00:14:55.856 17:07:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:55.856 17:07:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:55.856 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:55.856 17:07:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.856 17:07:52 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:55.856 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.856 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:55.856 [2024-11-27 17:07:52.567232] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:55.856 17:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.856 17:07:52 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:55.856 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.856 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:55.856 17:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.856 17:07:52 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:55.856 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.856 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:55.856 [2024-11-27 17:07:52.599691] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:55.856 17:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.856 17:07:52 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:55.856 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.856 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:55.856 NULL1 00:14:55.856 17:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.856 17:07:52 -- target/connect_stress.sh@21 -- # PERF_PID=1705875 00:14:55.856 17:07:52 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:55.856 17:07:52 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:55.856 17:07:52 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.856 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.856 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:55.857 17:07:52 -- target/connect_stress.sh@28 -- # cat 00:14:55.857 17:07:52 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:55.857 17:07:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.857 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.857 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:56.114 17:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.114 17:07:52 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:56.114 17:07:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.114 17:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.114 17:07:52 -- common/autotest_common.sh@10 -- # set +x 00:14:56.372 17:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.372 17:07:53 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:56.372 17:07:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.372 17:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.372 17:07:53 -- common/autotest_common.sh@10 -- # set +x 00:14:56.938 17:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.938 17:07:53 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:56.938 17:07:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.938 17:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.938 17:07:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.195 17:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.195 17:07:53 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:57.195 17:07:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.195 17:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.195 17:07:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.453 17:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.453 17:07:54 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:57.453 17:07:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.453 17:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.453 17:07:54 -- common/autotest_common.sh@10 -- # set +x 00:14:57.711 17:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.711 17:07:54 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:57.711 17:07:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.711 17:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.711 17:07:54 -- common/autotest_common.sh@10 -- # set +x 00:14:57.969 17:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.969 17:07:54 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:57.969 17:07:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.969 17:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.969 17:07:54 -- common/autotest_common.sh@10 -- # set +x 00:14:58.534 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.534 17:07:55 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:58.534 17:07:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.534 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.534 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:14:58.792 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.793 17:07:55 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:58.793 17:07:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.793 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.793 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:14:59.051 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.051 17:07:55 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:59.051 17:07:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.051 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.051 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:14:59.309 17:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.309 17:07:56 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:59.309 17:07:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.309 17:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.309 17:07:56 -- common/autotest_common.sh@10 -- # set +x 00:14:59.566 17:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.566 17:07:56 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:14:59.566 17:07:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.566 17:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.566 17:07:56 -- common/autotest_common.sh@10 -- # set +x 00:15:00.132 17:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.132 17:07:56 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:00.132 17:07:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.132 17:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.132 17:07:56 -- common/autotest_common.sh@10 -- # set +x 00:15:00.390 17:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.390 17:07:57 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:00.390 17:07:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.390 17:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.390 17:07:57 -- common/autotest_common.sh@10 -- # set +x 00:15:00.648 17:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.648 17:07:57 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:00.648 17:07:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.648 17:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.648 17:07:57 -- common/autotest_common.sh@10 -- # set +x 00:15:00.907 17:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.907 17:07:57 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:00.907 17:07:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.907 17:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.907 17:07:57 -- common/autotest_common.sh@10 -- # set +x 00:15:01.165 17:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.165 17:07:58 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:01.165 17:07:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.165 17:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.455 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:15:01.734 17:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.734 17:07:58 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:01.734 17:07:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.734 17:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.734 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:15:01.992 17:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.992 17:07:58 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:01.992 17:07:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.992 17:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.992 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:15:02.250 17:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.250 17:07:59 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:02.250 17:07:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.251 17:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.251 17:07:59 -- common/autotest_common.sh@10 -- # set +x 00:15:02.508 17:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.508 17:07:59 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:02.508 17:07:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.508 17:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.508 17:07:59 -- common/autotest_common.sh@10 -- # set +x 00:15:03.072 17:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.073 17:07:59 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:03.073 17:07:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.073 17:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.073 17:07:59 -- common/autotest_common.sh@10 -- # set +x 00:15:03.330 17:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.330 17:08:00 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:03.330 17:08:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.330 17:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.330 17:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:03.588 17:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.588 17:08:00 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:03.588 17:08:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.588 17:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.588 17:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:03.846 17:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.846 17:08:00 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:03.846 17:08:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.846 17:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.846 17:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:04.104 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.104 17:08:01 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:04.104 17:08:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.104 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.104 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:15:04.670 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.670 17:08:01 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:04.670 17:08:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.670 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.670 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:15:04.928 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.928 17:08:01 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:04.928 17:08:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.928 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.928 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.186 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.186 17:08:01 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:05.186 17:08:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.186 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.186 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.444 17:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.444 17:08:02 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:05.444 17:08:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.444 17:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.444 17:08:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.701 17:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.701 17:08:02 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:05.701 17:08:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.701 17:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.701 17:08:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.959 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:06.217 17:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.218 17:08:02 -- target/connect_stress.sh@34 -- # kill -0 1705875 00:15:06.218 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1705875) - No such process 00:15:06.218 17:08:02 -- target/connect_stress.sh@38 -- # wait 1705875 00:15:06.218 17:08:02 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:06.218 17:08:02 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:06.218 17:08:02 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:06.218 17:08:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:06.218 17:08:02 -- nvmf/common.sh@116 -- # sync 00:15:06.218 17:08:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:06.218 17:08:02 -- nvmf/common.sh@119 -- # set +e 00:15:06.218 17:08:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:06.218 17:08:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:06.218 rmmod nvme_tcp 00:15:06.218 rmmod nvme_fabrics 00:15:06.218 rmmod nvme_keyring 00:15:06.218 17:08:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:06.218 17:08:02 -- nvmf/common.sh@123 -- # set -e 00:15:06.218 17:08:02 -- nvmf/common.sh@124 -- # return 0 00:15:06.218 17:08:02 -- nvmf/common.sh@477 -- # '[' -n 1705712 ']' 00:15:06.218 17:08:02 -- nvmf/common.sh@478 -- # killprocess 1705712 00:15:06.218 17:08:02 -- common/autotest_common.sh@936 -- # '[' -z 1705712 ']' 00:15:06.218 17:08:02 -- common/autotest_common.sh@940 -- # kill -0 1705712 00:15:06.218 17:08:02 -- common/autotest_common.sh@941 -- # uname 00:15:06.218 17:08:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:06.218 17:08:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1705712 00:15:06.218 17:08:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:06.218 17:08:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:06.218 17:08:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1705712' 00:15:06.218 killing process with pid 1705712 00:15:06.218 17:08:03 -- common/autotest_common.sh@955 -- # kill 1705712 00:15:06.218 17:08:03 -- common/autotest_common.sh@960 -- # wait 1705712 00:15:06.477 17:08:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:06.477 17:08:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:06.477 17:08:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:06.478 17:08:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:06.478 17:08:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:06.478 17:08:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.478 17:08:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.478 17:08:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.382 17:08:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:08.382 00:15:08.382 real 0m16.097s 00:15:08.382 user 0m40.959s 00:15:08.382 sys 0m5.793s 00:15:08.382 17:08:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:08.382 17:08:05 -- common/autotest_common.sh@10 -- # set +x 00:15:08.382 ************************************ 00:15:08.382 END TEST nvmf_connect_stress 00:15:08.382 ************************************ 00:15:08.641 17:08:05 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:08.641 17:08:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:08.641 17:08:05 -- common/autotest_common.sh@10 -- # set +x 00:15:08.641 ************************************ 00:15:08.641 START TEST nvmf_fused_ordering 00:15:08.641 ************************************ 00:15:08.641 17:08:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:08.641 * Looking for test storage... 00:15:08.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:08.641 17:08:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:08.641 17:08:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:08.641 17:08:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:08.641 17:08:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:08.641 17:08:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:08.641 17:08:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:08.641 17:08:05 -- scripts/common.sh@335 -- # IFS=.-: 00:15:08.641 17:08:05 -- scripts/common.sh@335 -- # read -ra ver1 00:15:08.641 17:08:05 -- scripts/common.sh@336 -- # IFS=.-: 00:15:08.641 17:08:05 -- scripts/common.sh@336 -- # read -ra ver2 00:15:08.641 17:08:05 -- scripts/common.sh@337 -- # local 'op=<' 00:15:08.641 17:08:05 -- scripts/common.sh@339 -- # ver1_l=2 00:15:08.641 17:08:05 -- scripts/common.sh@340 -- # ver2_l=1 00:15:08.641 17:08:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:08.641 17:08:05 -- scripts/common.sh@343 -- # case "$op" in 00:15:08.641 17:08:05 -- scripts/common.sh@344 -- # : 1 00:15:08.641 17:08:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:08.641 17:08:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:08.641 17:08:05 -- scripts/common.sh@364 -- # decimal 1 00:15:08.641 17:08:05 -- scripts/common.sh@352 -- # local d=1 00:15:08.641 17:08:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:08.641 17:08:05 -- scripts/common.sh@354 -- # echo 1 00:15:08.641 17:08:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:08.641 17:08:05 -- scripts/common.sh@365 -- # decimal 2 00:15:08.641 17:08:05 -- scripts/common.sh@352 -- # local d=2 00:15:08.641 17:08:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:08.641 17:08:05 -- scripts/common.sh@354 -- # echo 2 00:15:08.641 17:08:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:08.641 17:08:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:08.641 17:08:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:08.641 17:08:05 -- scripts/common.sh@367 -- # return 0 00:15:08.641 17:08:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:08.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.641 --rc genhtml_branch_coverage=1 00:15:08.641 --rc genhtml_function_coverage=1 00:15:08.641 --rc genhtml_legend=1 00:15:08.641 --rc geninfo_all_blocks=1 00:15:08.641 --rc geninfo_unexecuted_blocks=1 00:15:08.641 00:15:08.641 ' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:08.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.641 --rc genhtml_branch_coverage=1 00:15:08.641 --rc genhtml_function_coverage=1 00:15:08.641 --rc genhtml_legend=1 00:15:08.641 --rc geninfo_all_blocks=1 00:15:08.641 --rc geninfo_unexecuted_blocks=1 00:15:08.641 00:15:08.641 ' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:08.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.641 --rc genhtml_branch_coverage=1 00:15:08.641 --rc genhtml_function_coverage=1 00:15:08.641 --rc genhtml_legend=1 00:15:08.641 --rc geninfo_all_blocks=1 00:15:08.641 --rc geninfo_unexecuted_blocks=1 00:15:08.641 00:15:08.641 ' 00:15:08.641 17:08:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:08.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.642 --rc genhtml_branch_coverage=1 00:15:08.642 --rc genhtml_function_coverage=1 00:15:08.642 --rc genhtml_legend=1 00:15:08.642 --rc geninfo_all_blocks=1 00:15:08.642 --rc geninfo_unexecuted_blocks=1 00:15:08.642 00:15:08.642 ' 00:15:08.642 17:08:05 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:08.642 17:08:05 -- nvmf/common.sh@7 -- # uname -s 00:15:08.642 17:08:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:08.642 17:08:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:08.642 17:08:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:08.642 17:08:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:08.642 17:08:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:08.642 17:08:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:08.642 17:08:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:08.642 17:08:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:08.642 17:08:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:08.642 17:08:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:08.642 17:08:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:08.642 17:08:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:08.642 17:08:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:08.642 17:08:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:08.642 17:08:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:08.642 17:08:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:08.642 17:08:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:08.642 17:08:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:08.642 17:08:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:08.642 17:08:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.642 17:08:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.642 17:08:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.642 17:08:05 -- paths/export.sh@5 -- # export PATH 00:15:08.642 17:08:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.642 17:08:05 -- nvmf/common.sh@46 -- # : 0 00:15:08.642 17:08:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:08.642 17:08:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:08.642 17:08:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:08.642 17:08:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:08.642 17:08:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:08.642 17:08:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:08.642 17:08:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:08.642 17:08:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:08.642 17:08:05 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:08.642 17:08:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:08.642 17:08:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:08.642 17:08:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:08.642 17:08:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:08.642 17:08:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:08.642 17:08:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.642 17:08:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.642 17:08:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.642 17:08:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:08.642 17:08:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:08.642 17:08:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:08.642 17:08:05 -- common/autotest_common.sh@10 -- # set +x 00:15:10.543 17:08:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:10.543 17:08:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:10.543 17:08:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:10.543 17:08:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:10.543 17:08:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:10.543 17:08:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:10.543 17:08:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:10.543 17:08:07 -- nvmf/common.sh@294 -- # net_devs=() 00:15:10.543 17:08:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:10.543 17:08:07 -- nvmf/common.sh@295 -- # e810=() 00:15:10.543 17:08:07 -- nvmf/common.sh@295 -- # local -ga e810 00:15:10.543 17:08:07 -- nvmf/common.sh@296 -- # x722=() 00:15:10.543 17:08:07 -- nvmf/common.sh@296 -- # local -ga x722 00:15:10.543 17:08:07 -- nvmf/common.sh@297 -- # mlx=() 00:15:10.543 17:08:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:10.543 17:08:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:10.543 17:08:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:10.543 17:08:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:10.543 17:08:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:10.543 17:08:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:10.543 17:08:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:10.543 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:10.543 17:08:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:10.543 17:08:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:10.544 17:08:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:10.544 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:10.544 17:08:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:10.544 17:08:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:10.544 17:08:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:10.544 17:08:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:10.544 17:08:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:10.544 17:08:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:10.544 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:10.544 17:08:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:10.544 17:08:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:10.544 17:08:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:10.544 17:08:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:10.544 17:08:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:10.544 17:08:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:10.544 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:10.544 17:08:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:10.544 17:08:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:10.544 17:08:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:10.544 17:08:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:10.544 17:08:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:10.544 17:08:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:10.544 17:08:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:10.544 17:08:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:10.544 17:08:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:10.544 17:08:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:10.544 17:08:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:10.544 17:08:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:10.544 17:08:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:10.544 17:08:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:10.544 17:08:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:10.544 17:08:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:10.544 17:08:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:10.544 17:08:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:10.800 17:08:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:10.800 17:08:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:10.800 17:08:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:10.800 17:08:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:10.800 17:08:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:10.800 17:08:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:10.800 17:08:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:10.800 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:10.800 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:15:10.800 00:15:10.800 --- 10.0.0.2 ping statistics --- 00:15:10.800 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:10.800 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:15:10.800 17:08:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:10.800 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:10.800 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:15:10.800 00:15:10.800 --- 10.0.0.1 ping statistics --- 00:15:10.800 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:10.800 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:15:10.800 17:08:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:10.800 17:08:07 -- nvmf/common.sh@410 -- # return 0 00:15:10.800 17:08:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:10.800 17:08:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:10.800 17:08:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:10.800 17:08:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:10.800 17:08:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:10.800 17:08:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:10.800 17:08:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:10.800 17:08:07 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:10.800 17:08:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:10.800 17:08:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:10.800 17:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:10.800 17:08:07 -- nvmf/common.sh@469 -- # nvmfpid=1709077 00:15:10.800 17:08:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:10.800 17:08:07 -- nvmf/common.sh@470 -- # waitforlisten 1709077 00:15:10.800 17:08:07 -- common/autotest_common.sh@829 -- # '[' -z 1709077 ']' 00:15:10.800 17:08:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:10.800 17:08:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:10.800 17:08:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:10.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:10.800 17:08:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:10.800 17:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:10.800 [2024-11-27 17:08:07.639034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:10.800 [2024-11-27 17:08:07.639122] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:10.800 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.801 [2024-11-27 17:08:07.699554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:11.058 [2024-11-27 17:08:07.780328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:11.058 [2024-11-27 17:08:07.780473] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:11.058 [2024-11-27 17:08:07.780489] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:11.058 [2024-11-27 17:08:07.780501] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:11.058 [2024-11-27 17:08:07.780550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:11.991 17:08:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:11.991 17:08:08 -- common/autotest_common.sh@862 -- # return 0 00:15:11.991 17:08:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:11.991 17:08:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 17:08:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:11.991 17:08:08 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 [2024-11-27 17:08:08.621044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 [2024-11-27 17:08:08.637230] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 NULL1 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:11.991 17:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.991 17:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:11.991 17:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.991 17:08:08 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:11.991 [2024-11-27 17:08:08.681457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:11.991 [2024-11-27 17:08:08.681499] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1709231 ] 00:15:11.991 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.249 Attached to nqn.2016-06.io.spdk:cnode1 00:15:12.249 Namespace ID: 1 size: 1GB 00:15:12.249 fused_ordering(0) 00:15:12.249 fused_ordering(1) 00:15:12.249 fused_ordering(2) 00:15:12.249 fused_ordering(3) 00:15:12.249 fused_ordering(4) 00:15:12.249 fused_ordering(5) 00:15:12.249 fused_ordering(6) 00:15:12.249 fused_ordering(7) 00:15:12.249 fused_ordering(8) 00:15:12.249 fused_ordering(9) 00:15:12.249 fused_ordering(10) 00:15:12.249 fused_ordering(11) 00:15:12.249 fused_ordering(12) 00:15:12.249 fused_ordering(13) 00:15:12.249 fused_ordering(14) 00:15:12.249 fused_ordering(15) 00:15:12.249 fused_ordering(16) 00:15:12.249 fused_ordering(17) 00:15:12.249 fused_ordering(18) 00:15:12.249 fused_ordering(19) 00:15:12.249 fused_ordering(20) 00:15:12.249 fused_ordering(21) 00:15:12.249 fused_ordering(22) 00:15:12.249 fused_ordering(23) 00:15:12.249 fused_ordering(24) 00:15:12.249 fused_ordering(25) 00:15:12.249 fused_ordering(26) 00:15:12.249 fused_ordering(27) 00:15:12.249 fused_ordering(28) 00:15:12.249 fused_ordering(29) 00:15:12.249 fused_ordering(30) 00:15:12.249 fused_ordering(31) 00:15:12.249 fused_ordering(32) 00:15:12.249 fused_ordering(33) 00:15:12.249 fused_ordering(34) 00:15:12.249 fused_ordering(35) 00:15:12.249 fused_ordering(36) 00:15:12.249 fused_ordering(37) 00:15:12.249 fused_ordering(38) 00:15:12.249 fused_ordering(39) 00:15:12.249 fused_ordering(40) 00:15:12.249 fused_ordering(41) 00:15:12.249 fused_ordering(42) 00:15:12.249 fused_ordering(43) 00:15:12.249 fused_ordering(44) 00:15:12.249 fused_ordering(45) 00:15:12.249 fused_ordering(46) 00:15:12.249 fused_ordering(47) 00:15:12.249 fused_ordering(48) 00:15:12.249 fused_ordering(49) 00:15:12.249 fused_ordering(50) 00:15:12.249 fused_ordering(51) 00:15:12.249 fused_ordering(52) 00:15:12.249 fused_ordering(53) 00:15:12.249 fused_ordering(54) 00:15:12.249 fused_ordering(55) 00:15:12.249 fused_ordering(56) 00:15:12.249 fused_ordering(57) 00:15:12.249 fused_ordering(58) 00:15:12.249 fused_ordering(59) 00:15:12.249 fused_ordering(60) 00:15:12.249 fused_ordering(61) 00:15:12.249 fused_ordering(62) 00:15:12.249 fused_ordering(63) 00:15:12.249 fused_ordering(64) 00:15:12.249 fused_ordering(65) 00:15:12.249 fused_ordering(66) 00:15:12.249 fused_ordering(67) 00:15:12.249 fused_ordering(68) 00:15:12.249 fused_ordering(69) 00:15:12.249 fused_ordering(70) 00:15:12.249 fused_ordering(71) 00:15:12.249 fused_ordering(72) 00:15:12.249 fused_ordering(73) 00:15:12.249 fused_ordering(74) 00:15:12.249 fused_ordering(75) 00:15:12.249 fused_ordering(76) 00:15:12.249 fused_ordering(77) 00:15:12.249 fused_ordering(78) 00:15:12.249 fused_ordering(79) 00:15:12.249 fused_ordering(80) 00:15:12.249 fused_ordering(81) 00:15:12.249 fused_ordering(82) 00:15:12.249 fused_ordering(83) 00:15:12.249 fused_ordering(84) 00:15:12.249 fused_ordering(85) 00:15:12.249 fused_ordering(86) 00:15:12.249 fused_ordering(87) 00:15:12.249 fused_ordering(88) 00:15:12.249 fused_ordering(89) 00:15:12.249 fused_ordering(90) 00:15:12.249 fused_ordering(91) 00:15:12.249 fused_ordering(92) 00:15:12.249 fused_ordering(93) 00:15:12.249 fused_ordering(94) 00:15:12.249 fused_ordering(95) 00:15:12.249 fused_ordering(96) 00:15:12.249 fused_ordering(97) 00:15:12.249 fused_ordering(98) 00:15:12.249 fused_ordering(99) 00:15:12.249 fused_ordering(100) 00:15:12.249 fused_ordering(101) 00:15:12.249 fused_ordering(102) 00:15:12.250 fused_ordering(103) 00:15:12.250 fused_ordering(104) 00:15:12.250 fused_ordering(105) 00:15:12.250 fused_ordering(106) 00:15:12.250 fused_ordering(107) 00:15:12.250 fused_ordering(108) 00:15:12.250 fused_ordering(109) 00:15:12.250 fused_ordering(110) 00:15:12.250 fused_ordering(111) 00:15:12.250 fused_ordering(112) 00:15:12.250 fused_ordering(113) 00:15:12.250 fused_ordering(114) 00:15:12.250 fused_ordering(115) 00:15:12.250 fused_ordering(116) 00:15:12.250 fused_ordering(117) 00:15:12.250 fused_ordering(118) 00:15:12.250 fused_ordering(119) 00:15:12.250 fused_ordering(120) 00:15:12.250 fused_ordering(121) 00:15:12.250 fused_ordering(122) 00:15:12.250 fused_ordering(123) 00:15:12.250 fused_ordering(124) 00:15:12.250 fused_ordering(125) 00:15:12.250 fused_ordering(126) 00:15:12.250 fused_ordering(127) 00:15:12.250 fused_ordering(128) 00:15:12.250 fused_ordering(129) 00:15:12.250 fused_ordering(130) 00:15:12.250 fused_ordering(131) 00:15:12.250 fused_ordering(132) 00:15:12.250 fused_ordering(133) 00:15:12.250 fused_ordering(134) 00:15:12.250 fused_ordering(135) 00:15:12.250 fused_ordering(136) 00:15:12.250 fused_ordering(137) 00:15:12.250 fused_ordering(138) 00:15:12.250 fused_ordering(139) 00:15:12.250 fused_ordering(140) 00:15:12.250 fused_ordering(141) 00:15:12.250 fused_ordering(142) 00:15:12.250 fused_ordering(143) 00:15:12.250 fused_ordering(144) 00:15:12.250 fused_ordering(145) 00:15:12.250 fused_ordering(146) 00:15:12.250 fused_ordering(147) 00:15:12.250 fused_ordering(148) 00:15:12.250 fused_ordering(149) 00:15:12.250 fused_ordering(150) 00:15:12.250 fused_ordering(151) 00:15:12.250 fused_ordering(152) 00:15:12.250 fused_ordering(153) 00:15:12.250 fused_ordering(154) 00:15:12.250 fused_ordering(155) 00:15:12.250 fused_ordering(156) 00:15:12.250 fused_ordering(157) 00:15:12.250 fused_ordering(158) 00:15:12.250 fused_ordering(159) 00:15:12.250 fused_ordering(160) 00:15:12.250 fused_ordering(161) 00:15:12.250 fused_ordering(162) 00:15:12.250 fused_ordering(163) 00:15:12.250 fused_ordering(164) 00:15:12.250 fused_ordering(165) 00:15:12.250 fused_ordering(166) 00:15:12.250 fused_ordering(167) 00:15:12.250 fused_ordering(168) 00:15:12.250 fused_ordering(169) 00:15:12.250 fused_ordering(170) 00:15:12.250 fused_ordering(171) 00:15:12.250 fused_ordering(172) 00:15:12.250 fused_ordering(173) 00:15:12.250 fused_ordering(174) 00:15:12.250 fused_ordering(175) 00:15:12.250 fused_ordering(176) 00:15:12.250 fused_ordering(177) 00:15:12.250 fused_ordering(178) 00:15:12.250 fused_ordering(179) 00:15:12.250 fused_ordering(180) 00:15:12.250 fused_ordering(181) 00:15:12.250 fused_ordering(182) 00:15:12.250 fused_ordering(183) 00:15:12.250 fused_ordering(184) 00:15:12.250 fused_ordering(185) 00:15:12.250 fused_ordering(186) 00:15:12.250 fused_ordering(187) 00:15:12.250 fused_ordering(188) 00:15:12.250 fused_ordering(189) 00:15:12.250 fused_ordering(190) 00:15:12.250 fused_ordering(191) 00:15:12.250 fused_ordering(192) 00:15:12.250 fused_ordering(193) 00:15:12.250 fused_ordering(194) 00:15:12.250 fused_ordering(195) 00:15:12.250 fused_ordering(196) 00:15:12.250 fused_ordering(197) 00:15:12.250 fused_ordering(198) 00:15:12.250 fused_ordering(199) 00:15:12.250 fused_ordering(200) 00:15:12.250 fused_ordering(201) 00:15:12.250 fused_ordering(202) 00:15:12.250 fused_ordering(203) 00:15:12.250 fused_ordering(204) 00:15:12.250 fused_ordering(205) 00:15:12.815 fused_ordering(206) 00:15:12.815 fused_ordering(207) 00:15:12.815 fused_ordering(208) 00:15:12.815 fused_ordering(209) 00:15:12.815 fused_ordering(210) 00:15:12.815 fused_ordering(211) 00:15:12.815 fused_ordering(212) 00:15:12.815 fused_ordering(213) 00:15:12.815 fused_ordering(214) 00:15:12.815 fused_ordering(215) 00:15:12.815 fused_ordering(216) 00:15:12.815 fused_ordering(217) 00:15:12.815 fused_ordering(218) 00:15:12.815 fused_ordering(219) 00:15:12.815 fused_ordering(220) 00:15:12.815 fused_ordering(221) 00:15:12.815 fused_ordering(222) 00:15:12.815 fused_ordering(223) 00:15:12.815 fused_ordering(224) 00:15:12.815 fused_ordering(225) 00:15:12.815 fused_ordering(226) 00:15:12.815 fused_ordering(227) 00:15:12.815 fused_ordering(228) 00:15:12.815 fused_ordering(229) 00:15:12.815 fused_ordering(230) 00:15:12.815 fused_ordering(231) 00:15:12.815 fused_ordering(232) 00:15:12.815 fused_ordering(233) 00:15:12.815 fused_ordering(234) 00:15:12.815 fused_ordering(235) 00:15:12.815 fused_ordering(236) 00:15:12.815 fused_ordering(237) 00:15:12.815 fused_ordering(238) 00:15:12.815 fused_ordering(239) 00:15:12.815 fused_ordering(240) 00:15:12.815 fused_ordering(241) 00:15:12.815 fused_ordering(242) 00:15:12.815 fused_ordering(243) 00:15:12.815 fused_ordering(244) 00:15:12.815 fused_ordering(245) 00:15:12.815 fused_ordering(246) 00:15:12.815 fused_ordering(247) 00:15:12.815 fused_ordering(248) 00:15:12.815 fused_ordering(249) 00:15:12.815 fused_ordering(250) 00:15:12.815 fused_ordering(251) 00:15:12.815 fused_ordering(252) 00:15:12.815 fused_ordering(253) 00:15:12.815 fused_ordering(254) 00:15:12.815 fused_ordering(255) 00:15:12.815 fused_ordering(256) 00:15:12.815 fused_ordering(257) 00:15:12.815 fused_ordering(258) 00:15:12.815 fused_ordering(259) 00:15:12.815 fused_ordering(260) 00:15:12.815 fused_ordering(261) 00:15:12.815 fused_ordering(262) 00:15:12.815 fused_ordering(263) 00:15:12.815 fused_ordering(264) 00:15:12.815 fused_ordering(265) 00:15:12.815 fused_ordering(266) 00:15:12.815 fused_ordering(267) 00:15:12.815 fused_ordering(268) 00:15:12.815 fused_ordering(269) 00:15:12.815 fused_ordering(270) 00:15:12.815 fused_ordering(271) 00:15:12.815 fused_ordering(272) 00:15:12.815 fused_ordering(273) 00:15:12.815 fused_ordering(274) 00:15:12.815 fused_ordering(275) 00:15:12.815 fused_ordering(276) 00:15:12.815 fused_ordering(277) 00:15:12.815 fused_ordering(278) 00:15:12.815 fused_ordering(279) 00:15:12.815 fused_ordering(280) 00:15:12.815 fused_ordering(281) 00:15:12.815 fused_ordering(282) 00:15:12.815 fused_ordering(283) 00:15:12.815 fused_ordering(284) 00:15:12.815 fused_ordering(285) 00:15:12.815 fused_ordering(286) 00:15:12.815 fused_ordering(287) 00:15:12.815 fused_ordering(288) 00:15:12.815 fused_ordering(289) 00:15:12.815 fused_ordering(290) 00:15:12.815 fused_ordering(291) 00:15:12.815 fused_ordering(292) 00:15:12.815 fused_ordering(293) 00:15:12.815 fused_ordering(294) 00:15:12.815 fused_ordering(295) 00:15:12.815 fused_ordering(296) 00:15:12.815 fused_ordering(297) 00:15:12.815 fused_ordering(298) 00:15:12.815 fused_ordering(299) 00:15:12.815 fused_ordering(300) 00:15:12.815 fused_ordering(301) 00:15:12.815 fused_ordering(302) 00:15:12.815 fused_ordering(303) 00:15:12.815 fused_ordering(304) 00:15:12.815 fused_ordering(305) 00:15:12.815 fused_ordering(306) 00:15:12.815 fused_ordering(307) 00:15:12.815 fused_ordering(308) 00:15:12.815 fused_ordering(309) 00:15:12.815 fused_ordering(310) 00:15:12.815 fused_ordering(311) 00:15:12.815 fused_ordering(312) 00:15:12.815 fused_ordering(313) 00:15:12.815 fused_ordering(314) 00:15:12.815 fused_ordering(315) 00:15:12.815 fused_ordering(316) 00:15:12.815 fused_ordering(317) 00:15:12.815 fused_ordering(318) 00:15:12.815 fused_ordering(319) 00:15:12.815 fused_ordering(320) 00:15:12.815 fused_ordering(321) 00:15:12.815 fused_ordering(322) 00:15:12.815 fused_ordering(323) 00:15:12.815 fused_ordering(324) 00:15:12.815 fused_ordering(325) 00:15:12.815 fused_ordering(326) 00:15:12.815 fused_ordering(327) 00:15:12.815 fused_ordering(328) 00:15:12.815 fused_ordering(329) 00:15:12.815 fused_ordering(330) 00:15:12.815 fused_ordering(331) 00:15:12.815 fused_ordering(332) 00:15:12.815 fused_ordering(333) 00:15:12.815 fused_ordering(334) 00:15:12.815 fused_ordering(335) 00:15:12.815 fused_ordering(336) 00:15:12.815 fused_ordering(337) 00:15:12.815 fused_ordering(338) 00:15:12.815 fused_ordering(339) 00:15:12.815 fused_ordering(340) 00:15:12.815 fused_ordering(341) 00:15:12.815 fused_ordering(342) 00:15:12.815 fused_ordering(343) 00:15:12.815 fused_ordering(344) 00:15:12.815 fused_ordering(345) 00:15:12.815 fused_ordering(346) 00:15:12.815 fused_ordering(347) 00:15:12.815 fused_ordering(348) 00:15:12.815 fused_ordering(349) 00:15:12.815 fused_ordering(350) 00:15:12.815 fused_ordering(351) 00:15:12.815 fused_ordering(352) 00:15:12.815 fused_ordering(353) 00:15:12.815 fused_ordering(354) 00:15:12.815 fused_ordering(355) 00:15:12.815 fused_ordering(356) 00:15:12.815 fused_ordering(357) 00:15:12.815 fused_ordering(358) 00:15:12.815 fused_ordering(359) 00:15:12.815 fused_ordering(360) 00:15:12.815 fused_ordering(361) 00:15:12.815 fused_ordering(362) 00:15:12.815 fused_ordering(363) 00:15:12.816 fused_ordering(364) 00:15:12.816 fused_ordering(365) 00:15:12.816 fused_ordering(366) 00:15:12.816 fused_ordering(367) 00:15:12.816 fused_ordering(368) 00:15:12.816 fused_ordering(369) 00:15:12.816 fused_ordering(370) 00:15:12.816 fused_ordering(371) 00:15:12.816 fused_ordering(372) 00:15:12.816 fused_ordering(373) 00:15:12.816 fused_ordering(374) 00:15:12.816 fused_ordering(375) 00:15:12.816 fused_ordering(376) 00:15:12.816 fused_ordering(377) 00:15:12.816 fused_ordering(378) 00:15:12.816 fused_ordering(379) 00:15:12.816 fused_ordering(380) 00:15:12.816 fused_ordering(381) 00:15:12.816 fused_ordering(382) 00:15:12.816 fused_ordering(383) 00:15:12.816 fused_ordering(384) 00:15:12.816 fused_ordering(385) 00:15:12.816 fused_ordering(386) 00:15:12.816 fused_ordering(387) 00:15:12.816 fused_ordering(388) 00:15:12.816 fused_ordering(389) 00:15:12.816 fused_ordering(390) 00:15:12.816 fused_ordering(391) 00:15:12.816 fused_ordering(392) 00:15:12.816 fused_ordering(393) 00:15:12.816 fused_ordering(394) 00:15:12.816 fused_ordering(395) 00:15:12.816 fused_ordering(396) 00:15:12.816 fused_ordering(397) 00:15:12.816 fused_ordering(398) 00:15:12.816 fused_ordering(399) 00:15:12.816 fused_ordering(400) 00:15:12.816 fused_ordering(401) 00:15:12.816 fused_ordering(402) 00:15:12.816 fused_ordering(403) 00:15:12.816 fused_ordering(404) 00:15:12.816 fused_ordering(405) 00:15:12.816 fused_ordering(406) 00:15:12.816 fused_ordering(407) 00:15:12.816 fused_ordering(408) 00:15:12.816 fused_ordering(409) 00:15:12.816 fused_ordering(410) 00:15:13.074 fused_ordering(411) 00:15:13.074 fused_ordering(412) 00:15:13.074 fused_ordering(413) 00:15:13.074 fused_ordering(414) 00:15:13.074 fused_ordering(415) 00:15:13.074 fused_ordering(416) 00:15:13.074 fused_ordering(417) 00:15:13.074 fused_ordering(418) 00:15:13.074 fused_ordering(419) 00:15:13.074 fused_ordering(420) 00:15:13.074 fused_ordering(421) 00:15:13.074 fused_ordering(422) 00:15:13.074 fused_ordering(423) 00:15:13.074 fused_ordering(424) 00:15:13.074 fused_ordering(425) 00:15:13.074 fused_ordering(426) 00:15:13.074 fused_ordering(427) 00:15:13.074 fused_ordering(428) 00:15:13.074 fused_ordering(429) 00:15:13.074 fused_ordering(430) 00:15:13.074 fused_ordering(431) 00:15:13.074 fused_ordering(432) 00:15:13.074 fused_ordering(433) 00:15:13.074 fused_ordering(434) 00:15:13.074 fused_ordering(435) 00:15:13.074 fused_ordering(436) 00:15:13.074 fused_ordering(437) 00:15:13.074 fused_ordering(438) 00:15:13.074 fused_ordering(439) 00:15:13.074 fused_ordering(440) 00:15:13.074 fused_ordering(441) 00:15:13.074 fused_ordering(442) 00:15:13.074 fused_ordering(443) 00:15:13.074 fused_ordering(444) 00:15:13.074 fused_ordering(445) 00:15:13.074 fused_ordering(446) 00:15:13.074 fused_ordering(447) 00:15:13.074 fused_ordering(448) 00:15:13.074 fused_ordering(449) 00:15:13.074 fused_ordering(450) 00:15:13.074 fused_ordering(451) 00:15:13.074 fused_ordering(452) 00:15:13.074 fused_ordering(453) 00:15:13.074 fused_ordering(454) 00:15:13.074 fused_ordering(455) 00:15:13.074 fused_ordering(456) 00:15:13.074 fused_ordering(457) 00:15:13.074 fused_ordering(458) 00:15:13.074 fused_ordering(459) 00:15:13.074 fused_ordering(460) 00:15:13.074 fused_ordering(461) 00:15:13.074 fused_ordering(462) 00:15:13.074 fused_ordering(463) 00:15:13.074 fused_ordering(464) 00:15:13.074 fused_ordering(465) 00:15:13.074 fused_ordering(466) 00:15:13.074 fused_ordering(467) 00:15:13.074 fused_ordering(468) 00:15:13.074 fused_ordering(469) 00:15:13.074 fused_ordering(470) 00:15:13.074 fused_ordering(471) 00:15:13.074 fused_ordering(472) 00:15:13.074 fused_ordering(473) 00:15:13.074 fused_ordering(474) 00:15:13.074 fused_ordering(475) 00:15:13.074 fused_ordering(476) 00:15:13.074 fused_ordering(477) 00:15:13.074 fused_ordering(478) 00:15:13.074 fused_ordering(479) 00:15:13.074 fused_ordering(480) 00:15:13.074 fused_ordering(481) 00:15:13.074 fused_ordering(482) 00:15:13.074 fused_ordering(483) 00:15:13.074 fused_ordering(484) 00:15:13.074 fused_ordering(485) 00:15:13.074 fused_ordering(486) 00:15:13.074 fused_ordering(487) 00:15:13.074 fused_ordering(488) 00:15:13.074 fused_ordering(489) 00:15:13.074 fused_ordering(490) 00:15:13.074 fused_ordering(491) 00:15:13.074 fused_ordering(492) 00:15:13.074 fused_ordering(493) 00:15:13.074 fused_ordering(494) 00:15:13.074 fused_ordering(495) 00:15:13.074 fused_ordering(496) 00:15:13.074 fused_ordering(497) 00:15:13.074 fused_ordering(498) 00:15:13.074 fused_ordering(499) 00:15:13.075 fused_ordering(500) 00:15:13.075 fused_ordering(501) 00:15:13.075 fused_ordering(502) 00:15:13.075 fused_ordering(503) 00:15:13.075 fused_ordering(504) 00:15:13.075 fused_ordering(505) 00:15:13.075 fused_ordering(506) 00:15:13.075 fused_ordering(507) 00:15:13.075 fused_ordering(508) 00:15:13.075 fused_ordering(509) 00:15:13.075 fused_ordering(510) 00:15:13.075 fused_ordering(511) 00:15:13.075 fused_ordering(512) 00:15:13.075 fused_ordering(513) 00:15:13.075 fused_ordering(514) 00:15:13.075 fused_ordering(515) 00:15:13.075 fused_ordering(516) 00:15:13.075 fused_ordering(517) 00:15:13.075 fused_ordering(518) 00:15:13.075 fused_ordering(519) 00:15:13.075 fused_ordering(520) 00:15:13.075 fused_ordering(521) 00:15:13.075 fused_ordering(522) 00:15:13.075 fused_ordering(523) 00:15:13.075 fused_ordering(524) 00:15:13.075 fused_ordering(525) 00:15:13.075 fused_ordering(526) 00:15:13.075 fused_ordering(527) 00:15:13.075 fused_ordering(528) 00:15:13.075 fused_ordering(529) 00:15:13.075 fused_ordering(530) 00:15:13.075 fused_ordering(531) 00:15:13.075 fused_ordering(532) 00:15:13.075 fused_ordering(533) 00:15:13.075 fused_ordering(534) 00:15:13.075 fused_ordering(535) 00:15:13.075 fused_ordering(536) 00:15:13.075 fused_ordering(537) 00:15:13.075 fused_ordering(538) 00:15:13.075 fused_ordering(539) 00:15:13.075 fused_ordering(540) 00:15:13.075 fused_ordering(541) 00:15:13.075 fused_ordering(542) 00:15:13.075 fused_ordering(543) 00:15:13.075 fused_ordering(544) 00:15:13.075 fused_ordering(545) 00:15:13.075 fused_ordering(546) 00:15:13.075 fused_ordering(547) 00:15:13.075 fused_ordering(548) 00:15:13.075 fused_ordering(549) 00:15:13.075 fused_ordering(550) 00:15:13.075 fused_ordering(551) 00:15:13.075 fused_ordering(552) 00:15:13.075 fused_ordering(553) 00:15:13.075 fused_ordering(554) 00:15:13.075 fused_ordering(555) 00:15:13.075 fused_ordering(556) 00:15:13.075 fused_ordering(557) 00:15:13.075 fused_ordering(558) 00:15:13.075 fused_ordering(559) 00:15:13.075 fused_ordering(560) 00:15:13.075 fused_ordering(561) 00:15:13.075 fused_ordering(562) 00:15:13.075 fused_ordering(563) 00:15:13.075 fused_ordering(564) 00:15:13.075 fused_ordering(565) 00:15:13.075 fused_ordering(566) 00:15:13.075 fused_ordering(567) 00:15:13.075 fused_ordering(568) 00:15:13.075 fused_ordering(569) 00:15:13.075 fused_ordering(570) 00:15:13.075 fused_ordering(571) 00:15:13.075 fused_ordering(572) 00:15:13.075 fused_ordering(573) 00:15:13.075 fused_ordering(574) 00:15:13.075 fused_ordering(575) 00:15:13.075 fused_ordering(576) 00:15:13.075 fused_ordering(577) 00:15:13.075 fused_ordering(578) 00:15:13.075 fused_ordering(579) 00:15:13.075 fused_ordering(580) 00:15:13.075 fused_ordering(581) 00:15:13.075 fused_ordering(582) 00:15:13.075 fused_ordering(583) 00:15:13.075 fused_ordering(584) 00:15:13.075 fused_ordering(585) 00:15:13.075 fused_ordering(586) 00:15:13.075 fused_ordering(587) 00:15:13.075 fused_ordering(588) 00:15:13.075 fused_ordering(589) 00:15:13.075 fused_ordering(590) 00:15:13.075 fused_ordering(591) 00:15:13.075 fused_ordering(592) 00:15:13.075 fused_ordering(593) 00:15:13.075 fused_ordering(594) 00:15:13.075 fused_ordering(595) 00:15:13.075 fused_ordering(596) 00:15:13.075 fused_ordering(597) 00:15:13.075 fused_ordering(598) 00:15:13.075 fused_ordering(599) 00:15:13.075 fused_ordering(600) 00:15:13.075 fused_ordering(601) 00:15:13.075 fused_ordering(602) 00:15:13.075 fused_ordering(603) 00:15:13.075 fused_ordering(604) 00:15:13.075 fused_ordering(605) 00:15:13.075 fused_ordering(606) 00:15:13.075 fused_ordering(607) 00:15:13.075 fused_ordering(608) 00:15:13.075 fused_ordering(609) 00:15:13.075 fused_ordering(610) 00:15:13.075 fused_ordering(611) 00:15:13.075 fused_ordering(612) 00:15:13.075 fused_ordering(613) 00:15:13.075 fused_ordering(614) 00:15:13.075 fused_ordering(615) 00:15:13.640 fused_ordering(616) 00:15:13.640 fused_ordering(617) 00:15:13.640 fused_ordering(618) 00:15:13.640 fused_ordering(619) 00:15:13.640 fused_ordering(620) 00:15:13.640 fused_ordering(621) 00:15:13.640 fused_ordering(622) 00:15:13.640 fused_ordering(623) 00:15:13.640 fused_ordering(624) 00:15:13.640 fused_ordering(625) 00:15:13.640 fused_ordering(626) 00:15:13.640 fused_ordering(627) 00:15:13.640 fused_ordering(628) 00:15:13.640 fused_ordering(629) 00:15:13.640 fused_ordering(630) 00:15:13.640 fused_ordering(631) 00:15:13.640 fused_ordering(632) 00:15:13.640 fused_ordering(633) 00:15:13.640 fused_ordering(634) 00:15:13.640 fused_ordering(635) 00:15:13.640 fused_ordering(636) 00:15:13.640 fused_ordering(637) 00:15:13.640 fused_ordering(638) 00:15:13.640 fused_ordering(639) 00:15:13.640 fused_ordering(640) 00:15:13.640 fused_ordering(641) 00:15:13.640 fused_ordering(642) 00:15:13.640 fused_ordering(643) 00:15:13.640 fused_ordering(644) 00:15:13.640 fused_ordering(645) 00:15:13.640 fused_ordering(646) 00:15:13.640 fused_ordering(647) 00:15:13.640 fused_ordering(648) 00:15:13.640 fused_ordering(649) 00:15:13.640 fused_ordering(650) 00:15:13.640 fused_ordering(651) 00:15:13.640 fused_ordering(652) 00:15:13.640 fused_ordering(653) 00:15:13.640 fused_ordering(654) 00:15:13.640 fused_ordering(655) 00:15:13.640 fused_ordering(656) 00:15:13.640 fused_ordering(657) 00:15:13.640 fused_ordering(658) 00:15:13.640 fused_ordering(659) 00:15:13.640 fused_ordering(660) 00:15:13.640 fused_ordering(661) 00:15:13.640 fused_ordering(662) 00:15:13.640 fused_ordering(663) 00:15:13.640 fused_ordering(664) 00:15:13.640 fused_ordering(665) 00:15:13.640 fused_ordering(666) 00:15:13.640 fused_ordering(667) 00:15:13.640 fused_ordering(668) 00:15:13.640 fused_ordering(669) 00:15:13.640 fused_ordering(670) 00:15:13.640 fused_ordering(671) 00:15:13.640 fused_ordering(672) 00:15:13.640 fused_ordering(673) 00:15:13.640 fused_ordering(674) 00:15:13.640 fused_ordering(675) 00:15:13.640 fused_ordering(676) 00:15:13.640 fused_ordering(677) 00:15:13.640 fused_ordering(678) 00:15:13.640 fused_ordering(679) 00:15:13.640 fused_ordering(680) 00:15:13.640 fused_ordering(681) 00:15:13.640 fused_ordering(682) 00:15:13.640 fused_ordering(683) 00:15:13.640 fused_ordering(684) 00:15:13.640 fused_ordering(685) 00:15:13.640 fused_ordering(686) 00:15:13.640 fused_ordering(687) 00:15:13.640 fused_ordering(688) 00:15:13.640 fused_ordering(689) 00:15:13.640 fused_ordering(690) 00:15:13.640 fused_ordering(691) 00:15:13.640 fused_ordering(692) 00:15:13.640 fused_ordering(693) 00:15:13.640 fused_ordering(694) 00:15:13.640 fused_ordering(695) 00:15:13.640 fused_ordering(696) 00:15:13.640 fused_ordering(697) 00:15:13.640 fused_ordering(698) 00:15:13.640 fused_ordering(699) 00:15:13.640 fused_ordering(700) 00:15:13.640 fused_ordering(701) 00:15:13.640 fused_ordering(702) 00:15:13.640 fused_ordering(703) 00:15:13.640 fused_ordering(704) 00:15:13.640 fused_ordering(705) 00:15:13.640 fused_ordering(706) 00:15:13.640 fused_ordering(707) 00:15:13.640 fused_ordering(708) 00:15:13.640 fused_ordering(709) 00:15:13.640 fused_ordering(710) 00:15:13.640 fused_ordering(711) 00:15:13.640 fused_ordering(712) 00:15:13.640 fused_ordering(713) 00:15:13.640 fused_ordering(714) 00:15:13.640 fused_ordering(715) 00:15:13.640 fused_ordering(716) 00:15:13.640 fused_ordering(717) 00:15:13.640 fused_ordering(718) 00:15:13.640 fused_ordering(719) 00:15:13.640 fused_ordering(720) 00:15:13.640 fused_ordering(721) 00:15:13.640 fused_ordering(722) 00:15:13.640 fused_ordering(723) 00:15:13.640 fused_ordering(724) 00:15:13.640 fused_ordering(725) 00:15:13.640 fused_ordering(726) 00:15:13.640 fused_ordering(727) 00:15:13.640 fused_ordering(728) 00:15:13.640 fused_ordering(729) 00:15:13.640 fused_ordering(730) 00:15:13.640 fused_ordering(731) 00:15:13.640 fused_ordering(732) 00:15:13.640 fused_ordering(733) 00:15:13.640 fused_ordering(734) 00:15:13.640 fused_ordering(735) 00:15:13.640 fused_ordering(736) 00:15:13.640 fused_ordering(737) 00:15:13.640 fused_ordering(738) 00:15:13.640 fused_ordering(739) 00:15:13.640 fused_ordering(740) 00:15:13.640 fused_ordering(741) 00:15:13.640 fused_ordering(742) 00:15:13.640 fused_ordering(743) 00:15:13.640 fused_ordering(744) 00:15:13.640 fused_ordering(745) 00:15:13.640 fused_ordering(746) 00:15:13.640 fused_ordering(747) 00:15:13.640 fused_ordering(748) 00:15:13.640 fused_ordering(749) 00:15:13.640 fused_ordering(750) 00:15:13.640 fused_ordering(751) 00:15:13.640 fused_ordering(752) 00:15:13.640 fused_ordering(753) 00:15:13.640 fused_ordering(754) 00:15:13.640 fused_ordering(755) 00:15:13.640 fused_ordering(756) 00:15:13.640 fused_ordering(757) 00:15:13.640 fused_ordering(758) 00:15:13.640 fused_ordering(759) 00:15:13.640 fused_ordering(760) 00:15:13.640 fused_ordering(761) 00:15:13.640 fused_ordering(762) 00:15:13.640 fused_ordering(763) 00:15:13.640 fused_ordering(764) 00:15:13.640 fused_ordering(765) 00:15:13.640 fused_ordering(766) 00:15:13.640 fused_ordering(767) 00:15:13.640 fused_ordering(768) 00:15:13.640 fused_ordering(769) 00:15:13.640 fused_ordering(770) 00:15:13.640 fused_ordering(771) 00:15:13.640 fused_ordering(772) 00:15:13.640 fused_ordering(773) 00:15:13.640 fused_ordering(774) 00:15:13.640 fused_ordering(775) 00:15:13.640 fused_ordering(776) 00:15:13.640 fused_ordering(777) 00:15:13.640 fused_ordering(778) 00:15:13.640 fused_ordering(779) 00:15:13.640 fused_ordering(780) 00:15:13.640 fused_ordering(781) 00:15:13.640 fused_ordering(782) 00:15:13.640 fused_ordering(783) 00:15:13.640 fused_ordering(784) 00:15:13.640 fused_ordering(785) 00:15:13.640 fused_ordering(786) 00:15:13.640 fused_ordering(787) 00:15:13.640 fused_ordering(788) 00:15:13.640 fused_ordering(789) 00:15:13.640 fused_ordering(790) 00:15:13.640 fused_ordering(791) 00:15:13.640 fused_ordering(792) 00:15:13.640 fused_ordering(793) 00:15:13.640 fused_ordering(794) 00:15:13.640 fused_ordering(795) 00:15:13.640 fused_ordering(796) 00:15:13.640 fused_ordering(797) 00:15:13.640 fused_ordering(798) 00:15:13.640 fused_ordering(799) 00:15:13.640 fused_ordering(800) 00:15:13.640 fused_ordering(801) 00:15:13.640 fused_ordering(802) 00:15:13.640 fused_ordering(803) 00:15:13.640 fused_ordering(804) 00:15:13.640 fused_ordering(805) 00:15:13.640 fused_ordering(806) 00:15:13.640 fused_ordering(807) 00:15:13.640 fused_ordering(808) 00:15:13.640 fused_ordering(809) 00:15:13.640 fused_ordering(810) 00:15:13.640 fused_ordering(811) 00:15:13.640 fused_ordering(812) 00:15:13.640 fused_ordering(813) 00:15:13.640 fused_ordering(814) 00:15:13.640 fused_ordering(815) 00:15:13.640 fused_ordering(816) 00:15:13.640 fused_ordering(817) 00:15:13.640 fused_ordering(818) 00:15:13.640 fused_ordering(819) 00:15:13.640 fused_ordering(820) 00:15:14.207 fused_ordering(821) 00:15:14.207 fused_ordering(822) 00:15:14.207 fused_ordering(823) 00:15:14.207 fused_ordering(824) 00:15:14.207 fused_ordering(825) 00:15:14.207 fused_ordering(826) 00:15:14.207 fused_ordering(827) 00:15:14.207 fused_ordering(828) 00:15:14.207 fused_ordering(829) 00:15:14.207 fused_ordering(830) 00:15:14.207 fused_ordering(831) 00:15:14.207 fused_ordering(832) 00:15:14.207 fused_ordering(833) 00:15:14.207 fused_ordering(834) 00:15:14.207 fused_ordering(835) 00:15:14.207 fused_ordering(836) 00:15:14.207 fused_ordering(837) 00:15:14.207 fused_ordering(838) 00:15:14.207 fused_ordering(839) 00:15:14.207 fused_ordering(840) 00:15:14.207 fused_ordering(841) 00:15:14.207 fused_ordering(842) 00:15:14.207 fused_ordering(843) 00:15:14.207 fused_ordering(844) 00:15:14.207 fused_ordering(845) 00:15:14.207 fused_ordering(846) 00:15:14.207 fused_ordering(847) 00:15:14.207 fused_ordering(848) 00:15:14.207 fused_ordering(849) 00:15:14.207 fused_ordering(850) 00:15:14.207 fused_ordering(851) 00:15:14.207 fused_ordering(852) 00:15:14.207 fused_ordering(853) 00:15:14.207 fused_ordering(854) 00:15:14.207 fused_ordering(855) 00:15:14.207 fused_ordering(856) 00:15:14.207 fused_ordering(857) 00:15:14.207 fused_ordering(858) 00:15:14.207 fused_ordering(859) 00:15:14.207 fused_ordering(860) 00:15:14.207 fused_ordering(861) 00:15:14.207 fused_ordering(862) 00:15:14.207 fused_ordering(863) 00:15:14.207 fused_ordering(864) 00:15:14.207 fused_ordering(865) 00:15:14.207 fused_ordering(866) 00:15:14.207 fused_ordering(867) 00:15:14.207 fused_ordering(868) 00:15:14.207 fused_ordering(869) 00:15:14.207 fused_ordering(870) 00:15:14.207 fused_ordering(871) 00:15:14.207 fused_ordering(872) 00:15:14.207 fused_ordering(873) 00:15:14.207 fused_ordering(874) 00:15:14.207 fused_ordering(875) 00:15:14.207 fused_ordering(876) 00:15:14.207 fused_ordering(877) 00:15:14.207 fused_ordering(878) 00:15:14.207 fused_ordering(879) 00:15:14.207 fused_ordering(880) 00:15:14.207 fused_ordering(881) 00:15:14.207 fused_ordering(882) 00:15:14.207 fused_ordering(883) 00:15:14.207 fused_ordering(884) 00:15:14.207 fused_ordering(885) 00:15:14.207 fused_ordering(886) 00:15:14.207 fused_ordering(887) 00:15:14.207 fused_ordering(888) 00:15:14.207 fused_ordering(889) 00:15:14.207 fused_ordering(890) 00:15:14.207 fused_ordering(891) 00:15:14.207 fused_ordering(892) 00:15:14.207 fused_ordering(893) 00:15:14.207 fused_ordering(894) 00:15:14.207 fused_ordering(895) 00:15:14.207 fused_ordering(896) 00:15:14.207 fused_ordering(897) 00:15:14.207 fused_ordering(898) 00:15:14.207 fused_ordering(899) 00:15:14.207 fused_ordering(900) 00:15:14.207 fused_ordering(901) 00:15:14.207 fused_ordering(902) 00:15:14.207 fused_ordering(903) 00:15:14.207 fused_ordering(904) 00:15:14.207 fused_ordering(905) 00:15:14.207 fused_ordering(906) 00:15:14.207 fused_ordering(907) 00:15:14.207 fused_ordering(908) 00:15:14.207 fused_ordering(909) 00:15:14.207 fused_ordering(910) 00:15:14.207 fused_ordering(911) 00:15:14.207 fused_ordering(912) 00:15:14.207 fused_ordering(913) 00:15:14.207 fused_ordering(914) 00:15:14.207 fused_ordering(915) 00:15:14.207 fused_ordering(916) 00:15:14.207 fused_ordering(917) 00:15:14.207 fused_ordering(918) 00:15:14.207 fused_ordering(919) 00:15:14.207 fused_ordering(920) 00:15:14.207 fused_ordering(921) 00:15:14.207 fused_ordering(922) 00:15:14.207 fused_ordering(923) 00:15:14.207 fused_ordering(924) 00:15:14.207 fused_ordering(925) 00:15:14.207 fused_ordering(926) 00:15:14.207 fused_ordering(927) 00:15:14.207 fused_ordering(928) 00:15:14.207 fused_ordering(929) 00:15:14.207 fused_ordering(930) 00:15:14.207 fused_ordering(931) 00:15:14.207 fused_ordering(932) 00:15:14.207 fused_ordering(933) 00:15:14.207 fused_ordering(934) 00:15:14.207 fused_ordering(935) 00:15:14.207 fused_ordering(936) 00:15:14.207 fused_ordering(937) 00:15:14.207 fused_ordering(938) 00:15:14.207 fused_ordering(939) 00:15:14.207 fused_ordering(940) 00:15:14.208 fused_ordering(941) 00:15:14.208 fused_ordering(942) 00:15:14.208 fused_ordering(943) 00:15:14.208 fused_ordering(944) 00:15:14.208 fused_ordering(945) 00:15:14.208 fused_ordering(946) 00:15:14.208 fused_ordering(947) 00:15:14.208 fused_ordering(948) 00:15:14.208 fused_ordering(949) 00:15:14.208 fused_ordering(950) 00:15:14.208 fused_ordering(951) 00:15:14.208 fused_ordering(952) 00:15:14.208 fused_ordering(953) 00:15:14.208 fused_ordering(954) 00:15:14.208 fused_ordering(955) 00:15:14.208 fused_ordering(956) 00:15:14.208 fused_ordering(957) 00:15:14.208 fused_ordering(958) 00:15:14.208 fused_ordering(959) 00:15:14.208 fused_ordering(960) 00:15:14.208 fused_ordering(961) 00:15:14.208 fused_ordering(962) 00:15:14.208 fused_ordering(963) 00:15:14.208 fused_ordering(964) 00:15:14.208 fused_ordering(965) 00:15:14.208 fused_ordering(966) 00:15:14.208 fused_ordering(967) 00:15:14.208 fused_ordering(968) 00:15:14.208 fused_ordering(969) 00:15:14.208 fused_ordering(970) 00:15:14.208 fused_ordering(971) 00:15:14.208 fused_ordering(972) 00:15:14.208 fused_ordering(973) 00:15:14.208 fused_ordering(974) 00:15:14.208 fused_ordering(975) 00:15:14.208 fused_ordering(976) 00:15:14.208 fused_ordering(977) 00:15:14.208 fused_ordering(978) 00:15:14.208 fused_ordering(979) 00:15:14.208 fused_ordering(980) 00:15:14.208 fused_ordering(981) 00:15:14.208 fused_ordering(982) 00:15:14.208 fused_ordering(983) 00:15:14.208 fused_ordering(984) 00:15:14.208 fused_ordering(985) 00:15:14.208 fused_ordering(986) 00:15:14.208 fused_ordering(987) 00:15:14.208 fused_ordering(988) 00:15:14.208 fused_ordering(989) 00:15:14.208 fused_ordering(990) 00:15:14.208 fused_ordering(991) 00:15:14.208 fused_ordering(992) 00:15:14.208 fused_ordering(993) 00:15:14.208 fused_ordering(994) 00:15:14.208 fused_ordering(995) 00:15:14.208 fused_ordering(996) 00:15:14.208 fused_ordering(997) 00:15:14.208 fused_ordering(998) 00:15:14.208 fused_ordering(999) 00:15:14.208 fused_ordering(1000) 00:15:14.208 fused_ordering(1001) 00:15:14.208 fused_ordering(1002) 00:15:14.208 fused_ordering(1003) 00:15:14.208 fused_ordering(1004) 00:15:14.208 fused_ordering(1005) 00:15:14.208 fused_ordering(1006) 00:15:14.208 fused_ordering(1007) 00:15:14.208 fused_ordering(1008) 00:15:14.208 fused_ordering(1009) 00:15:14.208 fused_ordering(1010) 00:15:14.208 fused_ordering(1011) 00:15:14.208 fused_ordering(1012) 00:15:14.208 fused_ordering(1013) 00:15:14.208 fused_ordering(1014) 00:15:14.208 fused_ordering(1015) 00:15:14.208 fused_ordering(1016) 00:15:14.208 fused_ordering(1017) 00:15:14.208 fused_ordering(1018) 00:15:14.208 fused_ordering(1019) 00:15:14.208 fused_ordering(1020) 00:15:14.208 fused_ordering(1021) 00:15:14.208 fused_ordering(1022) 00:15:14.208 fused_ordering(1023) 00:15:14.208 17:08:11 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:14.208 17:08:11 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:14.208 17:08:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:14.208 17:08:11 -- nvmf/common.sh@116 -- # sync 00:15:14.208 17:08:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:14.208 17:08:11 -- nvmf/common.sh@119 -- # set +e 00:15:14.208 17:08:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:14.208 17:08:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:14.208 rmmod nvme_tcp 00:15:14.208 rmmod nvme_fabrics 00:15:14.208 rmmod nvme_keyring 00:15:14.466 17:08:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:14.466 17:08:11 -- nvmf/common.sh@123 -- # set -e 00:15:14.466 17:08:11 -- nvmf/common.sh@124 -- # return 0 00:15:14.466 17:08:11 -- nvmf/common.sh@477 -- # '[' -n 1709077 ']' 00:15:14.466 17:08:11 -- nvmf/common.sh@478 -- # killprocess 1709077 00:15:14.466 17:08:11 -- common/autotest_common.sh@936 -- # '[' -z 1709077 ']' 00:15:14.466 17:08:11 -- common/autotest_common.sh@940 -- # kill -0 1709077 00:15:14.466 17:08:11 -- common/autotest_common.sh@941 -- # uname 00:15:14.466 17:08:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:14.466 17:08:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1709077 00:15:14.466 17:08:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:14.466 17:08:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:14.466 17:08:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1709077' 00:15:14.466 killing process with pid 1709077 00:15:14.466 17:08:11 -- common/autotest_common.sh@955 -- # kill 1709077 00:15:14.466 17:08:11 -- common/autotest_common.sh@960 -- # wait 1709077 00:15:14.726 17:08:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:14.726 17:08:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:14.726 17:08:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:14.726 17:08:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:14.726 17:08:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:14.726 17:08:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:14.726 17:08:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:14.726 17:08:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.629 17:08:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:16.629 00:15:16.629 real 0m8.153s 00:15:16.629 user 0m6.052s 00:15:16.629 sys 0m3.097s 00:15:16.629 17:08:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:16.629 17:08:13 -- common/autotest_common.sh@10 -- # set +x 00:15:16.629 ************************************ 00:15:16.629 END TEST nvmf_fused_ordering 00:15:16.629 ************************************ 00:15:16.629 17:08:13 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:16.629 17:08:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:16.629 17:08:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:16.629 17:08:13 -- common/autotest_common.sh@10 -- # set +x 00:15:16.629 ************************************ 00:15:16.629 START TEST nvmf_delete_subsystem 00:15:16.629 ************************************ 00:15:16.629 17:08:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:16.629 * Looking for test storage... 00:15:16.888 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:16.888 17:08:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:16.888 17:08:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:16.888 17:08:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:16.888 17:08:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:16.888 17:08:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:16.888 17:08:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:16.888 17:08:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:16.888 17:08:13 -- scripts/common.sh@335 -- # IFS=.-: 00:15:16.888 17:08:13 -- scripts/common.sh@335 -- # read -ra ver1 00:15:16.888 17:08:13 -- scripts/common.sh@336 -- # IFS=.-: 00:15:16.888 17:08:13 -- scripts/common.sh@336 -- # read -ra ver2 00:15:16.888 17:08:13 -- scripts/common.sh@337 -- # local 'op=<' 00:15:16.888 17:08:13 -- scripts/common.sh@339 -- # ver1_l=2 00:15:16.888 17:08:13 -- scripts/common.sh@340 -- # ver2_l=1 00:15:16.888 17:08:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:16.888 17:08:13 -- scripts/common.sh@343 -- # case "$op" in 00:15:16.888 17:08:13 -- scripts/common.sh@344 -- # : 1 00:15:16.888 17:08:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:16.888 17:08:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:16.888 17:08:13 -- scripts/common.sh@364 -- # decimal 1 00:15:16.888 17:08:13 -- scripts/common.sh@352 -- # local d=1 00:15:16.888 17:08:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:16.888 17:08:13 -- scripts/common.sh@354 -- # echo 1 00:15:16.888 17:08:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:16.888 17:08:13 -- scripts/common.sh@365 -- # decimal 2 00:15:16.888 17:08:13 -- scripts/common.sh@352 -- # local d=2 00:15:16.888 17:08:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:16.888 17:08:13 -- scripts/common.sh@354 -- # echo 2 00:15:16.888 17:08:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:16.888 17:08:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:16.888 17:08:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:16.888 17:08:13 -- scripts/common.sh@367 -- # return 0 00:15:16.888 17:08:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:16.888 17:08:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:16.888 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.888 --rc genhtml_branch_coverage=1 00:15:16.888 --rc genhtml_function_coverage=1 00:15:16.888 --rc genhtml_legend=1 00:15:16.888 --rc geninfo_all_blocks=1 00:15:16.888 --rc geninfo_unexecuted_blocks=1 00:15:16.888 00:15:16.888 ' 00:15:16.888 17:08:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:16.888 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.888 --rc genhtml_branch_coverage=1 00:15:16.888 --rc genhtml_function_coverage=1 00:15:16.888 --rc genhtml_legend=1 00:15:16.888 --rc geninfo_all_blocks=1 00:15:16.888 --rc geninfo_unexecuted_blocks=1 00:15:16.888 00:15:16.888 ' 00:15:16.888 17:08:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:16.888 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.888 --rc genhtml_branch_coverage=1 00:15:16.888 --rc genhtml_function_coverage=1 00:15:16.888 --rc genhtml_legend=1 00:15:16.888 --rc geninfo_all_blocks=1 00:15:16.888 --rc geninfo_unexecuted_blocks=1 00:15:16.888 00:15:16.888 ' 00:15:16.888 17:08:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:16.888 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.888 --rc genhtml_branch_coverage=1 00:15:16.888 --rc genhtml_function_coverage=1 00:15:16.888 --rc genhtml_legend=1 00:15:16.888 --rc geninfo_all_blocks=1 00:15:16.888 --rc geninfo_unexecuted_blocks=1 00:15:16.888 00:15:16.888 ' 00:15:16.888 17:08:13 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:16.888 17:08:13 -- nvmf/common.sh@7 -- # uname -s 00:15:16.888 17:08:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:16.888 17:08:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:16.888 17:08:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:16.888 17:08:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:16.888 17:08:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:16.888 17:08:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:16.888 17:08:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:16.888 17:08:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:16.888 17:08:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:16.888 17:08:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:16.888 17:08:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.888 17:08:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.888 17:08:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:16.888 17:08:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:16.888 17:08:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:16.888 17:08:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:16.888 17:08:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:16.888 17:08:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:16.888 17:08:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:16.888 17:08:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.888 17:08:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.888 17:08:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.888 17:08:13 -- paths/export.sh@5 -- # export PATH 00:15:16.888 17:08:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.888 17:08:13 -- nvmf/common.sh@46 -- # : 0 00:15:16.888 17:08:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:16.888 17:08:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:16.888 17:08:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:16.888 17:08:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:16.888 17:08:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:16.888 17:08:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:16.888 17:08:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:16.888 17:08:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:16.888 17:08:13 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:16.888 17:08:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:16.888 17:08:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:16.888 17:08:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:16.888 17:08:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:16.888 17:08:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:16.888 17:08:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.888 17:08:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.888 17:08:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.888 17:08:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:16.888 17:08:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:16.888 17:08:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:16.888 17:08:13 -- common/autotest_common.sh@10 -- # set +x 00:15:18.790 17:08:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:18.790 17:08:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:18.790 17:08:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:18.790 17:08:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:18.790 17:08:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:18.790 17:08:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:18.790 17:08:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:18.790 17:08:15 -- nvmf/common.sh@294 -- # net_devs=() 00:15:18.790 17:08:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:18.790 17:08:15 -- nvmf/common.sh@295 -- # e810=() 00:15:18.790 17:08:15 -- nvmf/common.sh@295 -- # local -ga e810 00:15:18.790 17:08:15 -- nvmf/common.sh@296 -- # x722=() 00:15:18.790 17:08:15 -- nvmf/common.sh@296 -- # local -ga x722 00:15:18.790 17:08:15 -- nvmf/common.sh@297 -- # mlx=() 00:15:18.790 17:08:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:18.790 17:08:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:18.790 17:08:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:18.790 17:08:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:18.790 17:08:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:18.790 17:08:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.790 17:08:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:18.790 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:18.790 17:08:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.790 17:08:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:18.790 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:18.790 17:08:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:18.790 17:08:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.790 17:08:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.790 17:08:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.790 17:08:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.790 17:08:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:18.790 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:18.790 17:08:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.790 17:08:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.790 17:08:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.790 17:08:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.790 17:08:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.790 17:08:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:18.790 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:18.790 17:08:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.790 17:08:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:18.790 17:08:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:18.790 17:08:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:18.790 17:08:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:18.791 17:08:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:18.791 17:08:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:18.791 17:08:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:18.791 17:08:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:18.791 17:08:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:18.791 17:08:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:18.791 17:08:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:18.791 17:08:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:18.791 17:08:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:18.791 17:08:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:18.791 17:08:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:18.791 17:08:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:18.791 17:08:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:19.050 17:08:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:19.050 17:08:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:19.050 17:08:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:19.050 17:08:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:19.050 17:08:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:19.050 17:08:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:19.050 17:08:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:19.050 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:19.050 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.139 ms 00:15:19.050 00:15:19.050 --- 10.0.0.2 ping statistics --- 00:15:19.050 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.050 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:15:19.050 17:08:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:19.050 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:19.050 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:19.050 00:15:19.050 --- 10.0.0.1 ping statistics --- 00:15:19.050 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.050 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:19.050 17:08:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:19.050 17:08:15 -- nvmf/common.sh@410 -- # return 0 00:15:19.050 17:08:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:19.050 17:08:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:19.050 17:08:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:19.050 17:08:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:19.050 17:08:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:19.050 17:08:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:19.050 17:08:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:19.050 17:08:15 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:19.050 17:08:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:19.050 17:08:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:19.050 17:08:15 -- common/autotest_common.sh@10 -- # set +x 00:15:19.050 17:08:15 -- nvmf/common.sh@469 -- # nvmfpid=1711454 00:15:19.050 17:08:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:19.050 17:08:15 -- nvmf/common.sh@470 -- # waitforlisten 1711454 00:15:19.050 17:08:15 -- common/autotest_common.sh@829 -- # '[' -z 1711454 ']' 00:15:19.050 17:08:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:19.050 17:08:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:19.050 17:08:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:19.050 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:19.050 17:08:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:19.050 17:08:15 -- common/autotest_common.sh@10 -- # set +x 00:15:19.050 [2024-11-27 17:08:15.906173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:19.050 [2024-11-27 17:08:15.906274] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:19.050 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.050 [2024-11-27 17:08:15.977209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:19.309 [2024-11-27 17:08:16.067478] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:19.309 [2024-11-27 17:08:16.067670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:19.309 [2024-11-27 17:08:16.067693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:19.309 [2024-11-27 17:08:16.067708] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:19.309 [2024-11-27 17:08:16.067783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:19.309 [2024-11-27 17:08:16.067790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:20.242 17:08:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:20.242 17:08:16 -- common/autotest_common.sh@862 -- # return 0 00:15:20.242 17:08:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:20.242 17:08:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:20.242 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.242 17:08:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:20.242 17:08:16 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:20.242 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.242 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.242 [2024-11-27 17:08:16.953514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:20.242 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:20.243 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.243 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:20.243 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.243 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 [2024-11-27 17:08:16.969876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:20.243 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:20.243 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.243 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 NULL1 00:15:20.243 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:20.243 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.243 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 Delay0 00:15:20.243 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:20.243 17:08:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.243 17:08:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 17:08:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@28 -- # perf_pid=1711618 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:20.243 17:08:16 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:20.243 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.243 [2024-11-27 17:08:17.044446] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:22.141 17:08:19 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:22.141 17:08:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.141 17:08:19 -- common/autotest_common.sh@10 -- # set +x 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 starting I/O failed: -6 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 starting I/O failed: -6 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Read completed with error (sct=0, sc=8) 00:15:22.399 Write completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 [2024-11-27 17:08:19.175701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fcf68000c00 is same with the state(5) to be set 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 starting I/O failed: -6 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:22.400 Write completed with error (sct=0, sc=8) 00:15:22.400 Read completed with error (sct=0, sc=8) 00:15:23.333 [2024-11-27 17:08:20.141362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20d29c0 is same with the state(5) to be set 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 [2024-11-27 17:08:20.174955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fcf6800c1d0 is same with the state(5) to be set 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Write completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 [2024-11-27 17:08:20.178321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20d09e0 is same with the state(5) to be set 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.333 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 [2024-11-27 17:08:20.178597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20d0ce0 is same with the state(5) to be set 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 Write completed with error (sct=0, sc=8) 00:15:23.334 Read completed with error (sct=0, sc=8) 00:15:23.334 [2024-11-27 17:08:20.178834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20d1240 is same with the state(5) to be set 00:15:23.334 [2024-11-27 17:08:20.179879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20d29c0 (9): Bad file descriptor 00:15:23.334 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:23.334 17:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.334 17:08:20 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:23.334 17:08:20 -- target/delete_subsystem.sh@35 -- # kill -0 1711618 00:15:23.334 17:08:20 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:23.334 Initializing NVMe Controllers 00:15:23.334 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:23.334 Controller IO queue size 128, less than required. 00:15:23.334 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:23.334 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:23.334 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:23.334 Initialization complete. Launching workers. 00:15:23.334 ======================================================== 00:15:23.334 Latency(us) 00:15:23.334 Device Information : IOPS MiB/s Average min max 00:15:23.334 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 193.97 0.09 948866.30 882.30 1012486.54 00:15:23.334 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 149.32 0.07 900268.60 551.06 1013471.42 00:15:23.334 ======================================================== 00:15:23.334 Total : 343.29 0.17 927727.71 551.06 1013471.42 00:15:23.334 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@35 -- # kill -0 1711618 00:15:23.901 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1711618) - No such process 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@45 -- # NOT wait 1711618 00:15:23.901 17:08:20 -- common/autotest_common.sh@650 -- # local es=0 00:15:23.901 17:08:20 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1711618 00:15:23.901 17:08:20 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:23.901 17:08:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.901 17:08:20 -- common/autotest_common.sh@642 -- # type -t wait 00:15:23.901 17:08:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.901 17:08:20 -- common/autotest_common.sh@653 -- # wait 1711618 00:15:23.901 17:08:20 -- common/autotest_common.sh@653 -- # es=1 00:15:23.901 17:08:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:23.901 17:08:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:23.901 17:08:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:23.901 17:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.901 17:08:20 -- common/autotest_common.sh@10 -- # set +x 00:15:23.901 17:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:23.901 17:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.901 17:08:20 -- common/autotest_common.sh@10 -- # set +x 00:15:23.901 [2024-11-27 17:08:20.699665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:23.901 17:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:23.901 17:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.901 17:08:20 -- common/autotest_common.sh@10 -- # set +x 00:15:23.901 17:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@54 -- # perf_pid=1712150 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:23.901 17:08:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:23.901 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.901 [2024-11-27 17:08:20.756454] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:24.467 17:08:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:24.467 17:08:21 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:24.467 17:08:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:25.032 17:08:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:25.032 17:08:21 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:25.032 17:08:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:25.289 17:08:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:25.289 17:08:22 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:25.289 17:08:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:25.854 17:08:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:25.854 17:08:22 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:25.854 17:08:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:26.419 17:08:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:26.419 17:08:23 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:26.419 17:08:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:26.984 17:08:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:26.984 17:08:23 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:26.984 17:08:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:27.242 Initializing NVMe Controllers 00:15:27.242 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:27.242 Controller IO queue size 128, less than required. 00:15:27.242 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:27.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:27.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:27.242 Initialization complete. Launching workers. 00:15:27.242 ======================================================== 00:15:27.242 Latency(us) 00:15:27.242 Device Information : IOPS MiB/s Average min max 00:15:27.242 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003523.05 1000178.93 1011718.73 00:15:27.242 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005676.80 1000182.76 1042377.58 00:15:27.242 ======================================================== 00:15:27.242 Total : 256.00 0.12 1004599.92 1000178.93 1042377.58 00:15:27.242 00:15:27.499 17:08:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:27.499 17:08:24 -- target/delete_subsystem.sh@57 -- # kill -0 1712150 00:15:27.499 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1712150) - No such process 00:15:27.499 17:08:24 -- target/delete_subsystem.sh@67 -- # wait 1712150 00:15:27.499 17:08:24 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:27.499 17:08:24 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:27.499 17:08:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:27.499 17:08:24 -- nvmf/common.sh@116 -- # sync 00:15:27.499 17:08:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:27.499 17:08:24 -- nvmf/common.sh@119 -- # set +e 00:15:27.499 17:08:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:27.499 17:08:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:27.499 rmmod nvme_tcp 00:15:27.499 rmmod nvme_fabrics 00:15:27.499 rmmod nvme_keyring 00:15:27.499 17:08:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:27.499 17:08:24 -- nvmf/common.sh@123 -- # set -e 00:15:27.499 17:08:24 -- nvmf/common.sh@124 -- # return 0 00:15:27.499 17:08:24 -- nvmf/common.sh@477 -- # '[' -n 1711454 ']' 00:15:27.499 17:08:24 -- nvmf/common.sh@478 -- # killprocess 1711454 00:15:27.499 17:08:24 -- common/autotest_common.sh@936 -- # '[' -z 1711454 ']' 00:15:27.499 17:08:24 -- common/autotest_common.sh@940 -- # kill -0 1711454 00:15:27.499 17:08:24 -- common/autotest_common.sh@941 -- # uname 00:15:27.499 17:08:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:27.499 17:08:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1711454 00:15:27.499 17:08:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:27.499 17:08:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:27.499 17:08:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1711454' 00:15:27.499 killing process with pid 1711454 00:15:27.499 17:08:24 -- common/autotest_common.sh@955 -- # kill 1711454 00:15:27.499 17:08:24 -- common/autotest_common.sh@960 -- # wait 1711454 00:15:27.757 17:08:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:27.757 17:08:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:27.757 17:08:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:27.757 17:08:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:27.757 17:08:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:27.757 17:08:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:27.757 17:08:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:27.757 17:08:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.660 17:08:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:29.660 00:15:29.660 real 0m13.076s 00:15:29.660 user 0m29.690s 00:15:29.660 sys 0m2.902s 00:15:29.660 17:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:29.660 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:29.660 ************************************ 00:15:29.660 END TEST nvmf_delete_subsystem 00:15:29.660 ************************************ 00:15:29.918 17:08:26 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:29.918 17:08:26 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:29.918 17:08:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:29.918 17:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:29.918 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:29.918 ************************************ 00:15:29.918 START TEST nvmf_nvme_cli 00:15:29.918 ************************************ 00:15:29.918 17:08:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:29.918 * Looking for test storage... 00:15:29.918 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:29.918 17:08:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:29.918 17:08:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:29.918 17:08:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:29.918 17:08:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:29.918 17:08:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:29.918 17:08:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:29.918 17:08:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:29.918 17:08:26 -- scripts/common.sh@335 -- # IFS=.-: 00:15:29.918 17:08:26 -- scripts/common.sh@335 -- # read -ra ver1 00:15:29.918 17:08:26 -- scripts/common.sh@336 -- # IFS=.-: 00:15:29.918 17:08:26 -- scripts/common.sh@336 -- # read -ra ver2 00:15:29.918 17:08:26 -- scripts/common.sh@337 -- # local 'op=<' 00:15:29.918 17:08:26 -- scripts/common.sh@339 -- # ver1_l=2 00:15:29.918 17:08:26 -- scripts/common.sh@340 -- # ver2_l=1 00:15:29.918 17:08:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:29.918 17:08:26 -- scripts/common.sh@343 -- # case "$op" in 00:15:29.918 17:08:26 -- scripts/common.sh@344 -- # : 1 00:15:29.918 17:08:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:29.918 17:08:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:29.918 17:08:26 -- scripts/common.sh@364 -- # decimal 1 00:15:29.918 17:08:26 -- scripts/common.sh@352 -- # local d=1 00:15:29.918 17:08:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:29.918 17:08:26 -- scripts/common.sh@354 -- # echo 1 00:15:29.918 17:08:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:29.918 17:08:26 -- scripts/common.sh@365 -- # decimal 2 00:15:29.918 17:08:26 -- scripts/common.sh@352 -- # local d=2 00:15:29.918 17:08:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:29.919 17:08:26 -- scripts/common.sh@354 -- # echo 2 00:15:29.919 17:08:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:29.919 17:08:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:29.919 17:08:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:29.919 17:08:26 -- scripts/common.sh@367 -- # return 0 00:15:29.919 17:08:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:29.919 17:08:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:29.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.919 --rc genhtml_branch_coverage=1 00:15:29.919 --rc genhtml_function_coverage=1 00:15:29.919 --rc genhtml_legend=1 00:15:29.919 --rc geninfo_all_blocks=1 00:15:29.919 --rc geninfo_unexecuted_blocks=1 00:15:29.919 00:15:29.919 ' 00:15:29.919 17:08:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:29.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.919 --rc genhtml_branch_coverage=1 00:15:29.919 --rc genhtml_function_coverage=1 00:15:29.919 --rc genhtml_legend=1 00:15:29.919 --rc geninfo_all_blocks=1 00:15:29.919 --rc geninfo_unexecuted_blocks=1 00:15:29.919 00:15:29.919 ' 00:15:29.919 17:08:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:29.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.919 --rc genhtml_branch_coverage=1 00:15:29.919 --rc genhtml_function_coverage=1 00:15:29.919 --rc genhtml_legend=1 00:15:29.919 --rc geninfo_all_blocks=1 00:15:29.919 --rc geninfo_unexecuted_blocks=1 00:15:29.919 00:15:29.919 ' 00:15:29.919 17:08:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:29.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.919 --rc genhtml_branch_coverage=1 00:15:29.919 --rc genhtml_function_coverage=1 00:15:29.919 --rc genhtml_legend=1 00:15:29.919 --rc geninfo_all_blocks=1 00:15:29.919 --rc geninfo_unexecuted_blocks=1 00:15:29.919 00:15:29.919 ' 00:15:29.919 17:08:26 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:29.919 17:08:26 -- nvmf/common.sh@7 -- # uname -s 00:15:29.919 17:08:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:29.919 17:08:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:29.919 17:08:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:29.919 17:08:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:29.919 17:08:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:29.919 17:08:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:29.919 17:08:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:29.919 17:08:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:29.919 17:08:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:29.919 17:08:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:29.919 17:08:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.919 17:08:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.919 17:08:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:29.919 17:08:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:29.919 17:08:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:29.919 17:08:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:29.919 17:08:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:29.919 17:08:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:29.919 17:08:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:29.919 17:08:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.919 17:08:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.919 17:08:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.919 17:08:26 -- paths/export.sh@5 -- # export PATH 00:15:29.919 17:08:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.919 17:08:26 -- nvmf/common.sh@46 -- # : 0 00:15:29.919 17:08:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:29.919 17:08:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:29.919 17:08:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:29.919 17:08:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:29.919 17:08:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:29.919 17:08:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:29.919 17:08:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:29.919 17:08:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:29.919 17:08:26 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:29.919 17:08:26 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:29.919 17:08:26 -- target/nvme_cli.sh@14 -- # devs=() 00:15:29.919 17:08:26 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:29.919 17:08:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:29.919 17:08:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:29.919 17:08:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:29.919 17:08:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:29.919 17:08:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:29.919 17:08:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:29.919 17:08:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:29.919 17:08:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.919 17:08:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:29.919 17:08:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:29.919 17:08:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:29.919 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:32.450 17:08:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:32.450 17:08:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:32.450 17:08:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:32.450 17:08:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:32.450 17:08:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:32.450 17:08:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:32.450 17:08:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:32.450 17:08:28 -- nvmf/common.sh@294 -- # net_devs=() 00:15:32.450 17:08:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:32.450 17:08:28 -- nvmf/common.sh@295 -- # e810=() 00:15:32.450 17:08:28 -- nvmf/common.sh@295 -- # local -ga e810 00:15:32.450 17:08:28 -- nvmf/common.sh@296 -- # x722=() 00:15:32.450 17:08:28 -- nvmf/common.sh@296 -- # local -ga x722 00:15:32.450 17:08:28 -- nvmf/common.sh@297 -- # mlx=() 00:15:32.450 17:08:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:32.450 17:08:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:32.450 17:08:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:32.450 17:08:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:32.450 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:32.450 17:08:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:32.450 17:08:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:32.450 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:32.450 17:08:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:32.450 17:08:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:32.450 17:08:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:32.450 17:08:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:32.450 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:32.450 17:08:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:32.450 17:08:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:32.450 17:08:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:32.450 17:08:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:32.450 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:32.450 17:08:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:32.450 17:08:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:32.450 17:08:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:32.450 17:08:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:32.450 17:08:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:32.450 17:08:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:32.450 17:08:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:32.450 17:08:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:32.450 17:08:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:32.450 17:08:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:32.450 17:08:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:32.450 17:08:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:32.450 17:08:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:32.450 17:08:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:32.450 17:08:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:32.450 17:08:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:32.450 17:08:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:32.450 17:08:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:32.450 17:08:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:32.450 17:08:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:32.450 17:08:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:32.450 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:32.450 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.357 ms 00:15:32.450 00:15:32.450 --- 10.0.0.2 ping statistics --- 00:15:32.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:32.450 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:15:32.450 17:08:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:32.450 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:32.450 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:15:32.450 00:15:32.450 --- 10.0.0.1 ping statistics --- 00:15:32.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:32.450 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:15:32.450 17:08:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:32.450 17:08:28 -- nvmf/common.sh@410 -- # return 0 00:15:32.450 17:08:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:32.450 17:08:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:32.450 17:08:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:32.450 17:08:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:32.450 17:08:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:32.450 17:08:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:32.450 17:08:28 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:32.450 17:08:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:32.450 17:08:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:32.450 17:08:28 -- common/autotest_common.sh@10 -- # set +x 00:15:32.450 17:08:28 -- nvmf/common.sh@469 -- # nvmfpid=1714526 00:15:32.450 17:08:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:32.450 17:08:28 -- nvmf/common.sh@470 -- # waitforlisten 1714526 00:15:32.450 17:08:28 -- common/autotest_common.sh@829 -- # '[' -z 1714526 ']' 00:15:32.450 17:08:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:32.450 17:08:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:32.451 17:08:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:32.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:32.451 17:08:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:32.451 17:08:28 -- common/autotest_common.sh@10 -- # set +x 00:15:32.451 [2024-11-27 17:08:28.997172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:32.451 [2024-11-27 17:08:28.997253] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:32.451 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.451 [2024-11-27 17:08:29.068052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:32.451 [2024-11-27 17:08:29.159559] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:32.451 [2024-11-27 17:08:29.159696] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:32.451 [2024-11-27 17:08:29.159712] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:32.451 [2024-11-27 17:08:29.159725] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:32.451 [2024-11-27 17:08:29.159775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:32.451 [2024-11-27 17:08:29.159835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:32.451 [2024-11-27 17:08:29.159899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:32.451 [2024-11-27 17:08:29.159902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:33.383 17:08:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:33.383 17:08:30 -- common/autotest_common.sh@862 -- # return 0 00:15:33.383 17:08:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:33.383 17:08:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:33.383 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.383 17:08:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:33.383 17:08:30 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:33.383 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.383 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.383 [2024-11-27 17:08:30.057471] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:33.383 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.383 17:08:30 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:33.383 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.383 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.383 Malloc0 00:15:33.383 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.383 17:08:30 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:33.383 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.383 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.383 Malloc1 00:15:33.383 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.383 17:08:30 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:33.383 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.383 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.384 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.384 17:08:30 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:33.384 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.384 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.384 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.384 17:08:30 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:33.384 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.384 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.384 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.384 17:08:30 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:33.384 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.384 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.384 [2024-11-27 17:08:30.143428] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:33.384 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.384 17:08:30 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:33.384 17:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.384 17:08:30 -- common/autotest_common.sh@10 -- # set +x 00:15:33.384 17:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.384 17:08:30 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:33.384 00:15:33.384 Discovery Log Number of Records 2, Generation counter 2 00:15:33.384 =====Discovery Log Entry 0====== 00:15:33.384 trtype: tcp 00:15:33.384 adrfam: ipv4 00:15:33.384 subtype: current discovery subsystem 00:15:33.384 treq: not required 00:15:33.384 portid: 0 00:15:33.384 trsvcid: 4420 00:15:33.384 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:33.384 traddr: 10.0.0.2 00:15:33.384 eflags: explicit discovery connections, duplicate discovery information 00:15:33.384 sectype: none 00:15:33.384 =====Discovery Log Entry 1====== 00:15:33.384 trtype: tcp 00:15:33.384 adrfam: ipv4 00:15:33.384 subtype: nvme subsystem 00:15:33.384 treq: not required 00:15:33.384 portid: 0 00:15:33.384 trsvcid: 4420 00:15:33.384 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:33.384 traddr: 10.0.0.2 00:15:33.384 eflags: none 00:15:33.384 sectype: none 00:15:33.384 17:08:30 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:33.384 17:08:30 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:33.384 17:08:30 -- nvmf/common.sh@510 -- # local dev _ 00:15:33.384 17:08:30 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:33.384 17:08:30 -- nvmf/common.sh@509 -- # nvme list 00:15:33.642 17:08:30 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:33.642 17:08:30 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:33.642 17:08:30 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:33.642 17:08:30 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:33.642 17:08:30 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:33.642 17:08:30 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:34.210 17:08:30 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:34.210 17:08:30 -- common/autotest_common.sh@1187 -- # local i=0 00:15:34.210 17:08:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:34.210 17:08:30 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:34.210 17:08:30 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:34.210 17:08:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:36.170 17:08:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:36.170 17:08:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:36.170 17:08:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:36.170 17:08:32 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:36.170 17:08:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:36.170 17:08:32 -- common/autotest_common.sh@1197 -- # return 0 00:15:36.170 17:08:32 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:36.170 17:08:32 -- nvmf/common.sh@510 -- # local dev _ 00:15:36.170 17:08:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:32 -- nvmf/common.sh@509 -- # nvme list 00:15:36.170 17:08:33 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:36.170 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:33 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:36.170 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:36.170 17:08:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:36.170 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:36.170 17:08:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:36.170 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:33 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:36.170 /dev/nvme0n2 ]] 00:15:36.170 17:08:33 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:36.170 17:08:33 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:36.170 17:08:33 -- nvmf/common.sh@510 -- # local dev _ 00:15:36.170 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.170 17:08:33 -- nvmf/common.sh@509 -- # nvme list 00:15:36.428 17:08:33 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:36.429 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.429 17:08:33 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:36.429 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.429 17:08:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:36.429 17:08:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:36.429 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.429 17:08:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:36.429 17:08:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:36.429 17:08:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:36.429 17:08:33 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:36.429 17:08:33 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:36.688 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:36.688 17:08:33 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:36.688 17:08:33 -- common/autotest_common.sh@1208 -- # local i=0 00:15:36.688 17:08:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:36.688 17:08:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:36.688 17:08:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:36.688 17:08:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:36.688 17:08:33 -- common/autotest_common.sh@1220 -- # return 0 00:15:36.688 17:08:33 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:36.688 17:08:33 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:36.688 17:08:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.688 17:08:33 -- common/autotest_common.sh@10 -- # set +x 00:15:36.688 17:08:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.688 17:08:33 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:36.688 17:08:33 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:36.688 17:08:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:36.688 17:08:33 -- nvmf/common.sh@116 -- # sync 00:15:36.688 17:08:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:36.688 17:08:33 -- nvmf/common.sh@119 -- # set +e 00:15:36.688 17:08:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:36.688 17:08:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:36.688 rmmod nvme_tcp 00:15:36.688 rmmod nvme_fabrics 00:15:36.688 rmmod nvme_keyring 00:15:36.688 17:08:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:36.688 17:08:33 -- nvmf/common.sh@123 -- # set -e 00:15:36.688 17:08:33 -- nvmf/common.sh@124 -- # return 0 00:15:36.688 17:08:33 -- nvmf/common.sh@477 -- # '[' -n 1714526 ']' 00:15:36.688 17:08:33 -- nvmf/common.sh@478 -- # killprocess 1714526 00:15:36.688 17:08:33 -- common/autotest_common.sh@936 -- # '[' -z 1714526 ']' 00:15:36.688 17:08:33 -- common/autotest_common.sh@940 -- # kill -0 1714526 00:15:36.688 17:08:33 -- common/autotest_common.sh@941 -- # uname 00:15:36.688 17:08:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:36.688 17:08:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1714526 00:15:36.688 17:08:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:36.688 17:08:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:36.688 17:08:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1714526' 00:15:36.688 killing process with pid 1714526 00:15:36.688 17:08:33 -- common/autotest_common.sh@955 -- # kill 1714526 00:15:36.688 17:08:33 -- common/autotest_common.sh@960 -- # wait 1714526 00:15:36.947 17:08:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:36.947 17:08:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:36.947 17:08:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:36.947 17:08:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:36.947 17:08:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:36.947 17:08:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.947 17:08:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.947 17:08:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:39.485 17:08:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:39.485 00:15:39.485 real 0m9.269s 00:15:39.485 user 0m19.470s 00:15:39.485 sys 0m2.359s 00:15:39.485 17:08:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:39.485 17:08:35 -- common/autotest_common.sh@10 -- # set +x 00:15:39.485 ************************************ 00:15:39.485 END TEST nvmf_nvme_cli 00:15:39.485 ************************************ 00:15:39.485 17:08:35 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:39.485 17:08:35 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:39.485 17:08:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:39.485 17:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:39.485 17:08:35 -- common/autotest_common.sh@10 -- # set +x 00:15:39.485 ************************************ 00:15:39.485 START TEST nvmf_vfio_user 00:15:39.485 ************************************ 00:15:39.485 17:08:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:39.485 * Looking for test storage... 00:15:39.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:39.485 17:08:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:39.485 17:08:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:39.485 17:08:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:39.485 17:08:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:39.485 17:08:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:39.485 17:08:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:39.485 17:08:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:39.485 17:08:36 -- scripts/common.sh@335 -- # IFS=.-: 00:15:39.485 17:08:36 -- scripts/common.sh@335 -- # read -ra ver1 00:15:39.485 17:08:36 -- scripts/common.sh@336 -- # IFS=.-: 00:15:39.485 17:08:36 -- scripts/common.sh@336 -- # read -ra ver2 00:15:39.485 17:08:36 -- scripts/common.sh@337 -- # local 'op=<' 00:15:39.485 17:08:36 -- scripts/common.sh@339 -- # ver1_l=2 00:15:39.485 17:08:36 -- scripts/common.sh@340 -- # ver2_l=1 00:15:39.485 17:08:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:39.485 17:08:36 -- scripts/common.sh@343 -- # case "$op" in 00:15:39.485 17:08:36 -- scripts/common.sh@344 -- # : 1 00:15:39.485 17:08:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:39.485 17:08:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:39.485 17:08:36 -- scripts/common.sh@364 -- # decimal 1 00:15:39.485 17:08:36 -- scripts/common.sh@352 -- # local d=1 00:15:39.485 17:08:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:39.485 17:08:36 -- scripts/common.sh@354 -- # echo 1 00:15:39.485 17:08:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:39.485 17:08:36 -- scripts/common.sh@365 -- # decimal 2 00:15:39.485 17:08:36 -- scripts/common.sh@352 -- # local d=2 00:15:39.485 17:08:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:39.485 17:08:36 -- scripts/common.sh@354 -- # echo 2 00:15:39.485 17:08:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:39.485 17:08:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:39.485 17:08:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:39.485 17:08:36 -- scripts/common.sh@367 -- # return 0 00:15:39.485 17:08:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:39.485 17:08:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:39.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.485 --rc genhtml_branch_coverage=1 00:15:39.485 --rc genhtml_function_coverage=1 00:15:39.485 --rc genhtml_legend=1 00:15:39.485 --rc geninfo_all_blocks=1 00:15:39.485 --rc geninfo_unexecuted_blocks=1 00:15:39.485 00:15:39.485 ' 00:15:39.485 17:08:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:39.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.485 --rc genhtml_branch_coverage=1 00:15:39.485 --rc genhtml_function_coverage=1 00:15:39.485 --rc genhtml_legend=1 00:15:39.485 --rc geninfo_all_blocks=1 00:15:39.485 --rc geninfo_unexecuted_blocks=1 00:15:39.485 00:15:39.485 ' 00:15:39.485 17:08:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:39.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.485 --rc genhtml_branch_coverage=1 00:15:39.485 --rc genhtml_function_coverage=1 00:15:39.485 --rc genhtml_legend=1 00:15:39.485 --rc geninfo_all_blocks=1 00:15:39.485 --rc geninfo_unexecuted_blocks=1 00:15:39.485 00:15:39.485 ' 00:15:39.485 17:08:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:39.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.485 --rc genhtml_branch_coverage=1 00:15:39.485 --rc genhtml_function_coverage=1 00:15:39.485 --rc genhtml_legend=1 00:15:39.485 --rc geninfo_all_blocks=1 00:15:39.485 --rc geninfo_unexecuted_blocks=1 00:15:39.485 00:15:39.485 ' 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:39.485 17:08:36 -- nvmf/common.sh@7 -- # uname -s 00:15:39.485 17:08:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:39.485 17:08:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:39.485 17:08:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:39.485 17:08:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:39.485 17:08:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:39.485 17:08:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:39.485 17:08:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:39.485 17:08:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:39.485 17:08:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:39.485 17:08:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:39.485 17:08:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:39.485 17:08:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:39.485 17:08:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:39.485 17:08:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:39.485 17:08:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:39.485 17:08:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:39.485 17:08:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:39.485 17:08:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:39.485 17:08:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:39.485 17:08:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.485 17:08:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.485 17:08:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.485 17:08:36 -- paths/export.sh@5 -- # export PATH 00:15:39.485 17:08:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.485 17:08:36 -- nvmf/common.sh@46 -- # : 0 00:15:39.485 17:08:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:39.485 17:08:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:39.485 17:08:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:39.485 17:08:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:39.485 17:08:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:39.485 17:08:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:39.485 17:08:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:39.485 17:08:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:39.485 17:08:36 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1715501 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1715501' 00:15:39.486 Process pid: 1715501 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:39.486 17:08:36 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1715501 00:15:39.486 17:08:36 -- common/autotest_common.sh@829 -- # '[' -z 1715501 ']' 00:15:39.486 17:08:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:39.486 17:08:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:39.486 17:08:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:39.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:39.486 17:08:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:39.486 17:08:36 -- common/autotest_common.sh@10 -- # set +x 00:15:39.486 [2024-11-27 17:08:36.160629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:39.486 [2024-11-27 17:08:36.160713] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:39.486 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.486 [2024-11-27 17:08:36.224187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:39.486 [2024-11-27 17:08:36.314159] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:39.486 [2024-11-27 17:08:36.314317] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:39.486 [2024-11-27 17:08:36.314337] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:39.486 [2024-11-27 17:08:36.314352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:39.486 [2024-11-27 17:08:36.314419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.486 [2024-11-27 17:08:36.314488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:39.486 [2024-11-27 17:08:36.314591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:39.486 [2024-11-27 17:08:36.314595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.419 17:08:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:40.419 17:08:37 -- common/autotest_common.sh@862 -- # return 0 00:15:40.419 17:08:37 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:41.352 17:08:38 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:41.610 17:08:38 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:41.610 17:08:38 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:41.610 17:08:38 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:41.610 17:08:38 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:41.610 17:08:38 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:41.868 Malloc1 00:15:41.868 17:08:38 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:42.126 17:08:38 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:42.388 17:08:39 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:42.645 17:08:39 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:42.645 17:08:39 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:42.645 17:08:39 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:42.903 Malloc2 00:15:42.903 17:08:39 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:43.161 17:08:39 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:43.417 17:08:40 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:43.675 17:08:40 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:43.675 [2024-11-27 17:08:40.525127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:43.675 [2024-11-27 17:08:40.525169] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1716070 ] 00:15:43.675 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.675 [2024-11-27 17:08:40.556224] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:43.675 [2024-11-27 17:08:40.564925] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:43.675 [2024-11-27 17:08:40.564955] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f46f60b5000 00:15:43.675 [2024-11-27 17:08:40.565917] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.566921] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.567911] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.568918] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.569923] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.570932] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.571944] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.572948] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:43.675 [2024-11-27 17:08:40.573956] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:43.675 [2024-11-27 17:08:40.573977] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f46f4daf000 00:15:43.675 [2024-11-27 17:08:40.575129] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:43.675 [2024-11-27 17:08:40.590375] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:43.675 [2024-11-27 17:08:40.590409] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:43.675 [2024-11-27 17:08:40.595111] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:43.675 [2024-11-27 17:08:40.595182] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:43.675 [2024-11-27 17:08:40.595301] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:43.675 [2024-11-27 17:08:40.595342] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:43.675 [2024-11-27 17:08:40.595354] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:43.675 [2024-11-27 17:08:40.596104] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:43.675 [2024-11-27 17:08:40.596125] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:43.675 [2024-11-27 17:08:40.596137] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:43.676 [2024-11-27 17:08:40.597110] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:43.676 [2024-11-27 17:08:40.597129] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:43.676 [2024-11-27 17:08:40.597143] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.598113] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:43.676 [2024-11-27 17:08:40.598131] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.599117] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:43.676 [2024-11-27 17:08:40.599136] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:43.676 [2024-11-27 17:08:40.599145] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.599156] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.599265] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:43.676 [2024-11-27 17:08:40.599273] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.599280] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:43.676 [2024-11-27 17:08:40.600125] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:43.676 [2024-11-27 17:08:40.601130] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:43.676 [2024-11-27 17:08:40.602139] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:43.676 [2024-11-27 17:08:40.604540] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:43.676 [2024-11-27 17:08:40.605158] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:43.676 [2024-11-27 17:08:40.605176] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:43.676 [2024-11-27 17:08:40.605185] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605210] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:43.676 [2024-11-27 17:08:40.605224] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605255] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:43.676 [2024-11-27 17:08:40.605266] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:43.676 [2024-11-27 17:08:40.605289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.605379] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:43.676 [2024-11-27 17:08:40.605388] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:43.676 [2024-11-27 17:08:40.605396] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:43.676 [2024-11-27 17:08:40.605418] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:43.676 [2024-11-27 17:08:40.605427] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:43.676 [2024-11-27 17:08:40.605434] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:43.676 [2024-11-27 17:08:40.605441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605459] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605475] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.605538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:43.676 [2024-11-27 17:08:40.605554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:43.676 [2024-11-27 17:08:40.605566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:43.676 [2024-11-27 17:08:40.605578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:43.676 [2024-11-27 17:08:40.605587] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605619] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.605643] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:43.676 [2024-11-27 17:08:40.605652] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605663] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605699] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.605777] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605792] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605823] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:43.676 [2024-11-27 17:08:40.605832] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:43.676 [2024-11-27 17:08:40.605841] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.605898] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:43.676 [2024-11-27 17:08:40.605919] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605934] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.605945] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:43.676 [2024-11-27 17:08:40.605953] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:43.676 [2024-11-27 17:08:40.605962] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.605986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606035] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:43.676 [2024-11-27 17:08:40.606042] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:43.676 [2024-11-27 17:08:40.606051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606081] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606091] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606106] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606131] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606143] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606152] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:43.676 [2024-11-27 17:08:40.606160] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:43.676 [2024-11-27 17:08:40.606168] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:43.676 [2024-11-27 17:08:40.606212] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606252] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606280] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606311] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606346] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:43.676 [2024-11-27 17:08:40.606354] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:43.676 [2024-11-27 17:08:40.606360] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:43.676 [2024-11-27 17:08:40.606367] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:43.676 [2024-11-27 17:08:40.606376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:43.676 [2024-11-27 17:08:40.606387] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:43.676 [2024-11-27 17:08:40.606395] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:43.676 [2024-11-27 17:08:40.606404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606415] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:43.676 [2024-11-27 17:08:40.606422] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:43.676 [2024-11-27 17:08:40.606431] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606444] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:43.676 [2024-11-27 17:08:40.606452] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:43.676 [2024-11-27 17:08:40.606461] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:43.676 [2024-11-27 17:08:40.606472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:43.676 [2024-11-27 17:08:40.606552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:43.676 ===================================================== 00:15:43.676 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:43.676 ===================================================== 00:15:43.676 Controller Capabilities/Features 00:15:43.676 ================================ 00:15:43.676 Vendor ID: 4e58 00:15:43.676 Subsystem Vendor ID: 4e58 00:15:43.676 Serial Number: SPDK1 00:15:43.676 Model Number: SPDK bdev Controller 00:15:43.676 Firmware Version: 24.01.1 00:15:43.676 Recommended Arb Burst: 6 00:15:43.676 IEEE OUI Identifier: 8d 6b 50 00:15:43.676 Multi-path I/O 00:15:43.676 May have multiple subsystem ports: Yes 00:15:43.676 May have multiple controllers: Yes 00:15:43.676 Associated with SR-IOV VF: No 00:15:43.676 Max Data Transfer Size: 131072 00:15:43.676 Max Number of Namespaces: 32 00:15:43.676 Max Number of I/O Queues: 127 00:15:43.676 NVMe Specification Version (VS): 1.3 00:15:43.676 NVMe Specification Version (Identify): 1.3 00:15:43.676 Maximum Queue Entries: 256 00:15:43.676 Contiguous Queues Required: Yes 00:15:43.676 Arbitration Mechanisms Supported 00:15:43.676 Weighted Round Robin: Not Supported 00:15:43.676 Vendor Specific: Not Supported 00:15:43.676 Reset Timeout: 15000 ms 00:15:43.676 Doorbell Stride: 4 bytes 00:15:43.676 NVM Subsystem Reset: Not Supported 00:15:43.676 Command Sets Supported 00:15:43.676 NVM Command Set: Supported 00:15:43.676 Boot Partition: Not Supported 00:15:43.676 Memory Page Size Minimum: 4096 bytes 00:15:43.676 Memory Page Size Maximum: 4096 bytes 00:15:43.676 Persistent Memory Region: Not Supported 00:15:43.676 Optional Asynchronous Events Supported 00:15:43.676 Namespace Attribute Notices: Supported 00:15:43.676 Firmware Activation Notices: Not Supported 00:15:43.676 ANA Change Notices: Not Supported 00:15:43.676 PLE Aggregate Log Change Notices: Not Supported 00:15:43.676 LBA Status Info Alert Notices: Not Supported 00:15:43.676 EGE Aggregate Log Change Notices: Not Supported 00:15:43.677 Normal NVM Subsystem Shutdown event: Not Supported 00:15:43.677 Zone Descriptor Change Notices: Not Supported 00:15:43.677 Discovery Log Change Notices: Not Supported 00:15:43.677 Controller Attributes 00:15:43.677 128-bit Host Identifier: Supported 00:15:43.677 Non-Operational Permissive Mode: Not Supported 00:15:43.677 NVM Sets: Not Supported 00:15:43.677 Read Recovery Levels: Not Supported 00:15:43.677 Endurance Groups: Not Supported 00:15:43.677 Predictable Latency Mode: Not Supported 00:15:43.677 Traffic Based Keep ALive: Not Supported 00:15:43.677 Namespace Granularity: Not Supported 00:15:43.677 SQ Associations: Not Supported 00:15:43.677 UUID List: Not Supported 00:15:43.677 Multi-Domain Subsystem: Not Supported 00:15:43.677 Fixed Capacity Management: Not Supported 00:15:43.677 Variable Capacity Management: Not Supported 00:15:43.677 Delete Endurance Group: Not Supported 00:15:43.677 Delete NVM Set: Not Supported 00:15:43.677 Extended LBA Formats Supported: Not Supported 00:15:43.677 Flexible Data Placement Supported: Not Supported 00:15:43.677 00:15:43.677 Controller Memory Buffer Support 00:15:43.677 ================================ 00:15:43.677 Supported: No 00:15:43.677 00:15:43.677 Persistent Memory Region Support 00:15:43.677 ================================ 00:15:43.677 Supported: No 00:15:43.677 00:15:43.677 Admin Command Set Attributes 00:15:43.677 ============================ 00:15:43.677 Security Send/Receive: Not Supported 00:15:43.677 Format NVM: Not Supported 00:15:43.677 Firmware Activate/Download: Not Supported 00:15:43.677 Namespace Management: Not Supported 00:15:43.677 Device Self-Test: Not Supported 00:15:43.677 Directives: Not Supported 00:15:43.677 NVMe-MI: Not Supported 00:15:43.677 Virtualization Management: Not Supported 00:15:43.677 Doorbell Buffer Config: Not Supported 00:15:43.677 Get LBA Status Capability: Not Supported 00:15:43.677 Command & Feature Lockdown Capability: Not Supported 00:15:43.677 Abort Command Limit: 4 00:15:43.677 Async Event Request Limit: 4 00:15:43.677 Number of Firmware Slots: N/A 00:15:43.677 Firmware Slot 1 Read-Only: N/A 00:15:43.677 Firmware Activation Without Reset: N/A 00:15:43.677 Multiple Update Detection Support: N/A 00:15:43.677 Firmware Update Granularity: No Information Provided 00:15:43.677 Per-Namespace SMART Log: No 00:15:43.677 Asymmetric Namespace Access Log Page: Not Supported 00:15:43.677 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:43.677 Command Effects Log Page: Supported 00:15:43.677 Get Log Page Extended Data: Supported 00:15:43.677 Telemetry Log Pages: Not Supported 00:15:43.677 Persistent Event Log Pages: Not Supported 00:15:43.677 Supported Log Pages Log Page: May Support 00:15:43.677 Commands Supported & Effects Log Page: Not Supported 00:15:43.677 Feature Identifiers & Effects Log Page:May Support 00:15:43.677 NVMe-MI Commands & Effects Log Page: May Support 00:15:43.677 Data Area 4 for Telemetry Log: Not Supported 00:15:43.677 Error Log Page Entries Supported: 128 00:15:43.677 Keep Alive: Supported 00:15:43.677 Keep Alive Granularity: 10000 ms 00:15:43.677 00:15:43.677 NVM Command Set Attributes 00:15:43.677 ========================== 00:15:43.677 Submission Queue Entry Size 00:15:43.677 Max: 64 00:15:43.677 Min: 64 00:15:43.677 Completion Queue Entry Size 00:15:43.677 Max: 16 00:15:43.677 Min: 16 00:15:43.677 Number of Namespaces: 32 00:15:43.677 Compare Command: Supported 00:15:43.677 Write Uncorrectable Command: Not Supported 00:15:43.677 Dataset Management Command: Supported 00:15:43.677 Write Zeroes Command: Supported 00:15:43.677 Set Features Save Field: Not Supported 00:15:43.677 Reservations: Not Supported 00:15:43.677 Timestamp: Not Supported 00:15:43.677 Copy: Supported 00:15:43.677 Volatile Write Cache: Present 00:15:43.677 Atomic Write Unit (Normal): 1 00:15:43.677 Atomic Write Unit (PFail): 1 00:15:43.677 Atomic Compare & Write Unit: 1 00:15:43.677 Fused Compare & Write: Supported 00:15:43.677 Scatter-Gather List 00:15:43.677 SGL Command Set: Supported (Dword aligned) 00:15:43.677 SGL Keyed: Not Supported 00:15:43.677 SGL Bit Bucket Descriptor: Not Supported 00:15:43.677 SGL Metadata Pointer: Not Supported 00:15:43.677 Oversized SGL: Not Supported 00:15:43.677 SGL Metadata Address: Not Supported 00:15:43.677 SGL Offset: Not Supported 00:15:43.677 Transport SGL Data Block: Not Supported 00:15:43.677 Replay Protected Memory Block: Not Supported 00:15:43.677 00:15:43.677 Firmware Slot Information 00:15:43.677 ========================= 00:15:43.677 Active slot: 1 00:15:43.677 Slot 1 Firmware Revision: 24.01.1 00:15:43.677 00:15:43.677 00:15:43.677 Commands Supported and Effects 00:15:43.677 ============================== 00:15:43.677 Admin Commands 00:15:43.677 -------------- 00:15:43.677 Get Log Page (02h): Supported 00:15:43.677 Identify (06h): Supported 00:15:43.677 Abort (08h): Supported 00:15:43.677 Set Features (09h): Supported 00:15:43.677 Get Features (0Ah): Supported 00:15:43.677 Asynchronous Event Request (0Ch): Supported 00:15:43.677 Keep Alive (18h): Supported 00:15:43.677 I/O Commands 00:15:43.677 ------------ 00:15:43.677 Flush (00h): Supported LBA-Change 00:15:43.677 Write (01h): Supported LBA-Change 00:15:43.677 Read (02h): Supported 00:15:43.677 Compare (05h): Supported 00:15:43.677 Write Zeroes (08h): Supported LBA-Change 00:15:43.677 Dataset Management (09h): Supported LBA-Change 00:15:43.677 Copy (19h): Supported LBA-Change 00:15:43.677 Unknown (79h): Supported LBA-Change 00:15:43.677 Unknown (7Ah): Supported 00:15:43.677 00:15:43.677 Error Log 00:15:43.677 ========= 00:15:43.677 00:15:43.677 Arbitration 00:15:43.677 =========== 00:15:43.677 Arbitration Burst: 1 00:15:43.677 00:15:43.677 Power Management 00:15:43.677 ================ 00:15:43.677 Number of Power States: 1 00:15:43.677 Current Power State: Power State #0 00:15:43.677 Power State #0: 00:15:43.677 Max Power: 0.00 W 00:15:43.677 Non-Operational State: Operational 00:15:43.677 Entry Latency: Not Reported 00:15:43.677 Exit Latency: Not Reported 00:15:43.677 Relative Read Throughput: 0 00:15:43.677 Relative Read Latency: 0 00:15:43.677 Relative Write Throughput: 0 00:15:43.677 Relative Write Latency: 0 00:15:43.677 Idle Power: Not Reported 00:15:43.677 Active Power: Not Reported 00:15:43.677 Non-Operational Permissive Mode: Not Supported 00:15:43.677 00:15:43.677 Health Information 00:15:43.677 ================== 00:15:43.677 Critical Warnings: 00:15:43.677 Available Spare Space: OK 00:15:43.677 Temperature: OK 00:15:43.677 Device Reliability: OK 00:15:43.677 Read Only: No 00:15:43.677 Volatile Memory Backup: OK 00:15:43.677 Current Temperature: 0 Kelvin[2024-11-27 17:08:40.606709] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:43.677 [2024-11-27 17:08:40.606726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:43.677 [2024-11-27 17:08:40.606769] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:43.677 [2024-11-27 17:08:40.606788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:43.677 [2024-11-27 17:08:40.606800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:43.677 [2024-11-27 17:08:40.606810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:43.677 [2024-11-27 17:08:40.606820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:43.677 [2024-11-27 17:08:40.609541] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:43.677 [2024-11-27 17:08:40.609566] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:43.677 [2024-11-27 17:08:40.610235] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:43.677 [2024-11-27 17:08:40.610248] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:43.677 [2024-11-27 17:08:40.611198] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:43.677 [2024-11-27 17:08:40.611221] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:43.677 [2024-11-27 17:08:40.611277] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:43.677 [2024-11-27 17:08:40.613242] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:43.935 (-273 Celsius) 00:15:43.935 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:43.935 Available Spare: 0% 00:15:43.935 Available Spare Threshold: 0% 00:15:43.935 Life Percentage Used: 0% 00:15:43.935 Data Units Read: 0 00:15:43.935 Data Units Written: 0 00:15:43.935 Host Read Commands: 0 00:15:43.935 Host Write Commands: 0 00:15:43.935 Controller Busy Time: 0 minutes 00:15:43.935 Power Cycles: 0 00:15:43.935 Power On Hours: 0 hours 00:15:43.935 Unsafe Shutdowns: 0 00:15:43.935 Unrecoverable Media Errors: 0 00:15:43.935 Lifetime Error Log Entries: 0 00:15:43.935 Warning Temperature Time: 0 minutes 00:15:43.935 Critical Temperature Time: 0 minutes 00:15:43.935 00:15:43.935 Number of Queues 00:15:43.935 ================ 00:15:43.935 Number of I/O Submission Queues: 127 00:15:43.935 Number of I/O Completion Queues: 127 00:15:43.935 00:15:43.935 Active Namespaces 00:15:43.935 ================= 00:15:43.935 Namespace ID:1 00:15:43.935 Error Recovery Timeout: Unlimited 00:15:43.935 Command Set Identifier: NVM (00h) 00:15:43.935 Deallocate: Supported 00:15:43.935 Deallocated/Unwritten Error: Not Supported 00:15:43.935 Deallocated Read Value: Unknown 00:15:43.935 Deallocate in Write Zeroes: Not Supported 00:15:43.935 Deallocated Guard Field: 0xFFFF 00:15:43.935 Flush: Supported 00:15:43.935 Reservation: Supported 00:15:43.935 Namespace Sharing Capabilities: Multiple Controllers 00:15:43.935 Size (in LBAs): 131072 (0GiB) 00:15:43.935 Capacity (in LBAs): 131072 (0GiB) 00:15:43.935 Utilization (in LBAs): 131072 (0GiB) 00:15:43.935 NGUID: EC1FD1A5CBF84417AF71C9B36828641F 00:15:43.935 UUID: ec1fd1a5-cbf8-4417-af71-c9b36828641f 00:15:43.935 Thin Provisioning: Not Supported 00:15:43.935 Per-NS Atomic Units: Yes 00:15:43.935 Atomic Boundary Size (Normal): 0 00:15:43.935 Atomic Boundary Size (PFail): 0 00:15:43.935 Atomic Boundary Offset: 0 00:15:43.935 Maximum Single Source Range Length: 65535 00:15:43.935 Maximum Copy Length: 65535 00:15:43.935 Maximum Source Range Count: 1 00:15:43.935 NGUID/EUI64 Never Reused: No 00:15:43.935 Namespace Write Protected: No 00:15:43.935 Number of LBA Formats: 1 00:15:43.935 Current LBA Format: LBA Format #00 00:15:43.935 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:43.935 00:15:43.935 17:08:40 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:43.935 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.228 Initializing NVMe Controllers 00:15:49.228 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:49.228 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:49.228 Initialization complete. Launching workers. 00:15:49.228 ======================================================== 00:15:49.228 Latency(us) 00:15:49.228 Device Information : IOPS MiB/s Average min max 00:15:49.228 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 38053.58 148.65 3364.29 1145.22 7394.47 00:15:49.228 ======================================================== 00:15:49.228 Total : 38053.58 148.65 3364.29 1145.22 7394.47 00:15:49.228 00:15:49.228 17:08:45 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:49.228 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.492 Initializing NVMe Controllers 00:15:54.492 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:54.492 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:54.492 Initialization complete. Launching workers. 00:15:54.492 ======================================================== 00:15:54.492 Latency(us) 00:15:54.492 Device Information : IOPS MiB/s Average min max 00:15:54.492 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16034.90 62.64 7987.82 6877.02 15958.72 00:15:54.492 ======================================================== 00:15:54.492 Total : 16034.90 62.64 7987.82 6877.02 15958.72 00:15:54.492 00:15:54.492 17:08:51 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:54.492 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.758 Initializing NVMe Controllers 00:15:59.758 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:59.758 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:59.758 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:59.758 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:59.758 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:59.758 Initialization complete. Launching workers. 00:15:59.758 Starting thread on core 2 00:15:59.758 Starting thread on core 3 00:15:59.758 Starting thread on core 1 00:15:59.758 17:08:56 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:59.758 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.041 Initializing NVMe Controllers 00:16:03.041 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:03.041 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:03.041 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:16:03.041 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:16:03.041 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:16:03.041 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:16:03.041 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:03.041 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:03.041 Initialization complete. Launching workers. 00:16:03.041 Starting thread on core 1 with urgent priority queue 00:16:03.041 Starting thread on core 2 with urgent priority queue 00:16:03.041 Starting thread on core 3 with urgent priority queue 00:16:03.041 Starting thread on core 0 with urgent priority queue 00:16:03.041 SPDK bdev Controller (SPDK1 ) core 0: 5302.67 IO/s 18.86 secs/100000 ios 00:16:03.041 SPDK bdev Controller (SPDK1 ) core 1: 5434.00 IO/s 18.40 secs/100000 ios 00:16:03.041 SPDK bdev Controller (SPDK1 ) core 2: 5267.00 IO/s 18.99 secs/100000 ios 00:16:03.041 SPDK bdev Controller (SPDK1 ) core 3: 5912.67 IO/s 16.91 secs/100000 ios 00:16:03.041 ======================================================== 00:16:03.041 00:16:03.041 17:08:59 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:03.041 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.299 Initializing NVMe Controllers 00:16:03.299 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:03.299 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:03.299 Namespace ID: 1 size: 0GB 00:16:03.299 Initialization complete. 00:16:03.299 INFO: using host memory buffer for IO 00:16:03.299 Hello world! 00:16:03.299 17:09:00 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:03.299 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.672 Initializing NVMe Controllers 00:16:04.672 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:04.672 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:04.672 Initialization complete. Launching workers. 00:16:04.672 submit (in ns) avg, min, max = 9416.6, 3454.4, 4018973.3 00:16:04.672 complete (in ns) avg, min, max = 26312.5, 2043.3, 4019768.9 00:16:04.672 00:16:04.672 Submit histogram 00:16:04.672 ================ 00:16:04.672 Range in us Cumulative Count 00:16:04.672 3.437 - 3.461: 0.0225% ( 3) 00:16:04.672 3.461 - 3.484: 1.0334% ( 135) 00:16:04.672 3.484 - 3.508: 2.9504% ( 256) 00:16:04.672 3.508 - 3.532: 7.5857% ( 619) 00:16:04.672 3.532 - 3.556: 15.1865% ( 1015) 00:16:04.672 3.556 - 3.579: 26.6287% ( 1528) 00:16:04.672 3.579 - 3.603: 35.4201% ( 1174) 00:16:04.672 3.603 - 3.627: 41.4707% ( 808) 00:16:04.672 3.627 - 3.650: 47.1394% ( 757) 00:16:04.672 3.650 - 3.674: 52.5610% ( 724) 00:16:04.672 3.674 - 3.698: 58.0201% ( 729) 00:16:04.672 3.698 - 3.721: 61.4273% ( 455) 00:16:04.672 3.721 - 3.745: 64.0183% ( 346) 00:16:04.672 3.745 - 3.769: 67.0810% ( 409) 00:16:04.672 3.769 - 3.793: 71.3644% ( 572) 00:16:04.672 3.793 - 3.816: 75.6253% ( 569) 00:16:04.672 3.816 - 3.840: 79.7439% ( 550) 00:16:04.672 3.840 - 3.864: 82.4472% ( 361) 00:16:04.672 3.864 - 3.887: 84.5814% ( 285) 00:16:04.672 3.887 - 3.911: 86.2363% ( 221) 00:16:04.672 3.911 - 3.935: 87.9811% ( 233) 00:16:04.672 3.935 - 3.959: 89.1942% ( 162) 00:16:04.672 3.959 - 3.982: 90.1677% ( 130) 00:16:04.672 3.982 - 4.006: 91.0813% ( 122) 00:16:04.672 4.006 - 4.030: 91.9874% ( 121) 00:16:04.672 4.030 - 4.053: 92.8636% ( 117) 00:16:04.672 4.053 - 4.077: 93.6424% ( 104) 00:16:04.672 4.077 - 4.101: 94.2190% ( 77) 00:16:04.672 4.101 - 4.124: 94.4960% ( 37) 00:16:04.672 4.124 - 4.148: 94.7282% ( 31) 00:16:04.672 4.148 - 4.172: 94.9229% ( 26) 00:16:04.672 4.172 - 4.196: 95.0577% ( 18) 00:16:04.672 4.196 - 4.219: 95.1325% ( 10) 00:16:04.672 4.219 - 4.243: 95.2598% ( 17) 00:16:04.672 4.243 - 4.267: 95.3946% ( 18) 00:16:04.672 4.267 - 4.290: 95.5145% ( 16) 00:16:04.672 4.290 - 4.314: 95.5893% ( 10) 00:16:04.672 4.314 - 4.338: 95.7017% ( 15) 00:16:04.672 4.338 - 4.361: 95.7990% ( 13) 00:16:04.672 4.361 - 4.385: 95.8439% ( 6) 00:16:04.672 4.385 - 4.409: 95.8589% ( 2) 00:16:04.672 4.409 - 4.433: 95.8814% ( 3) 00:16:04.672 4.433 - 4.456: 95.8964% ( 2) 00:16:04.672 4.456 - 4.480: 95.9188% ( 3) 00:16:04.672 4.480 - 4.504: 95.9338% ( 2) 00:16:04.672 4.527 - 4.551: 95.9488% ( 2) 00:16:04.672 4.551 - 4.575: 95.9563% ( 1) 00:16:04.672 4.575 - 4.599: 95.9712% ( 2) 00:16:04.672 4.599 - 4.622: 95.9787% ( 1) 00:16:04.672 4.622 - 4.646: 95.9862% ( 1) 00:16:04.672 4.646 - 4.670: 96.0237% ( 5) 00:16:04.672 4.670 - 4.693: 96.0761% ( 7) 00:16:04.672 4.693 - 4.717: 96.0836% ( 1) 00:16:04.672 4.717 - 4.741: 96.1285% ( 6) 00:16:04.672 4.741 - 4.764: 96.1510% ( 3) 00:16:04.672 4.764 - 4.788: 96.2109% ( 8) 00:16:04.672 4.788 - 4.812: 96.2558% ( 6) 00:16:04.672 4.812 - 4.836: 96.3307% ( 10) 00:16:04.672 4.836 - 4.859: 96.3756% ( 6) 00:16:04.672 4.859 - 4.883: 96.4205% ( 6) 00:16:04.672 4.883 - 4.907: 96.4655% ( 6) 00:16:04.672 4.907 - 4.930: 96.4954% ( 4) 00:16:04.672 4.954 - 4.978: 96.5254% ( 4) 00:16:04.672 4.978 - 5.001: 96.5479% ( 3) 00:16:04.672 5.001 - 5.025: 96.5778% ( 4) 00:16:04.672 5.025 - 5.049: 96.6152% ( 5) 00:16:04.672 5.049 - 5.073: 96.6302% ( 2) 00:16:04.672 5.073 - 5.096: 96.6452% ( 2) 00:16:04.672 5.096 - 5.120: 96.6602% ( 2) 00:16:04.672 5.120 - 5.144: 96.6826% ( 3) 00:16:04.672 5.144 - 5.167: 96.7126% ( 4) 00:16:04.672 5.167 - 5.191: 96.7351% ( 3) 00:16:04.672 5.191 - 5.215: 96.7425% ( 1) 00:16:04.672 5.239 - 5.262: 96.7575% ( 2) 00:16:04.672 5.262 - 5.286: 96.7650% ( 1) 00:16:04.672 5.286 - 5.310: 96.7725% ( 1) 00:16:04.672 5.333 - 5.357: 96.7875% ( 2) 00:16:04.672 5.357 - 5.381: 96.7950% ( 1) 00:16:04.672 5.381 - 5.404: 96.8099% ( 2) 00:16:04.672 5.428 - 5.452: 96.8249% ( 2) 00:16:04.672 5.452 - 5.476: 96.8324% ( 1) 00:16:04.672 5.476 - 5.499: 96.8399% ( 1) 00:16:04.672 5.499 - 5.523: 96.8474% ( 1) 00:16:04.672 5.523 - 5.547: 96.8549% ( 1) 00:16:04.672 5.618 - 5.641: 96.8624% ( 1) 00:16:04.673 5.641 - 5.665: 96.8848% ( 3) 00:16:04.673 5.713 - 5.736: 96.8998% ( 2) 00:16:04.673 5.736 - 5.760: 96.9148% ( 2) 00:16:04.673 5.855 - 5.879: 96.9372% ( 3) 00:16:04.673 5.879 - 5.902: 96.9447% ( 1) 00:16:04.673 5.926 - 5.950: 96.9522% ( 1) 00:16:04.673 5.950 - 5.973: 96.9597% ( 1) 00:16:04.673 5.973 - 5.997: 96.9672% ( 1) 00:16:04.673 6.068 - 6.116: 96.9747% ( 1) 00:16:04.673 6.163 - 6.210: 96.9822% ( 1) 00:16:04.673 6.258 - 6.305: 97.0046% ( 3) 00:16:04.673 6.447 - 6.495: 97.0121% ( 1) 00:16:04.673 6.542 - 6.590: 97.0196% ( 1) 00:16:04.673 6.590 - 6.637: 97.0271% ( 1) 00:16:04.673 6.637 - 6.684: 97.0496% ( 3) 00:16:04.673 6.684 - 6.732: 97.0645% ( 2) 00:16:04.673 6.732 - 6.779: 97.0720% ( 1) 00:16:04.673 6.779 - 6.827: 97.0795% ( 1) 00:16:04.673 6.827 - 6.874: 97.1020% ( 3) 00:16:04.673 6.874 - 6.921: 97.1095% ( 1) 00:16:04.673 6.921 - 6.969: 97.1245% ( 2) 00:16:04.673 6.969 - 7.016: 97.1319% ( 1) 00:16:04.673 7.064 - 7.111: 97.1469% ( 2) 00:16:04.673 7.159 - 7.206: 97.1619% ( 2) 00:16:04.673 7.253 - 7.301: 97.1694% ( 1) 00:16:04.673 7.301 - 7.348: 97.1769% ( 1) 00:16:04.673 7.348 - 7.396: 97.1844% ( 1) 00:16:04.673 7.396 - 7.443: 97.1919% ( 1) 00:16:04.673 7.443 - 7.490: 97.2068% ( 2) 00:16:04.673 7.490 - 7.538: 97.2143% ( 1) 00:16:04.673 7.538 - 7.585: 97.2293% ( 2) 00:16:04.673 7.633 - 7.680: 97.2518% ( 3) 00:16:04.673 7.775 - 7.822: 97.2592% ( 1) 00:16:04.673 7.822 - 7.870: 97.2667% ( 1) 00:16:04.673 7.870 - 7.917: 97.2742% ( 1) 00:16:04.673 7.917 - 7.964: 97.2892% ( 2) 00:16:04.673 8.059 - 8.107: 97.3117% ( 3) 00:16:04.673 8.154 - 8.201: 97.3266% ( 2) 00:16:04.673 8.296 - 8.344: 97.3491% ( 3) 00:16:04.673 8.344 - 8.391: 97.3866% ( 5) 00:16:04.673 8.391 - 8.439: 97.4165% ( 4) 00:16:04.673 8.439 - 8.486: 97.4315% ( 2) 00:16:04.673 8.486 - 8.533: 97.4465% ( 2) 00:16:04.673 8.581 - 8.628: 97.4764% ( 4) 00:16:04.673 8.628 - 8.676: 97.4989% ( 3) 00:16:04.673 8.676 - 8.723: 97.5139% ( 2) 00:16:04.673 8.723 - 8.770: 97.5363% ( 3) 00:16:04.673 8.770 - 8.818: 97.5513% ( 2) 00:16:04.673 8.818 - 8.865: 97.5588% ( 1) 00:16:04.673 8.913 - 8.960: 97.5663% ( 1) 00:16:04.673 8.960 - 9.007: 97.5812% ( 2) 00:16:04.673 9.007 - 9.055: 97.6037% ( 3) 00:16:04.673 9.055 - 9.102: 97.6262% ( 3) 00:16:04.673 9.102 - 9.150: 97.6337% ( 1) 00:16:04.673 9.150 - 9.197: 97.6412% ( 1) 00:16:04.673 9.292 - 9.339: 97.6561% ( 2) 00:16:04.673 9.339 - 9.387: 97.6861% ( 4) 00:16:04.673 9.434 - 9.481: 97.7011% ( 2) 00:16:04.673 9.529 - 9.576: 97.7160% ( 2) 00:16:04.673 9.576 - 9.624: 97.7235% ( 1) 00:16:04.673 9.671 - 9.719: 97.7535% ( 4) 00:16:04.673 9.766 - 9.813: 97.7834% ( 4) 00:16:04.673 9.956 - 10.003: 97.8059% ( 3) 00:16:04.673 10.098 - 10.145: 97.8134% ( 1) 00:16:04.673 10.145 - 10.193: 97.8359% ( 3) 00:16:04.673 10.193 - 10.240: 97.8583% ( 3) 00:16:04.673 10.430 - 10.477: 97.8733% ( 2) 00:16:04.673 10.477 - 10.524: 97.8808% ( 1) 00:16:04.673 10.524 - 10.572: 97.8883% ( 1) 00:16:04.673 10.572 - 10.619: 97.9182% ( 4) 00:16:04.673 10.619 - 10.667: 97.9332% ( 2) 00:16:04.673 10.667 - 10.714: 97.9407% ( 1) 00:16:04.673 10.761 - 10.809: 97.9482% ( 1) 00:16:04.673 10.999 - 11.046: 97.9632% ( 2) 00:16:04.673 11.046 - 11.093: 97.9706% ( 1) 00:16:04.673 11.093 - 11.141: 97.9856% ( 2) 00:16:04.673 11.141 - 11.188: 97.9931% ( 1) 00:16:04.673 11.188 - 11.236: 98.0006% ( 1) 00:16:04.673 11.236 - 11.283: 98.0156% ( 2) 00:16:04.673 11.330 - 11.378: 98.0231% ( 1) 00:16:04.673 11.473 - 11.520: 98.0380% ( 2) 00:16:04.673 11.520 - 11.567: 98.0455% ( 1) 00:16:04.673 11.567 - 11.615: 98.0680% ( 3) 00:16:04.673 11.615 - 11.662: 98.0830% ( 2) 00:16:04.673 11.710 - 11.757: 98.0905% ( 1) 00:16:04.673 11.757 - 11.804: 98.1054% ( 2) 00:16:04.673 11.804 - 11.852: 98.1279% ( 3) 00:16:04.673 11.852 - 11.899: 98.1429% ( 2) 00:16:04.673 11.899 - 11.947: 98.1579% ( 2) 00:16:04.673 11.947 - 11.994: 98.1728% ( 2) 00:16:04.673 11.994 - 12.041: 98.1878% ( 2) 00:16:04.673 12.231 - 12.326: 98.1953% ( 1) 00:16:04.673 12.326 - 12.421: 98.2103% ( 2) 00:16:04.673 12.421 - 12.516: 98.2327% ( 3) 00:16:04.673 12.516 - 12.610: 98.2627% ( 4) 00:16:04.673 12.610 - 12.705: 98.2777% ( 2) 00:16:04.673 12.705 - 12.800: 98.3076% ( 4) 00:16:04.673 12.800 - 12.895: 98.3151% ( 1) 00:16:04.673 12.895 - 12.990: 98.3226% ( 1) 00:16:04.673 12.990 - 13.084: 98.3451% ( 3) 00:16:04.673 13.084 - 13.179: 98.3526% ( 1) 00:16:04.673 13.179 - 13.274: 98.3750% ( 3) 00:16:04.673 13.274 - 13.369: 98.3825% ( 1) 00:16:04.673 13.369 - 13.464: 98.4050% ( 3) 00:16:04.673 13.559 - 13.653: 98.4274% ( 3) 00:16:04.673 13.748 - 13.843: 98.4499% ( 3) 00:16:04.673 13.843 - 13.938: 98.4574% ( 1) 00:16:04.673 13.938 - 14.033: 98.4799% ( 3) 00:16:04.673 14.033 - 14.127: 98.4948% ( 2) 00:16:04.673 14.127 - 14.222: 98.5248% ( 4) 00:16:04.673 14.222 - 14.317: 98.5323% ( 1) 00:16:04.673 14.317 - 14.412: 98.5398% ( 1) 00:16:04.673 14.412 - 14.507: 98.5622% ( 3) 00:16:04.673 14.507 - 14.601: 98.5697% ( 1) 00:16:04.673 14.601 - 14.696: 98.5847% ( 2) 00:16:04.673 14.696 - 14.791: 98.6072% ( 3) 00:16:04.673 14.791 - 14.886: 98.6146% ( 1) 00:16:04.673 14.886 - 14.981: 98.6446% ( 4) 00:16:04.673 14.981 - 15.076: 98.6596% ( 2) 00:16:04.673 15.076 - 15.170: 98.6671% ( 1) 00:16:04.673 15.265 - 15.360: 98.6746% ( 1) 00:16:04.673 15.360 - 15.455: 98.6820% ( 1) 00:16:04.673 15.455 - 15.550: 98.6895% ( 1) 00:16:04.673 15.550 - 15.644: 98.7045% ( 2) 00:16:04.673 16.213 - 16.308: 98.7120% ( 1) 00:16:04.673 17.161 - 17.256: 98.7270% ( 2) 00:16:04.673 17.351 - 17.446: 98.7494% ( 3) 00:16:04.673 17.446 - 17.541: 98.7869% ( 5) 00:16:04.673 17.541 - 17.636: 98.8093% ( 3) 00:16:04.673 17.636 - 17.730: 98.8468% ( 5) 00:16:04.673 17.730 - 17.825: 98.9142% ( 9) 00:16:04.673 17.825 - 17.920: 98.9292% ( 2) 00:16:04.673 17.920 - 18.015: 98.9741% ( 6) 00:16:04.673 18.015 - 18.110: 99.0265% ( 7) 00:16:04.673 18.110 - 18.204: 99.0714% ( 6) 00:16:04.673 18.204 - 18.299: 99.1538% ( 11) 00:16:04.673 18.299 - 18.394: 99.2512% ( 13) 00:16:04.673 18.394 - 18.489: 99.3036% ( 7) 00:16:04.673 18.489 - 18.584: 99.3635% ( 8) 00:16:04.673 18.584 - 18.679: 99.4159% ( 7) 00:16:04.673 18.679 - 18.773: 99.4459% ( 4) 00:16:04.673 18.773 - 18.868: 99.4908% ( 6) 00:16:04.673 18.868 - 18.963: 99.5282% ( 5) 00:16:04.673 18.963 - 19.058: 99.5357% ( 1) 00:16:04.673 19.058 - 19.153: 99.5432% ( 1) 00:16:04.673 19.153 - 19.247: 99.5507% ( 1) 00:16:04.673 19.247 - 19.342: 99.5881% ( 5) 00:16:04.673 19.342 - 19.437: 99.6031% ( 2) 00:16:04.673 19.437 - 19.532: 99.6106% ( 1) 00:16:04.673 19.627 - 19.721: 99.6181% ( 1) 00:16:04.673 20.954 - 21.049: 99.6256% ( 1) 00:16:04.673 21.239 - 21.333: 99.6331% ( 1) 00:16:04.673 21.807 - 21.902: 99.6406% ( 1) 00:16:04.673 22.661 - 22.756: 99.6480% ( 1) 00:16:04.673 23.893 - 23.988: 99.6555% ( 1) 00:16:04.673 24.083 - 24.178: 99.6630% ( 1) 00:16:04.673 24.273 - 24.462: 99.6705% ( 1) 00:16:04.673 24.462 - 24.652: 99.6855% ( 2) 00:16:04.673 24.841 - 25.031: 99.7005% ( 2) 00:16:04.673 25.221 - 25.410: 99.7080% ( 1) 00:16:04.673 26.359 - 26.548: 99.7154% ( 1) 00:16:04.673 26.548 - 26.738: 99.7229% ( 1) 00:16:04.673 27.117 - 27.307: 99.7304% ( 1) 00:16:04.673 27.307 - 27.496: 99.7529% ( 3) 00:16:04.673 27.686 - 27.876: 99.7604% ( 1) 00:16:04.673 27.876 - 28.065: 99.7753% ( 2) 00:16:04.673 28.065 - 28.255: 99.7828% ( 1) 00:16:04.673 28.255 - 28.444: 99.7903% ( 1) 00:16:04.673 28.444 - 28.634: 99.8053% ( 2) 00:16:04.673 28.634 - 28.824: 99.8128% ( 1) 00:16:04.673 29.203 - 29.393: 99.8203% ( 1) 00:16:04.673 30.151 - 30.341: 99.8278% ( 1) 00:16:04.673 30.720 - 30.910: 99.8353% ( 1) 00:16:04.673 31.858 - 32.047: 99.8427% ( 1) 00:16:04.673 32.806 - 32.996: 99.8502% ( 1) 00:16:04.673 34.133 - 34.323: 99.8577% ( 1) 00:16:04.673 34.513 - 34.702: 99.8652% ( 1) 00:16:04.673 3980.705 - 4004.978: 99.9476% ( 11) 00:16:04.673 4004.978 - 4029.250: 100.0000% ( 7) 00:16:04.673 00:16:04.673 Complete histogram 00:16:04.673 ================== 00:16:04.673 Range in us Cumulative Count 00:16:04.673 2.039 - 2.050: 0.7713% ( 103) 00:16:04.673 2.050 - 2.062: 8.6940% ( 1058) 00:16:04.673 2.062 - 2.074: 13.3892% ( 627) 00:16:04.673 2.074 - 2.086: 21.7163% ( 1112) 00:16:04.673 2.086 - 2.098: 47.4914% ( 3442) 00:16:04.673 2.098 - 2.110: 55.6313% ( 1087) 00:16:04.673 2.110 - 2.121: 57.7355% ( 281) 00:16:04.673 2.121 - 2.133: 60.6635% ( 391) 00:16:04.673 2.133 - 2.145: 61.8691% ( 161) 00:16:04.673 2.145 - 2.157: 67.3806% ( 736) 00:16:04.673 2.157 - 2.169: 77.3102% ( 1326) 00:16:04.673 2.169 - 2.181: 80.2007% ( 386) 00:16:04.673 2.181 - 2.193: 82.4697% ( 303) 00:16:04.673 2.193 - 2.204: 84.1695% ( 227) 00:16:04.673 2.204 - 2.216: 85.2703% ( 147) 00:16:04.673 2.216 - 2.228: 88.3406% ( 410) 00:16:04.673 2.228 - 2.240: 92.0473% ( 495) 00:16:04.673 2.240 - 2.252: 93.3578% ( 175) 00:16:04.673 2.252 - 2.264: 94.0767% ( 96) 00:16:04.673 2.264 - 2.276: 94.3837% ( 41) 00:16:04.673 2.276 - 2.287: 94.7357% ( 47) 00:16:04.673 2.287 - 2.299: 95.1101% ( 50) 00:16:04.673 2.299 - 2.311: 95.2598% ( 20) 00:16:04.673 2.311 - 2.323: 95.3497% ( 12) 00:16:04.673 2.323 - 2.335: 95.5893% ( 32) 00:16:04.673 2.335 - 2.347: 95.8514% ( 35) 00:16:04.673 2.347 - 2.359: 96.0985% ( 33) 00:16:04.673 2.359 - 2.370: 96.6003% ( 67) 00:16:04.673 2.370 - 2.382: 96.9148% ( 42) 00:16:04.673 2.382 - 2.394: 97.2368% ( 43) 00:16:04.673 2.394 - 2.406: 97.4914% ( 34) 00:16:04.673 2.406 - 2.418: 97.6936% ( 27) 00:16:04.673 2.418 - 2.430: 97.8658% ( 23) 00:16:04.673 2.430 - 2.441: 98.0156% ( 20) 00:16:04.673 2.441 - 2.453: 98.1653% ( 20) 00:16:04.673 2.453 - 2.465: 98.2028% ( 5) 00:16:04.673 2.465 - 2.477: 98.2327% ( 4) 00:16:04.673 2.477 - 2.489: 98.2777% ( 6) 00:16:04.673 2.489 - 2.501: 98.3151% ( 5) 00:16:04.673 2.501 - 2.513: 98.3600% ( 6) 00:16:04.673 2.513 - 2.524: 98.3675% ( 1) 00:16:04.673 2.536 - 2.548: 98.3750% ( 1) 00:16:04.673 2.548 - 2.560: 98.3900% ( 2) 00:16:04.673 2.560 - 2.572: 98.3975% ( 1) 00:16:04.673 2.643 - 2.655: 98.4050% ( 1) 00:16:04.673 3.247 - 3.271: 98.4199% ( 2) 00:16:04.673 3.271 - 3.295: 98.4274% ( 1) 00:16:04.673 3.295 - 3.319: 98.4349% ( 1) 00:16:04.673 3.319 - 3.342: 98.4424% ( 1) 00:16:04.673 3.342 - 3.366: 98.4574% ( 2) 00:16:04.673 3.366 - 3.390: 98.4799% ( 3) 00:16:04.673 3.437 - 3.461: 98.4948% ( 2) 00:16:04.673 3.532 - 3.556: 98.5098% ( 2) 00:16:04.673 3.579 - 3.603: 98.5173% ( 1) 00:16:04.673 3.603 - 3.627: 98.5248% ( 1) 00:16:04.673 3.650 - 3.674: 98.5323% ( 1) 00:16:04.673 3.674 - 3.698: 98.5398% ( 1) 00:16:04.673 3.769 - 3.793: 98.5473% ( 1) 00:16:04.673 3.793 - 3.816: 98.5622% ( 2) 00:16:04.673 3.864 - 3.887: 98.5697% ( 1) 00:16:04.673 5.997 - 6.021: 98.5772% ( 1) 00:16:04.673 6.116 - 6.163: 98.5847% ( 1) 00:16:04.673 6.400 - 6.447: 98.5922% ( 1) 00:16:04.673 6.637 - 6.684: 98.5997% ( 1) 00:16:04.673 6.732 - 6.779: 98.6072% ( 1) 00:16:04.673 6.921 - 6.969: 98.6146% ( 1) 00:16:04.673 7.064 - 7.111: 98.6221% ( 1) 00:16:04.673 7.159 - 7.206: 98.6371% ( 2) 00:16:04.673 7.206 - 7.253: 98.6446% ( 1) 00:16:04.673 7.253 - 7.301: 98.6521% ( 1) 00:16:04.673 7.301 - 7.348: 98.6671% ( 2) 00:16:04.673 7.490 - 7.538: 98.6746% ( 1) 00:16:04.673 7.727 - 7.775: 98.6820% ( 1) 00:16:04.673 8.059 - 8.107: 98.6895% ( 1) 00:16:04.673 8.249 - 8.296: 98.6970% ( 1) 00:16:04.673 8.439 - 8.486: 98.7045% ( 1) 00:16:04.673 8.533 - 8.581: 98.7120% ( 1) 00:16:04.673 10.335 - 10.382: 98.7195% ( 1) 00:16:04.673 10.667 - 10.714: 98.7270% ( 1) 00:16:04.673 11.520 - 11.567: 98.7345% ( 1) 00:16:04.673 11.994 - 12.041: 98.7419% ( 1) 00:16:04.673 13.179 - 13.274: 98.7494% ( 1) 00:16:04.673 14.507 - 14.601: 98.7569% ( 1) 00:16:04.673 15.644 - 15.739: 98.7644% ( 1) 00:16:04.673 15.739 - 15.834: 98.7944% ( 4) 00:16:04.673 15.834 - 15.929: 98.8393% ( 6) 00:16:04.673 15.929 - 16.024: 98.8618% ( 3) 00:16:04.673 16.024 - 16.119: 98.9067% ( 6) 00:16:04.673 16.119 - 16.213: 98.9516% ( 6) 00:16:04.673 16.213 - 16.308: 99.0040% ( 7) 00:16:04.673 16.308 - 16.403: 99.0714% ( 9) 00:16:04.673 16.403 - 16.498: 99.0864% ( 2) 00:16:04.673 16.498 - 16.593: 99.1089% ( 3) 00:16:04.673 16.593 - 16.687: 99.1613% ( 7) 00:16:04.673 16.687 - 16.782: 99.2062% ( 6) 00:16:04.673 16.782 - 16.877: 99.2736% ( 9) 00:16:04.673 16.877 - 16.972: 99.3036% ( 4) 00:16:04.673 16.972 - 17.067: 99.3111% ( 1) 00:16:04.673 17.067 - 17.161: 99.3260% ( 2) 00:16:04.673 17.256 - 17.351: 99.3335% ( 1) 00:16:04.673 17.351 - 17.446: 99.3485% ( 2) 00:16:04.673 17.730 - 17.825: 99.3560% ( 1) 00:16:04.673 17.825 - 17.920: 99.3635% ( 1) 00:16:04.673 18.110 - 18.204: 99.3710% ( 1) 00:16:04.673 18.204 - 18.299: 99.3860% ( 2) 00:16:04.673 67.887 - 68.267: 99.3934% ( 1) 00:16:04.673 3009.801 - 3021.938: 99.4009% ( 1) 00:16:04.673 3046.210 - 3058.347: 99.4084% ( 1) 00:16:04.673 3325.345 - 3349.618: 99.4159% ( 1) 00:16:04.673 3907.887 - 3932.160: 99.4234% ( 1) 00:16:04.673 3956.433 - 3980.705: 99.4309% ( 1) 00:16:04.673 3980.705 - 4004.978: 99.8353% ( 54) 00:16:04.673 4004.978 - 4029.250: 100.0000% ( 22) 00:16:04.673 00:16:04.673 17:09:01 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:04.673 17:09:01 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:04.673 17:09:01 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:04.673 17:09:01 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:04.673 17:09:01 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:04.932 [2024-11-27 17:09:01.715558] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:04.932 [ 00:16:04.932 { 00:16:04.932 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:04.932 "subtype": "Discovery", 00:16:04.932 "listen_addresses": [], 00:16:04.932 "allow_any_host": true, 00:16:04.932 "hosts": [] 00:16:04.932 }, 00:16:04.932 { 00:16:04.932 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:04.932 "subtype": "NVMe", 00:16:04.932 "listen_addresses": [ 00:16:04.932 { 00:16:04.932 "transport": "VFIOUSER", 00:16:04.932 "trtype": "VFIOUSER", 00:16:04.932 "adrfam": "IPv4", 00:16:04.932 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:04.932 "trsvcid": "0" 00:16:04.932 } 00:16:04.932 ], 00:16:04.932 "allow_any_host": true, 00:16:04.932 "hosts": [], 00:16:04.932 "serial_number": "SPDK1", 00:16:04.932 "model_number": "SPDK bdev Controller", 00:16:04.932 "max_namespaces": 32, 00:16:04.932 "min_cntlid": 1, 00:16:04.932 "max_cntlid": 65519, 00:16:04.932 "namespaces": [ 00:16:04.932 { 00:16:04.932 "nsid": 1, 00:16:04.932 "bdev_name": "Malloc1", 00:16:04.932 "name": "Malloc1", 00:16:04.932 "nguid": "EC1FD1A5CBF84417AF71C9B36828641F", 00:16:04.932 "uuid": "ec1fd1a5-cbf8-4417-af71-c9b36828641f" 00:16:04.932 } 00:16:04.932 ] 00:16:04.932 }, 00:16:04.932 { 00:16:04.932 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:04.932 "subtype": "NVMe", 00:16:04.932 "listen_addresses": [ 00:16:04.932 { 00:16:04.932 "transport": "VFIOUSER", 00:16:04.932 "trtype": "VFIOUSER", 00:16:04.932 "adrfam": "IPv4", 00:16:04.932 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:04.932 "trsvcid": "0" 00:16:04.932 } 00:16:04.932 ], 00:16:04.932 "allow_any_host": true, 00:16:04.932 "hosts": [], 00:16:04.932 "serial_number": "SPDK2", 00:16:04.932 "model_number": "SPDK bdev Controller", 00:16:04.932 "max_namespaces": 32, 00:16:04.932 "min_cntlid": 1, 00:16:04.932 "max_cntlid": 65519, 00:16:04.932 "namespaces": [ 00:16:04.932 { 00:16:04.932 "nsid": 1, 00:16:04.932 "bdev_name": "Malloc2", 00:16:04.932 "name": "Malloc2", 00:16:04.932 "nguid": "6A2D398ED73B4FF9BE1D23FE4E4ACD13", 00:16:04.932 "uuid": "6a2d398e-d73b-4ff9-be1d-23fe4e4acd13" 00:16:04.932 } 00:16:04.932 ] 00:16:04.932 } 00:16:04.932 ] 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1718773 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:04.932 17:09:01 -- common/autotest_common.sh@1254 -- # local i=0 00:16:04.932 17:09:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:04.932 17:09:01 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:04.932 17:09:01 -- common/autotest_common.sh@1265 -- # return 0 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:04.932 17:09:01 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:04.932 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.191 Malloc3 00:16:05.191 17:09:02 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:05.449 17:09:02 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:05.449 Asynchronous Event Request test 00:16:05.449 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:05.449 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:05.449 Registering asynchronous event callbacks... 00:16:05.449 Starting namespace attribute notice tests for all controllers... 00:16:05.449 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:05.449 aer_cb - Changed Namespace 00:16:05.449 Cleaning up... 00:16:05.708 [ 00:16:05.708 { 00:16:05.708 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:05.708 "subtype": "Discovery", 00:16:05.708 "listen_addresses": [], 00:16:05.708 "allow_any_host": true, 00:16:05.708 "hosts": [] 00:16:05.708 }, 00:16:05.708 { 00:16:05.708 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:05.708 "subtype": "NVMe", 00:16:05.708 "listen_addresses": [ 00:16:05.708 { 00:16:05.708 "transport": "VFIOUSER", 00:16:05.708 "trtype": "VFIOUSER", 00:16:05.708 "adrfam": "IPv4", 00:16:05.708 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:05.708 "trsvcid": "0" 00:16:05.708 } 00:16:05.708 ], 00:16:05.708 "allow_any_host": true, 00:16:05.708 "hosts": [], 00:16:05.708 "serial_number": "SPDK1", 00:16:05.708 "model_number": "SPDK bdev Controller", 00:16:05.708 "max_namespaces": 32, 00:16:05.708 "min_cntlid": 1, 00:16:05.708 "max_cntlid": 65519, 00:16:05.708 "namespaces": [ 00:16:05.708 { 00:16:05.708 "nsid": 1, 00:16:05.708 "bdev_name": "Malloc1", 00:16:05.708 "name": "Malloc1", 00:16:05.708 "nguid": "EC1FD1A5CBF84417AF71C9B36828641F", 00:16:05.708 "uuid": "ec1fd1a5-cbf8-4417-af71-c9b36828641f" 00:16:05.708 }, 00:16:05.708 { 00:16:05.708 "nsid": 2, 00:16:05.708 "bdev_name": "Malloc3", 00:16:05.708 "name": "Malloc3", 00:16:05.708 "nguid": "7FA1DF5AE810481BBD498E93777322F4", 00:16:05.708 "uuid": "7fa1df5a-e810-481b-bd49-8e93777322f4" 00:16:05.708 } 00:16:05.708 ] 00:16:05.708 }, 00:16:05.708 { 00:16:05.708 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:05.708 "subtype": "NVMe", 00:16:05.708 "listen_addresses": [ 00:16:05.708 { 00:16:05.708 "transport": "VFIOUSER", 00:16:05.708 "trtype": "VFIOUSER", 00:16:05.708 "adrfam": "IPv4", 00:16:05.708 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:05.708 "trsvcid": "0" 00:16:05.708 } 00:16:05.708 ], 00:16:05.708 "allow_any_host": true, 00:16:05.708 "hosts": [], 00:16:05.708 "serial_number": "SPDK2", 00:16:05.708 "model_number": "SPDK bdev Controller", 00:16:05.708 "max_namespaces": 32, 00:16:05.708 "min_cntlid": 1, 00:16:05.708 "max_cntlid": 65519, 00:16:05.708 "namespaces": [ 00:16:05.708 { 00:16:05.708 "nsid": 1, 00:16:05.708 "bdev_name": "Malloc2", 00:16:05.708 "name": "Malloc2", 00:16:05.708 "nguid": "6A2D398ED73B4FF9BE1D23FE4E4ACD13", 00:16:05.708 "uuid": "6a2d398e-d73b-4ff9-be1d-23fe4e4acd13" 00:16:05.708 } 00:16:05.708 ] 00:16:05.708 } 00:16:05.708 ] 00:16:05.708 17:09:02 -- target/nvmf_vfio_user.sh@44 -- # wait 1718773 00:16:05.708 17:09:02 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:05.708 17:09:02 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:05.708 17:09:02 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:05.708 17:09:02 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:05.708 [2024-11-27 17:09:02.558014] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:05.708 [2024-11-27 17:09:02.558055] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1718870 ] 00:16:05.708 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.708 [2024-11-27 17:09:02.589110] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:05.708 [2024-11-27 17:09:02.601868] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:05.708 [2024-11-27 17:09:02.601895] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f85e4d41000 00:16:05.708 [2024-11-27 17:09:02.602866] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.603856] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.604856] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.605863] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.606865] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.607876] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.608884] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:05.708 [2024-11-27 17:09:02.609889] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:05.709 [2024-11-27 17:09:02.610918] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:05.709 [2024-11-27 17:09:02.610939] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f85e3a3b000 00:16:05.709 [2024-11-27 17:09:02.612055] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:05.709 [2024-11-27 17:09:02.626751] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:05.709 [2024-11-27 17:09:02.626784] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:05.709 [2024-11-27 17:09:02.628889] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:05.709 [2024-11-27 17:09:02.628939] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:05.709 [2024-11-27 17:09:02.629026] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:05.709 [2024-11-27 17:09:02.629055] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:05.709 [2024-11-27 17:09:02.629065] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:05.709 [2024-11-27 17:09:02.629894] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:05.709 [2024-11-27 17:09:02.629914] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:05.709 [2024-11-27 17:09:02.629926] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:05.709 [2024-11-27 17:09:02.630901] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:05.709 [2024-11-27 17:09:02.630921] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:05.709 [2024-11-27 17:09:02.630934] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.631906] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:05.709 [2024-11-27 17:09:02.631926] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.632915] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:05.709 [2024-11-27 17:09:02.632934] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:05.709 [2024-11-27 17:09:02.632943] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.632954] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.633068] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:05.709 [2024-11-27 17:09:02.633076] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.633084] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:05.709 [2024-11-27 17:09:02.633923] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:05.709 [2024-11-27 17:09:02.634933] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:05.709 [2024-11-27 17:09:02.635941] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:05.709 [2024-11-27 17:09:02.636964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:05.709 [2024-11-27 17:09:02.637948] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:05.709 [2024-11-27 17:09:02.637967] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:05.709 [2024-11-27 17:09:02.637976] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.637999] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:05.709 [2024-11-27 17:09:02.638016] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.638036] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:05.709 [2024-11-27 17:09:02.638045] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:05.709 [2024-11-27 17:09:02.638065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:05.709 [2024-11-27 17:09:02.644541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:05.709 [2024-11-27 17:09:02.644565] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:05.709 [2024-11-27 17:09:02.644574] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:05.709 [2024-11-27 17:09:02.644581] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:05.709 [2024-11-27 17:09:02.644588] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:05.709 [2024-11-27 17:09:02.644596] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:05.709 [2024-11-27 17:09:02.644603] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:05.709 [2024-11-27 17:09:02.644611] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.644628] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.644645] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:05.709 [2024-11-27 17:09:02.652535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:05.709 [2024-11-27 17:09:02.652563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:05.709 [2024-11-27 17:09:02.652578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:05.709 [2024-11-27 17:09:02.652590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:05.709 [2024-11-27 17:09:02.652601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:05.709 [2024-11-27 17:09:02.652610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.652626] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:05.709 [2024-11-27 17:09:02.652641] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:05.968 [2024-11-27 17:09:02.660554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:05.968 [2024-11-27 17:09:02.660573] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:05.968 [2024-11-27 17:09:02.660582] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.660609] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.660624] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.660640] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:05.968 [2024-11-27 17:09:02.668539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:05.968 [2024-11-27 17:09:02.668610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.668626] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.668639] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:05.968 [2024-11-27 17:09:02.668647] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:05.968 [2024-11-27 17:09:02.668657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:05.968 [2024-11-27 17:09:02.676535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:05.968 [2024-11-27 17:09:02.676563] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:05.968 [2024-11-27 17:09:02.676580] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.676594] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:05.968 [2024-11-27 17:09:02.676607] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:05.968 [2024-11-27 17:09:02.676618] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:05.968 [2024-11-27 17:09:02.676629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.684537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.684566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.684582] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.684595] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:05.969 [2024-11-27 17:09:02.684603] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:05.969 [2024-11-27 17:09:02.684613] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.692538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.692559] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692571] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692586] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692597] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692605] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692613] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:05.969 [2024-11-27 17:09:02.692620] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:05.969 [2024-11-27 17:09:02.692628] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:05.969 [2024-11-27 17:09:02.692652] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.700538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.700564] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.708538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.708563] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.716537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.716562] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.724535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.724565] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:05.969 [2024-11-27 17:09:02.724576] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:05.969 [2024-11-27 17:09:02.724582] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:05.969 [2024-11-27 17:09:02.724588] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:05.969 [2024-11-27 17:09:02.724597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:05.969 [2024-11-27 17:09:02.724609] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:05.969 [2024-11-27 17:09:02.724616] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:05.969 [2024-11-27 17:09:02.724625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.724636] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:05.969 [2024-11-27 17:09:02.724643] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:05.969 [2024-11-27 17:09:02.724652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.724664] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:05.969 [2024-11-27 17:09:02.724671] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:05.969 [2024-11-27 17:09:02.724680] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:05.969 [2024-11-27 17:09:02.732553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.732581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.732597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:05.969 [2024-11-27 17:09:02.732609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:05.969 ===================================================== 00:16:05.969 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:05.969 ===================================================== 00:16:05.969 Controller Capabilities/Features 00:16:05.969 ================================ 00:16:05.969 Vendor ID: 4e58 00:16:05.969 Subsystem Vendor ID: 4e58 00:16:05.969 Serial Number: SPDK2 00:16:05.969 Model Number: SPDK bdev Controller 00:16:05.969 Firmware Version: 24.01.1 00:16:05.969 Recommended Arb Burst: 6 00:16:05.969 IEEE OUI Identifier: 8d 6b 50 00:16:05.969 Multi-path I/O 00:16:05.969 May have multiple subsystem ports: Yes 00:16:05.969 May have multiple controllers: Yes 00:16:05.969 Associated with SR-IOV VF: No 00:16:05.969 Max Data Transfer Size: 131072 00:16:05.969 Max Number of Namespaces: 32 00:16:05.969 Max Number of I/O Queues: 127 00:16:05.969 NVMe Specification Version (VS): 1.3 00:16:05.969 NVMe Specification Version (Identify): 1.3 00:16:05.969 Maximum Queue Entries: 256 00:16:05.969 Contiguous Queues Required: Yes 00:16:05.969 Arbitration Mechanisms Supported 00:16:05.969 Weighted Round Robin: Not Supported 00:16:05.969 Vendor Specific: Not Supported 00:16:05.969 Reset Timeout: 15000 ms 00:16:05.969 Doorbell Stride: 4 bytes 00:16:05.969 NVM Subsystem Reset: Not Supported 00:16:05.969 Command Sets Supported 00:16:05.969 NVM Command Set: Supported 00:16:05.969 Boot Partition: Not Supported 00:16:05.969 Memory Page Size Minimum: 4096 bytes 00:16:05.969 Memory Page Size Maximum: 4096 bytes 00:16:05.969 Persistent Memory Region: Not Supported 00:16:05.969 Optional Asynchronous Events Supported 00:16:05.969 Namespace Attribute Notices: Supported 00:16:05.969 Firmware Activation Notices: Not Supported 00:16:05.969 ANA Change Notices: Not Supported 00:16:05.969 PLE Aggregate Log Change Notices: Not Supported 00:16:05.969 LBA Status Info Alert Notices: Not Supported 00:16:05.969 EGE Aggregate Log Change Notices: Not Supported 00:16:05.969 Normal NVM Subsystem Shutdown event: Not Supported 00:16:05.969 Zone Descriptor Change Notices: Not Supported 00:16:05.969 Discovery Log Change Notices: Not Supported 00:16:05.969 Controller Attributes 00:16:05.969 128-bit Host Identifier: Supported 00:16:05.969 Non-Operational Permissive Mode: Not Supported 00:16:05.969 NVM Sets: Not Supported 00:16:05.969 Read Recovery Levels: Not Supported 00:16:05.969 Endurance Groups: Not Supported 00:16:05.969 Predictable Latency Mode: Not Supported 00:16:05.969 Traffic Based Keep ALive: Not Supported 00:16:05.969 Namespace Granularity: Not Supported 00:16:05.969 SQ Associations: Not Supported 00:16:05.969 UUID List: Not Supported 00:16:05.969 Multi-Domain Subsystem: Not Supported 00:16:05.969 Fixed Capacity Management: Not Supported 00:16:05.969 Variable Capacity Management: Not Supported 00:16:05.969 Delete Endurance Group: Not Supported 00:16:05.969 Delete NVM Set: Not Supported 00:16:05.969 Extended LBA Formats Supported: Not Supported 00:16:05.969 Flexible Data Placement Supported: Not Supported 00:16:05.969 00:16:05.969 Controller Memory Buffer Support 00:16:05.969 ================================ 00:16:05.969 Supported: No 00:16:05.969 00:16:05.969 Persistent Memory Region Support 00:16:05.969 ================================ 00:16:05.969 Supported: No 00:16:05.969 00:16:05.969 Admin Command Set Attributes 00:16:05.969 ============================ 00:16:05.969 Security Send/Receive: Not Supported 00:16:05.969 Format NVM: Not Supported 00:16:05.969 Firmware Activate/Download: Not Supported 00:16:05.969 Namespace Management: Not Supported 00:16:05.969 Device Self-Test: Not Supported 00:16:05.969 Directives: Not Supported 00:16:05.969 NVMe-MI: Not Supported 00:16:05.969 Virtualization Management: Not Supported 00:16:05.969 Doorbell Buffer Config: Not Supported 00:16:05.969 Get LBA Status Capability: Not Supported 00:16:05.969 Command & Feature Lockdown Capability: Not Supported 00:16:05.970 Abort Command Limit: 4 00:16:05.970 Async Event Request Limit: 4 00:16:05.970 Number of Firmware Slots: N/A 00:16:05.970 Firmware Slot 1 Read-Only: N/A 00:16:05.970 Firmware Activation Without Reset: N/A 00:16:05.970 Multiple Update Detection Support: N/A 00:16:05.970 Firmware Update Granularity: No Information Provided 00:16:05.970 Per-Namespace SMART Log: No 00:16:05.970 Asymmetric Namespace Access Log Page: Not Supported 00:16:05.970 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:05.970 Command Effects Log Page: Supported 00:16:05.970 Get Log Page Extended Data: Supported 00:16:05.970 Telemetry Log Pages: Not Supported 00:16:05.970 Persistent Event Log Pages: Not Supported 00:16:05.970 Supported Log Pages Log Page: May Support 00:16:05.970 Commands Supported & Effects Log Page: Not Supported 00:16:05.970 Feature Identifiers & Effects Log Page:May Support 00:16:05.970 NVMe-MI Commands & Effects Log Page: May Support 00:16:05.970 Data Area 4 for Telemetry Log: Not Supported 00:16:05.970 Error Log Page Entries Supported: 128 00:16:05.970 Keep Alive: Supported 00:16:05.970 Keep Alive Granularity: 10000 ms 00:16:05.970 00:16:05.970 NVM Command Set Attributes 00:16:05.970 ========================== 00:16:05.970 Submission Queue Entry Size 00:16:05.970 Max: 64 00:16:05.970 Min: 64 00:16:05.970 Completion Queue Entry Size 00:16:05.970 Max: 16 00:16:05.970 Min: 16 00:16:05.970 Number of Namespaces: 32 00:16:05.970 Compare Command: Supported 00:16:05.970 Write Uncorrectable Command: Not Supported 00:16:05.970 Dataset Management Command: Supported 00:16:05.970 Write Zeroes Command: Supported 00:16:05.970 Set Features Save Field: Not Supported 00:16:05.970 Reservations: Not Supported 00:16:05.970 Timestamp: Not Supported 00:16:05.970 Copy: Supported 00:16:05.970 Volatile Write Cache: Present 00:16:05.970 Atomic Write Unit (Normal): 1 00:16:05.970 Atomic Write Unit (PFail): 1 00:16:05.970 Atomic Compare & Write Unit: 1 00:16:05.970 Fused Compare & Write: Supported 00:16:05.970 Scatter-Gather List 00:16:05.970 SGL Command Set: Supported (Dword aligned) 00:16:05.970 SGL Keyed: Not Supported 00:16:05.970 SGL Bit Bucket Descriptor: Not Supported 00:16:05.970 SGL Metadata Pointer: Not Supported 00:16:05.970 Oversized SGL: Not Supported 00:16:05.970 SGL Metadata Address: Not Supported 00:16:05.970 SGL Offset: Not Supported 00:16:05.970 Transport SGL Data Block: Not Supported 00:16:05.970 Replay Protected Memory Block: Not Supported 00:16:05.970 00:16:05.970 Firmware Slot Information 00:16:05.970 ========================= 00:16:05.970 Active slot: 1 00:16:05.970 Slot 1 Firmware Revision: 24.01.1 00:16:05.970 00:16:05.970 00:16:05.970 Commands Supported and Effects 00:16:05.970 ============================== 00:16:05.970 Admin Commands 00:16:05.970 -------------- 00:16:05.970 Get Log Page (02h): Supported 00:16:05.970 Identify (06h): Supported 00:16:05.970 Abort (08h): Supported 00:16:05.970 Set Features (09h): Supported 00:16:05.970 Get Features (0Ah): Supported 00:16:05.970 Asynchronous Event Request (0Ch): Supported 00:16:05.970 Keep Alive (18h): Supported 00:16:05.970 I/O Commands 00:16:05.970 ------------ 00:16:05.970 Flush (00h): Supported LBA-Change 00:16:05.970 Write (01h): Supported LBA-Change 00:16:05.970 Read (02h): Supported 00:16:05.970 Compare (05h): Supported 00:16:05.970 Write Zeroes (08h): Supported LBA-Change 00:16:05.970 Dataset Management (09h): Supported LBA-Change 00:16:05.970 Copy (19h): Supported LBA-Change 00:16:05.970 Unknown (79h): Supported LBA-Change 00:16:05.970 Unknown (7Ah): Supported 00:16:05.970 00:16:05.970 Error Log 00:16:05.970 ========= 00:16:05.970 00:16:05.970 Arbitration 00:16:05.970 =========== 00:16:05.970 Arbitration Burst: 1 00:16:05.970 00:16:05.970 Power Management 00:16:05.970 ================ 00:16:05.970 Number of Power States: 1 00:16:05.970 Current Power State: Power State #0 00:16:05.970 Power State #0: 00:16:05.970 Max Power: 0.00 W 00:16:05.970 Non-Operational State: Operational 00:16:05.970 Entry Latency: Not Reported 00:16:05.970 Exit Latency: Not Reported 00:16:05.970 Relative Read Throughput: 0 00:16:05.970 Relative Read Latency: 0 00:16:05.970 Relative Write Throughput: 0 00:16:05.970 Relative Write Latency: 0 00:16:05.970 Idle Power: Not Reported 00:16:05.970 Active Power: Not Reported 00:16:05.970 Non-Operational Permissive Mode: Not Supported 00:16:05.970 00:16:05.970 Health Information 00:16:05.970 ================== 00:16:05.970 Critical Warnings: 00:16:05.970 Available Spare Space: OK 00:16:05.970 Temperature: OK 00:16:05.970 Device Reliability: OK 00:16:05.970 Read Only: No 00:16:05.970 Volatile Memory Backup: OK 00:16:05.970 Current Temperature: 0 Kelvin[2024-11-27 17:09:02.732735] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:05.970 [2024-11-27 17:09:02.740536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:05.970 [2024-11-27 17:09:02.740583] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:05.970 [2024-11-27 17:09:02.740601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:05.970 [2024-11-27 17:09:02.740611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:05.970 [2024-11-27 17:09:02.740621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:05.970 [2024-11-27 17:09:02.740631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:05.970 [2024-11-27 17:09:02.740713] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:05.970 [2024-11-27 17:09:02.740735] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:05.970 [2024-11-27 17:09:02.741757] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:05.970 [2024-11-27 17:09:02.741777] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:05.970 [2024-11-27 17:09:02.742727] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:05.970 [2024-11-27 17:09:02.742751] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:05.970 [2024-11-27 17:09:02.742801] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:05.970 [2024-11-27 17:09:02.745538] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:05.970 (-273 Celsius) 00:16:05.970 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:05.970 Available Spare: 0% 00:16:05.970 Available Spare Threshold: 0% 00:16:05.970 Life Percentage Used: 0% 00:16:05.970 Data Units Read: 0 00:16:05.970 Data Units Written: 0 00:16:05.970 Host Read Commands: 0 00:16:05.970 Host Write Commands: 0 00:16:05.970 Controller Busy Time: 0 minutes 00:16:05.970 Power Cycles: 0 00:16:05.970 Power On Hours: 0 hours 00:16:05.970 Unsafe Shutdowns: 0 00:16:05.970 Unrecoverable Media Errors: 0 00:16:05.970 Lifetime Error Log Entries: 0 00:16:05.970 Warning Temperature Time: 0 minutes 00:16:05.970 Critical Temperature Time: 0 minutes 00:16:05.970 00:16:05.970 Number of Queues 00:16:05.970 ================ 00:16:05.970 Number of I/O Submission Queues: 127 00:16:05.970 Number of I/O Completion Queues: 127 00:16:05.970 00:16:05.970 Active Namespaces 00:16:05.970 ================= 00:16:05.970 Namespace ID:1 00:16:05.970 Error Recovery Timeout: Unlimited 00:16:05.970 Command Set Identifier: NVM (00h) 00:16:05.970 Deallocate: Supported 00:16:05.970 Deallocated/Unwritten Error: Not Supported 00:16:05.970 Deallocated Read Value: Unknown 00:16:05.970 Deallocate in Write Zeroes: Not Supported 00:16:05.970 Deallocated Guard Field: 0xFFFF 00:16:05.970 Flush: Supported 00:16:05.970 Reservation: Supported 00:16:05.970 Namespace Sharing Capabilities: Multiple Controllers 00:16:05.970 Size (in LBAs): 131072 (0GiB) 00:16:05.970 Capacity (in LBAs): 131072 (0GiB) 00:16:05.970 Utilization (in LBAs): 131072 (0GiB) 00:16:05.970 NGUID: 6A2D398ED73B4FF9BE1D23FE4E4ACD13 00:16:05.970 UUID: 6a2d398e-d73b-4ff9-be1d-23fe4e4acd13 00:16:05.970 Thin Provisioning: Not Supported 00:16:05.970 Per-NS Atomic Units: Yes 00:16:05.970 Atomic Boundary Size (Normal): 0 00:16:05.970 Atomic Boundary Size (PFail): 0 00:16:05.970 Atomic Boundary Offset: 0 00:16:05.970 Maximum Single Source Range Length: 65535 00:16:05.970 Maximum Copy Length: 65535 00:16:05.970 Maximum Source Range Count: 1 00:16:05.970 NGUID/EUI64 Never Reused: No 00:16:05.970 Namespace Write Protected: No 00:16:05.970 Number of LBA Formats: 1 00:16:05.971 Current LBA Format: LBA Format #00 00:16:05.971 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:05.971 00:16:05.971 17:09:02 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:05.971 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.237 Initializing NVMe Controllers 00:16:11.237 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:11.237 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:11.237 Initialization complete. Launching workers. 00:16:11.237 ======================================================== 00:16:11.237 Latency(us) 00:16:11.237 Device Information : IOPS MiB/s Average min max 00:16:11.237 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38141.99 148.99 3355.16 1121.05 8447.30 00:16:11.237 ======================================================== 00:16:11.237 Total : 38141.99 148.99 3355.16 1121.05 8447.30 00:16:11.237 00:16:11.237 17:09:08 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:11.237 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.501 Initializing NVMe Controllers 00:16:16.501 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:16.501 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:16.501 Initialization complete. Launching workers. 00:16:16.501 ======================================================== 00:16:16.501 Latency(us) 00:16:16.501 Device Information : IOPS MiB/s Average min max 00:16:16.501 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36454.48 142.40 3510.44 1170.68 9675.01 00:16:16.501 ======================================================== 00:16:16.501 Total : 36454.48 142.40 3510.44 1170.68 9675.01 00:16:16.501 00:16:16.501 17:09:13 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:16.501 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.765 Initializing NVMe Controllers 00:16:21.765 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:21.765 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:21.765 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:21.765 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:21.765 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:21.765 Initialization complete. Launching workers. 00:16:21.765 Starting thread on core 2 00:16:21.765 Starting thread on core 3 00:16:21.765 Starting thread on core 1 00:16:22.022 17:09:18 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:22.022 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.394 Initializing NVMe Controllers 00:16:25.394 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:25.394 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:25.394 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:25.394 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:25.394 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:25.394 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:25.394 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:25.394 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:25.394 Initialization complete. Launching workers. 00:16:25.394 Starting thread on core 1 with urgent priority queue 00:16:25.394 Starting thread on core 2 with urgent priority queue 00:16:25.394 Starting thread on core 3 with urgent priority queue 00:16:25.394 Starting thread on core 0 with urgent priority queue 00:16:25.394 SPDK bdev Controller (SPDK2 ) core 0: 5549.67 IO/s 18.02 secs/100000 ios 00:16:25.394 SPDK bdev Controller (SPDK2 ) core 1: 5045.67 IO/s 19.82 secs/100000 ios 00:16:25.394 SPDK bdev Controller (SPDK2 ) core 2: 5966.67 IO/s 16.76 secs/100000 ios 00:16:25.394 SPDK bdev Controller (SPDK2 ) core 3: 5836.67 IO/s 17.13 secs/100000 ios 00:16:25.394 ======================================================== 00:16:25.394 00:16:25.394 17:09:22 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:25.394 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.652 Initializing NVMe Controllers 00:16:25.652 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:25.652 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:25.652 Namespace ID: 1 size: 0GB 00:16:25.652 Initialization complete. 00:16:25.652 INFO: using host memory buffer for IO 00:16:25.652 Hello world! 00:16:25.652 17:09:22 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:25.652 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.024 Initializing NVMe Controllers 00:16:27.024 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:27.024 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:27.024 Initialization complete. Launching workers. 00:16:27.025 submit (in ns) avg, min, max = 8563.5, 3420.0, 4017942.2 00:16:27.025 complete (in ns) avg, min, max = 26638.9, 2011.1, 4018511.1 00:16:27.025 00:16:27.025 Submit histogram 00:16:27.025 ================ 00:16:27.025 Range in us Cumulative Count 00:16:27.025 3.413 - 3.437: 0.2293% ( 31) 00:16:27.025 3.437 - 3.461: 1.0133% ( 106) 00:16:27.025 3.461 - 3.484: 3.2249% ( 299) 00:16:27.025 3.484 - 3.508: 7.8033% ( 619) 00:16:27.025 3.508 - 3.532: 16.6050% ( 1190) 00:16:27.025 3.532 - 3.556: 25.8210% ( 1246) 00:16:27.025 3.556 - 3.579: 35.1036% ( 1255) 00:16:27.025 3.579 - 3.603: 42.8846% ( 1052) 00:16:27.025 3.603 - 3.627: 50.1627% ( 984) 00:16:27.025 3.627 - 3.650: 57.2041% ( 952) 00:16:27.025 3.650 - 3.674: 62.0340% ( 653) 00:16:27.025 3.674 - 3.698: 66.0725% ( 546) 00:16:27.025 3.698 - 3.721: 69.3121% ( 438) 00:16:27.025 3.721 - 3.745: 72.4778% ( 428) 00:16:27.025 3.745 - 3.769: 75.5473% ( 415) 00:16:27.025 3.769 - 3.793: 79.1272% ( 484) 00:16:27.025 3.793 - 3.816: 82.7959% ( 496) 00:16:27.025 3.816 - 3.840: 85.5325% ( 370) 00:16:27.025 3.840 - 3.864: 87.9290% ( 324) 00:16:27.025 3.864 - 3.887: 89.7781% ( 250) 00:16:27.025 3.887 - 3.911: 91.3240% ( 209) 00:16:27.025 3.911 - 3.935: 92.6479% ( 179) 00:16:27.025 3.935 - 3.959: 93.6982% ( 142) 00:16:27.025 3.959 - 3.982: 94.6450% ( 128) 00:16:27.025 3.982 - 4.006: 95.2663% ( 84) 00:16:27.025 4.006 - 4.030: 95.8210% ( 75) 00:16:27.025 4.030 - 4.053: 96.2130% ( 53) 00:16:27.025 4.053 - 4.077: 96.5015% ( 39) 00:16:27.025 4.077 - 4.101: 96.6790% ( 24) 00:16:27.025 4.101 - 4.124: 96.8195% ( 19) 00:16:27.025 4.124 - 4.148: 96.8861% ( 9) 00:16:27.025 4.148 - 4.172: 96.9822% ( 13) 00:16:27.025 4.172 - 4.196: 97.0636% ( 11) 00:16:27.025 4.196 - 4.219: 97.1746% ( 15) 00:16:27.025 4.219 - 4.243: 97.2485% ( 10) 00:16:27.025 4.243 - 4.267: 97.3003% ( 7) 00:16:27.025 4.267 - 4.290: 97.3373% ( 5) 00:16:27.025 4.290 - 4.314: 97.3743% ( 5) 00:16:27.025 4.314 - 4.338: 97.3817% ( 1) 00:16:27.025 4.338 - 4.361: 97.4112% ( 4) 00:16:27.025 4.361 - 4.385: 97.4260% ( 2) 00:16:27.025 4.409 - 4.433: 97.4408% ( 2) 00:16:27.025 4.433 - 4.456: 97.4482% ( 1) 00:16:27.025 4.480 - 4.504: 97.4556% ( 1) 00:16:27.025 4.504 - 4.527: 97.4630% ( 1) 00:16:27.025 4.527 - 4.551: 97.4926% ( 4) 00:16:27.025 4.551 - 4.575: 97.5074% ( 2) 00:16:27.025 4.575 - 4.599: 97.5222% ( 2) 00:16:27.025 4.670 - 4.693: 97.5296% ( 1) 00:16:27.025 4.717 - 4.741: 97.5518% ( 3) 00:16:27.025 4.741 - 4.764: 97.5888% ( 5) 00:16:27.025 4.764 - 4.788: 97.6553% ( 9) 00:16:27.025 4.788 - 4.812: 97.6923% ( 5) 00:16:27.025 4.812 - 4.836: 97.7367% ( 6) 00:16:27.025 4.836 - 4.859: 97.8033% ( 9) 00:16:27.025 4.859 - 4.883: 97.8328% ( 4) 00:16:27.025 4.883 - 4.907: 97.9142% ( 11) 00:16:27.025 4.907 - 4.930: 97.9734% ( 8) 00:16:27.025 4.930 - 4.954: 98.0178% ( 6) 00:16:27.025 4.954 - 4.978: 98.0621% ( 6) 00:16:27.025 4.978 - 5.001: 98.1139% ( 7) 00:16:27.025 5.001 - 5.025: 98.1583% ( 6) 00:16:27.025 5.025 - 5.049: 98.1805% ( 3) 00:16:27.025 5.049 - 5.073: 98.1953% ( 2) 00:16:27.025 5.073 - 5.096: 98.2027% ( 1) 00:16:27.025 5.096 - 5.120: 98.2101% ( 1) 00:16:27.025 5.120 - 5.144: 98.2470% ( 5) 00:16:27.025 5.144 - 5.167: 98.2692% ( 3) 00:16:27.025 5.167 - 5.191: 98.2914% ( 3) 00:16:27.025 5.191 - 5.215: 98.3210% ( 4) 00:16:27.025 5.262 - 5.286: 98.3358% ( 2) 00:16:27.025 5.286 - 5.310: 98.3506% ( 2) 00:16:27.025 5.333 - 5.357: 98.3654% ( 2) 00:16:27.025 5.404 - 5.428: 98.3728% ( 1) 00:16:27.025 5.452 - 5.476: 98.3802% ( 1) 00:16:27.025 5.476 - 5.499: 98.3876% ( 1) 00:16:27.025 5.547 - 5.570: 98.3950% ( 1) 00:16:27.025 5.689 - 5.713: 98.4024% ( 1) 00:16:27.025 5.831 - 5.855: 98.4098% ( 1) 00:16:27.025 5.926 - 5.950: 98.4246% ( 2) 00:16:27.025 5.950 - 5.973: 98.4393% ( 2) 00:16:27.025 6.116 - 6.163: 98.4467% ( 1) 00:16:27.025 6.210 - 6.258: 98.4541% ( 1) 00:16:27.025 6.258 - 6.305: 98.4615% ( 1) 00:16:27.025 6.305 - 6.353: 98.4689% ( 1) 00:16:27.025 6.447 - 6.495: 98.4837% ( 2) 00:16:27.025 6.921 - 6.969: 98.4911% ( 1) 00:16:27.025 6.969 - 7.016: 98.4985% ( 1) 00:16:27.025 7.111 - 7.159: 98.5059% ( 1) 00:16:27.025 7.206 - 7.253: 98.5207% ( 2) 00:16:27.025 7.396 - 7.443: 98.5355% ( 2) 00:16:27.025 7.490 - 7.538: 98.5503% ( 2) 00:16:27.025 7.585 - 7.633: 98.5577% ( 1) 00:16:27.025 7.680 - 7.727: 98.5651% ( 1) 00:16:27.025 7.727 - 7.775: 98.5799% ( 2) 00:16:27.025 7.775 - 7.822: 98.5873% ( 1) 00:16:27.025 7.870 - 7.917: 98.5947% ( 1) 00:16:27.025 7.964 - 8.012: 98.6021% ( 1) 00:16:27.025 8.012 - 8.059: 98.6169% ( 2) 00:16:27.025 8.107 - 8.154: 98.6317% ( 2) 00:16:27.025 8.249 - 8.296: 98.6391% ( 1) 00:16:27.025 8.486 - 8.533: 98.6464% ( 1) 00:16:27.025 8.533 - 8.581: 98.6538% ( 1) 00:16:27.025 8.628 - 8.676: 98.6612% ( 1) 00:16:27.025 8.676 - 8.723: 98.6686% ( 1) 00:16:27.025 8.723 - 8.770: 98.6908% ( 3) 00:16:27.025 8.770 - 8.818: 98.7056% ( 2) 00:16:27.025 8.818 - 8.865: 98.7130% ( 1) 00:16:27.025 8.960 - 9.007: 98.7204% ( 1) 00:16:27.025 9.007 - 9.055: 98.7500% ( 4) 00:16:27.025 9.102 - 9.150: 98.7648% ( 2) 00:16:27.025 9.150 - 9.197: 98.7722% ( 1) 00:16:27.025 9.244 - 9.292: 98.7796% ( 1) 00:16:27.025 9.339 - 9.387: 98.8018% ( 3) 00:16:27.025 9.624 - 9.671: 98.8092% ( 1) 00:16:27.025 9.671 - 9.719: 98.8166% ( 1) 00:16:27.025 9.766 - 9.813: 98.8314% ( 2) 00:16:27.025 9.813 - 9.861: 98.8609% ( 4) 00:16:27.025 9.861 - 9.908: 98.8683% ( 1) 00:16:27.025 10.050 - 10.098: 98.8757% ( 1) 00:16:27.025 10.098 - 10.145: 98.8831% ( 1) 00:16:27.025 10.193 - 10.240: 98.8905% ( 1) 00:16:27.025 10.430 - 10.477: 98.8979% ( 1) 00:16:27.025 10.477 - 10.524: 98.9053% ( 1) 00:16:27.025 10.524 - 10.572: 98.9127% ( 1) 00:16:27.025 10.619 - 10.667: 98.9201% ( 1) 00:16:27.025 10.856 - 10.904: 98.9275% ( 1) 00:16:27.025 10.904 - 10.951: 98.9349% ( 1) 00:16:27.025 10.999 - 11.046: 98.9423% ( 1) 00:16:27.025 11.283 - 11.330: 98.9571% ( 2) 00:16:27.025 11.330 - 11.378: 98.9719% ( 2) 00:16:27.025 11.520 - 11.567: 98.9793% ( 1) 00:16:27.025 11.567 - 11.615: 98.9867% ( 1) 00:16:27.025 11.804 - 11.852: 98.9941% ( 1) 00:16:27.025 12.089 - 12.136: 99.0015% ( 1) 00:16:27.025 12.136 - 12.231: 99.0163% ( 2) 00:16:27.025 12.326 - 12.421: 99.0237% ( 1) 00:16:27.025 12.610 - 12.705: 99.0311% ( 1) 00:16:27.025 13.084 - 13.179: 99.0459% ( 2) 00:16:27.025 13.179 - 13.274: 99.0533% ( 1) 00:16:27.025 13.274 - 13.369: 99.0607% ( 1) 00:16:27.025 13.464 - 13.559: 99.0680% ( 1) 00:16:27.025 14.222 - 14.317: 99.0754% ( 1) 00:16:27.025 14.412 - 14.507: 99.0828% ( 1) 00:16:27.025 14.507 - 14.601: 99.0902% ( 1) 00:16:27.025 15.360 - 15.455: 99.0976% ( 1) 00:16:27.025 16.877 - 16.972: 99.1124% ( 2) 00:16:27.025 17.067 - 17.161: 99.1198% ( 1) 00:16:27.025 17.161 - 17.256: 99.1272% ( 1) 00:16:27.025 17.256 - 17.351: 99.1346% ( 1) 00:16:27.025 17.351 - 17.446: 99.1568% ( 3) 00:16:27.025 17.446 - 17.541: 99.1864% ( 4) 00:16:27.025 17.541 - 17.636: 99.2382% ( 7) 00:16:27.025 17.636 - 17.730: 99.2899% ( 7) 00:16:27.025 17.825 - 17.920: 99.3713% ( 11) 00:16:27.025 17.920 - 18.015: 99.3935% ( 3) 00:16:27.025 18.015 - 18.110: 99.4675% ( 10) 00:16:27.025 18.110 - 18.204: 99.5636% ( 13) 00:16:27.025 18.204 - 18.299: 99.6450% ( 11) 00:16:27.025 18.299 - 18.394: 99.6967% ( 7) 00:16:27.025 18.394 - 18.489: 99.7337% ( 5) 00:16:27.025 18.489 - 18.584: 99.7559% ( 3) 00:16:27.025 18.584 - 18.679: 99.7781% ( 3) 00:16:27.025 18.679 - 18.773: 99.7929% ( 2) 00:16:27.025 18.773 - 18.868: 99.8077% ( 2) 00:16:27.025 18.868 - 18.963: 99.8299% ( 3) 00:16:27.025 19.153 - 19.247: 99.8373% ( 1) 00:16:27.025 19.532 - 19.627: 99.8447% ( 1) 00:16:27.025 20.480 - 20.575: 99.8521% ( 1) 00:16:27.025 23.893 - 23.988: 99.8595% ( 1) 00:16:27.025 25.031 - 25.221: 99.8669% ( 1) 00:16:27.025 29.582 - 29.772: 99.8743% ( 1) 00:16:27.025 33.754 - 33.944: 99.8817% ( 1) 00:16:27.025 3980.705 - 4004.978: 99.9778% ( 13) 00:16:27.025 4004.978 - 4029.250: 100.0000% ( 3) 00:16:27.025 00:16:27.025 Complete histogram 00:16:27.025 ================== 00:16:27.025 Range in us Cumulative Count 00:16:27.025 2.003 - 2.015: 0.0148% ( 2) 00:16:27.025 2.015 - 2.027: 5.6435% ( 761) 00:16:27.025 2.027 - 2.039: 17.5296% ( 1607) 00:16:27.025 2.039 - 2.050: 19.6893% ( 292) 00:16:27.025 2.050 - 2.062: 46.1982% ( 3584) 00:16:27.026 2.062 - 2.074: 62.0932% ( 2149) 00:16:27.026 2.074 - 2.086: 63.8462% ( 237) 00:16:27.026 2.086 - 2.098: 68.2840% ( 600) 00:16:27.026 2.098 - 2.110: 70.0518% ( 239) 00:16:27.026 2.110 - 2.121: 73.6908% ( 492) 00:16:27.026 2.121 - 2.133: 85.8062% ( 1638) 00:16:27.026 2.133 - 2.145: 88.9867% ( 430) 00:16:27.026 2.145 - 2.157: 90.3920% ( 190) 00:16:27.026 2.157 - 2.169: 91.8047% ( 191) 00:16:27.026 2.169 - 2.181: 92.4260% ( 84) 00:16:27.026 2.181 - 2.193: 93.5503% ( 152) 00:16:27.026 2.193 - 2.204: 95.0370% ( 201) 00:16:27.026 2.204 - 2.216: 95.3920% ( 48) 00:16:27.026 2.216 - 2.228: 95.6287% ( 32) 00:16:27.026 2.228 - 2.240: 95.7840% ( 21) 00:16:27.026 2.240 - 2.252: 95.8506% ( 9) 00:16:27.026 2.252 - 2.264: 96.0725% ( 30) 00:16:27.026 2.264 - 2.276: 96.1538% ( 11) 00:16:27.026 2.276 - 2.287: 96.2056% ( 7) 00:16:27.026 2.287 - 2.299: 96.2574% ( 7) 00:16:27.026 2.299 - 2.311: 96.4719% ( 29) 00:16:27.026 2.311 - 2.323: 96.6124% ( 19) 00:16:27.026 2.323 - 2.335: 96.7678% ( 21) 00:16:27.026 2.335 - 2.347: 97.0340% ( 36) 00:16:27.026 2.347 - 2.359: 97.3225% ( 39) 00:16:27.026 2.359 - 2.370: 97.6036% ( 38) 00:16:27.026 2.370 - 2.382: 97.8033% ( 27) 00:16:27.026 2.382 - 2.394: 97.9660% ( 22) 00:16:27.026 2.394 - 2.406: 98.1435% ( 24) 00:16:27.026 2.406 - 2.418: 98.2322% ( 12) 00:16:27.026 2.418 - 2.430: 98.2840% ( 7) 00:16:27.026 2.430 - 2.441: 98.3580% ( 10) 00:16:27.026 2.441 - 2.453: 98.4172% ( 8) 00:16:27.026 2.453 - 2.465: 98.4615% ( 6) 00:16:27.026 2.465 - 2.477: 98.4911% ( 4) 00:16:27.026 2.477 - 2.489: 98.5059% ( 2) 00:16:27.026 2.489 - 2.501: 98.5207% ( 2) 00:16:27.026 2.501 - 2.513: 98.5281% ( 1) 00:16:27.026 2.513 - 2.524: 98.5355% ( 1) 00:16:27.026 2.631 - 2.643: 98.5429% ( 1) 00:16:27.026 2.655 - 2.667: 98.5503% ( 1) 00:16:27.026 2.667 - 2.679: 98.5577% ( 1) 00:16:27.026 2.714 - 2.726: 98.5651% ( 1) 00:16:27.026 2.726 - 2.738: 98.5725% ( 1) 00:16:27.026 2.927 - 2.939: 98.5799% ( 1) 00:16:27.026 3.247 - 3.271: 98.5873% ( 1) 00:16:27.026 3.319 - 3.342: 98.5947% ( 1) 00:16:27.026 3.342 - 3.366: 98.6021% ( 1) 00:16:27.026 3.366 - 3.390: 98.6169% ( 2) 00:16:27.026 3.413 - 3.437: 98.6464% ( 4) 00:16:27.026 3.437 - 3.461: 98.6538% ( 1) 00:16:27.026 3.461 - 3.484: 98.6612% ( 1) 00:16:27.026 3.484 - 3.508: 98.6686% ( 1) 00:16:27.026 3.508 - 3.532: 98.6760% ( 1) 00:16:27.026 3.532 - 3.556: 98.6834% ( 1) 00:16:27.026 3.556 - 3.579: 98.6908% ( 1) 00:16:27.026 3.579 - 3.603: 98.6982% ( 1) 00:16:27.026 3.627 - 3.650: 98.7204% ( 3) 00:16:27.026 3.721 - 3.745: 98.7278% ( 1) 00:16:27.026 3.816 - 3.840: 98.7352% ( 1) 00:16:27.026 3.887 - 3.911: 98.7426% ( 1) 00:16:27.026 4.836 - 4.859: 98.7500% ( 1) 00:16:27.026 5.594 - 5.618: 98.7574% ( 1) 00:16:27.026 6.021 - 6.044: 98.7648% ( 1) 00:16:27.026 6.044 - 6.068: 98.7722% ( 1) 00:16:27.026 6.163 - 6.210: 98.7870% ( 2) 00:16:27.026 6.258 - 6.305: 98.7944% ( 1) 00:16:27.026 6.353 - 6.400: 98.8018% ( 1) 00:16:27.026 6.684 - 6.732: 98.8092% ( 1) 00:16:27.026 6.779 - 6.827: 98.8166% ( 1) 00:16:27.026 6.874 - 6.921: 98.8314% ( 2) 00:16:27.026 6.921 - 6.969: 98.8388% ( 1) 00:16:27.026 7.159 - 7.206: 98.8462% ( 1) 00:16:27.026 7.301 - 7.348: 98.8536% ( 1) 00:16:27.026 7.443 - 7.490: 98.8757% ( 3) 00:16:27.026 7.585 - 7.633: 98.8831% ( 1) 00:16:27.026 7.680 - 7.727: 98.8905% ( 1) 00:16:27.026 7.775 - 7.822: 98.8979% ( 1) 00:16:27.026 8.012 - 8.059: 98.9127% ( 2) 00:16:27.026 8.296 - 8.344: 98.9201% ( 1) 00:16:27.026 9.766 - 9.813: 98.9275% ( 1) 00:16:27.026 12.136 - 12.231: 98.9349% ( 1) 00:16:27.026 15.170 - 15.265: 98.9423% ( 1) 00:16:27.026 15.455 - 15.550: 98.9497% ( 1) 00:16:27.026 15.550 - 15.644: 98.9719% ( 3) 00:16:27.026 15.644 - 15.739: 98.9793% ( 1) 00:16:27.026 15.739 - 15.834: 99.0015% ( 3) 00:16:27.026 15.834 - 15.929: 99.0533% ( 7) 00:16:27.026 15.929 - 16.024: 99.0828% ( 4) 00:16:27.026 16.024 - 16.119: 99.0902% ( 1) 00:16:27.026 16.119 - 16.213: 99.1198% ( 4) 00:16:27.026 16.213 - 16.308: 99.1568% ( 5) 00:16:27.026 16.308 - 16.403: 99.1864% ( 4) 00:16:27.026 16.403 - 16.498: 99.2012% ( 2) 00:16:27.026 16.498 - 16.593: 99.2234% ( 3) 00:16:27.026 16.593 - 16.687: 99.2530% ( 4) 00:16:27.026 16.782 - 16.877: 99.2751% ( 3) 00:16:27.026 16.877 - 16.972: 99.2899% ( 2) 00:16:27.026 16.972 - 17.067: 99.2973% ( 1) 00:16:27.026 17.161 - 17.256: 99.3047% ( 1) 00:16:27.026 17.256 - 17.351: 99.3121% ( 1) 00:16:27.026 17.446 - 17.541: 99.3269% ( 2) 00:16:27.026 17.825 - 17.920: 99.3343% ( 1) 00:16:27.026 18.015 - 18.110: 99.3417% ( 1) 00:16:27.026 18.110 - 18.204: 99.3491% ( 1) 00:16:27.026 18.204 - 18.299: 99.3565% ( 1) 00:16:27.026 20.101 - 20.196: 99.3639% ( 1) 00:16:27.026 22.756 - 22.850: 99.3713% ( 1) 00:16:27.026 31.479 - 31.668: 99.3787% ( 1) 00:16:27.026 56.889 - 57.268: 99.3861% ( 1) 00:16:27.026 3094.756 - 3106.892: 99.3935% ( 1) 00:16:27.026 3689.434 - 3713.707: 99.4009% ( 1) 00:16:27.026 3980.705 - 4004.978: 99.8743% ( 64) 00:16:27.026 4004.978 - 4029.250: 100.0000% ( 17) 00:16:27.026 00:16:27.026 17:09:23 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:27.026 17:09:23 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:27.026 17:09:23 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:27.026 17:09:23 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:27.026 17:09:23 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:27.284 [ 00:16:27.284 { 00:16:27.284 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:27.284 "subtype": "Discovery", 00:16:27.284 "listen_addresses": [], 00:16:27.284 "allow_any_host": true, 00:16:27.284 "hosts": [] 00:16:27.284 }, 00:16:27.284 { 00:16:27.284 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:27.284 "subtype": "NVMe", 00:16:27.284 "listen_addresses": [ 00:16:27.284 { 00:16:27.284 "transport": "VFIOUSER", 00:16:27.284 "trtype": "VFIOUSER", 00:16:27.284 "adrfam": "IPv4", 00:16:27.284 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:27.284 "trsvcid": "0" 00:16:27.284 } 00:16:27.284 ], 00:16:27.284 "allow_any_host": true, 00:16:27.284 "hosts": [], 00:16:27.284 "serial_number": "SPDK1", 00:16:27.284 "model_number": "SPDK bdev Controller", 00:16:27.284 "max_namespaces": 32, 00:16:27.284 "min_cntlid": 1, 00:16:27.284 "max_cntlid": 65519, 00:16:27.284 "namespaces": [ 00:16:27.284 { 00:16:27.284 "nsid": 1, 00:16:27.284 "bdev_name": "Malloc1", 00:16:27.284 "name": "Malloc1", 00:16:27.284 "nguid": "EC1FD1A5CBF84417AF71C9B36828641F", 00:16:27.284 "uuid": "ec1fd1a5-cbf8-4417-af71-c9b36828641f" 00:16:27.284 }, 00:16:27.284 { 00:16:27.284 "nsid": 2, 00:16:27.284 "bdev_name": "Malloc3", 00:16:27.284 "name": "Malloc3", 00:16:27.284 "nguid": "7FA1DF5AE810481BBD498E93777322F4", 00:16:27.284 "uuid": "7fa1df5a-e810-481b-bd49-8e93777322f4" 00:16:27.284 } 00:16:27.284 ] 00:16:27.284 }, 00:16:27.284 { 00:16:27.284 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:27.284 "subtype": "NVMe", 00:16:27.284 "listen_addresses": [ 00:16:27.284 { 00:16:27.284 "transport": "VFIOUSER", 00:16:27.284 "trtype": "VFIOUSER", 00:16:27.285 "adrfam": "IPv4", 00:16:27.285 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:27.285 "trsvcid": "0" 00:16:27.285 } 00:16:27.285 ], 00:16:27.285 "allow_any_host": true, 00:16:27.285 "hosts": [], 00:16:27.285 "serial_number": "SPDK2", 00:16:27.285 "model_number": "SPDK bdev Controller", 00:16:27.285 "max_namespaces": 32, 00:16:27.285 "min_cntlid": 1, 00:16:27.285 "max_cntlid": 65519, 00:16:27.285 "namespaces": [ 00:16:27.285 { 00:16:27.285 "nsid": 1, 00:16:27.285 "bdev_name": "Malloc2", 00:16:27.285 "name": "Malloc2", 00:16:27.285 "nguid": "6A2D398ED73B4FF9BE1D23FE4E4ACD13", 00:16:27.285 "uuid": "6a2d398e-d73b-4ff9-be1d-23fe4e4acd13" 00:16:27.285 } 00:16:27.285 ] 00:16:27.285 } 00:16:27.285 ] 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1722011 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:27.285 17:09:24 -- common/autotest_common.sh@1254 -- # local i=0 00:16:27.285 17:09:24 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:27.285 17:09:24 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:27.285 17:09:24 -- common/autotest_common.sh@1265 -- # return 0 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:27.285 17:09:24 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:27.285 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.543 Malloc4 00:16:27.543 17:09:24 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:27.801 17:09:24 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:27.801 Asynchronous Event Request test 00:16:27.801 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:27.801 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:27.801 Registering asynchronous event callbacks... 00:16:27.801 Starting namespace attribute notice tests for all controllers... 00:16:27.801 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:27.801 aer_cb - Changed Namespace 00:16:27.801 Cleaning up... 00:16:28.059 [ 00:16:28.059 { 00:16:28.059 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:28.059 "subtype": "Discovery", 00:16:28.059 "listen_addresses": [], 00:16:28.059 "allow_any_host": true, 00:16:28.059 "hosts": [] 00:16:28.059 }, 00:16:28.059 { 00:16:28.059 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:28.059 "subtype": "NVMe", 00:16:28.059 "listen_addresses": [ 00:16:28.059 { 00:16:28.059 "transport": "VFIOUSER", 00:16:28.059 "trtype": "VFIOUSER", 00:16:28.059 "adrfam": "IPv4", 00:16:28.059 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:28.059 "trsvcid": "0" 00:16:28.059 } 00:16:28.059 ], 00:16:28.059 "allow_any_host": true, 00:16:28.059 "hosts": [], 00:16:28.059 "serial_number": "SPDK1", 00:16:28.059 "model_number": "SPDK bdev Controller", 00:16:28.059 "max_namespaces": 32, 00:16:28.059 "min_cntlid": 1, 00:16:28.059 "max_cntlid": 65519, 00:16:28.059 "namespaces": [ 00:16:28.059 { 00:16:28.059 "nsid": 1, 00:16:28.059 "bdev_name": "Malloc1", 00:16:28.059 "name": "Malloc1", 00:16:28.059 "nguid": "EC1FD1A5CBF84417AF71C9B36828641F", 00:16:28.059 "uuid": "ec1fd1a5-cbf8-4417-af71-c9b36828641f" 00:16:28.059 }, 00:16:28.059 { 00:16:28.059 "nsid": 2, 00:16:28.059 "bdev_name": "Malloc3", 00:16:28.059 "name": "Malloc3", 00:16:28.059 "nguid": "7FA1DF5AE810481BBD498E93777322F4", 00:16:28.059 "uuid": "7fa1df5a-e810-481b-bd49-8e93777322f4" 00:16:28.059 } 00:16:28.059 ] 00:16:28.059 }, 00:16:28.059 { 00:16:28.059 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:28.059 "subtype": "NVMe", 00:16:28.059 "listen_addresses": [ 00:16:28.059 { 00:16:28.059 "transport": "VFIOUSER", 00:16:28.059 "trtype": "VFIOUSER", 00:16:28.059 "adrfam": "IPv4", 00:16:28.059 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:28.059 "trsvcid": "0" 00:16:28.059 } 00:16:28.059 ], 00:16:28.059 "allow_any_host": true, 00:16:28.059 "hosts": [], 00:16:28.059 "serial_number": "SPDK2", 00:16:28.059 "model_number": "SPDK bdev Controller", 00:16:28.059 "max_namespaces": 32, 00:16:28.059 "min_cntlid": 1, 00:16:28.059 "max_cntlid": 65519, 00:16:28.059 "namespaces": [ 00:16:28.059 { 00:16:28.059 "nsid": 1, 00:16:28.059 "bdev_name": "Malloc2", 00:16:28.059 "name": "Malloc2", 00:16:28.059 "nguid": "6A2D398ED73B4FF9BE1D23FE4E4ACD13", 00:16:28.059 "uuid": "6a2d398e-d73b-4ff9-be1d-23fe4e4acd13" 00:16:28.059 }, 00:16:28.059 { 00:16:28.059 "nsid": 2, 00:16:28.059 "bdev_name": "Malloc4", 00:16:28.059 "name": "Malloc4", 00:16:28.059 "nguid": "CF8AE52EABAD4DD695544696AF7EF069", 00:16:28.059 "uuid": "cf8ae52e-abad-4dd6-9554-4696af7ef069" 00:16:28.059 } 00:16:28.059 ] 00:16:28.059 } 00:16:28.059 ] 00:16:28.059 17:09:24 -- target/nvmf_vfio_user.sh@44 -- # wait 1722011 00:16:28.059 17:09:24 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:28.059 17:09:24 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1715501 00:16:28.059 17:09:24 -- common/autotest_common.sh@936 -- # '[' -z 1715501 ']' 00:16:28.059 17:09:24 -- common/autotest_common.sh@940 -- # kill -0 1715501 00:16:28.059 17:09:24 -- common/autotest_common.sh@941 -- # uname 00:16:28.059 17:09:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:28.059 17:09:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1715501 00:16:28.059 17:09:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:28.059 17:09:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:28.059 17:09:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1715501' 00:16:28.059 killing process with pid 1715501 00:16:28.059 17:09:24 -- common/autotest_common.sh@955 -- # kill 1715501 00:16:28.059 [2024-11-27 17:09:24.870318] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:28.059 17:09:24 -- common/autotest_common.sh@960 -- # wait 1715501 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1722157 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1722157' 00:16:28.318 Process pid: 1722157 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:28.318 17:09:25 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1722157 00:16:28.318 17:09:25 -- common/autotest_common.sh@829 -- # '[' -z 1722157 ']' 00:16:28.318 17:09:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.318 17:09:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:28.318 17:09:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.318 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.318 17:09:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:28.318 17:09:25 -- common/autotest_common.sh@10 -- # set +x 00:16:28.318 [2024-11-27 17:09:25.246183] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:28.318 [2024-11-27 17:09:25.247202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:28.318 [2024-11-27 17:09:25.247273] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:28.576 EAL: No free 2048 kB hugepages reported on node 1 00:16:28.576 [2024-11-27 17:09:25.309516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:28.576 [2024-11-27 17:09:25.396561] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:28.576 [2024-11-27 17:09:25.396727] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:28.576 [2024-11-27 17:09:25.396746] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:28.576 [2024-11-27 17:09:25.396760] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:28.576 [2024-11-27 17:09:25.396830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:28.576 [2024-11-27 17:09:25.396890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:28.576 [2024-11-27 17:09:25.397009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:28.576 [2024-11-27 17:09:25.397012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:28.576 [2024-11-27 17:09:25.494880] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:28.576 [2024-11-27 17:09:25.495136] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:28.576 [2024-11-27 17:09:25.495409] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:28.576 [2024-11-27 17:09:25.496181] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:28.576 [2024-11-27 17:09:25.496290] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:29.510 17:09:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:29.510 17:09:26 -- common/autotest_common.sh@862 -- # return 0 00:16:29.510 17:09:26 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:30.443 17:09:27 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:30.701 17:09:27 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:30.701 17:09:27 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:30.701 17:09:27 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:30.701 17:09:27 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:30.701 17:09:27 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:30.960 Malloc1 00:16:30.960 17:09:27 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:31.219 17:09:28 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:31.477 17:09:28 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:31.735 17:09:28 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:31.735 17:09:28 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:31.735 17:09:28 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:31.993 Malloc2 00:16:31.993 17:09:28 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:32.251 17:09:29 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:32.508 17:09:29 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:32.765 17:09:29 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:32.765 17:09:29 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1722157 00:16:32.765 17:09:29 -- common/autotest_common.sh@936 -- # '[' -z 1722157 ']' 00:16:32.765 17:09:29 -- common/autotest_common.sh@940 -- # kill -0 1722157 00:16:32.765 17:09:29 -- common/autotest_common.sh@941 -- # uname 00:16:32.765 17:09:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:32.765 17:09:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1722157 00:16:32.765 17:09:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:32.765 17:09:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:32.765 17:09:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1722157' 00:16:32.765 killing process with pid 1722157 00:16:32.765 17:09:29 -- common/autotest_common.sh@955 -- # kill 1722157 00:16:32.765 17:09:29 -- common/autotest_common.sh@960 -- # wait 1722157 00:16:33.023 17:09:29 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:33.023 17:09:29 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:33.023 00:16:33.023 real 0m53.917s 00:16:33.023 user 3m33.240s 00:16:33.023 sys 0m4.416s 00:16:33.023 17:09:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:33.023 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:16:33.023 ************************************ 00:16:33.023 END TEST nvmf_vfio_user 00:16:33.023 ************************************ 00:16:33.023 17:09:29 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:33.023 17:09:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:33.023 17:09:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:33.023 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:16:33.023 ************************************ 00:16:33.023 START TEST nvmf_vfio_user_nvme_compliance 00:16:33.023 ************************************ 00:16:33.023 17:09:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:33.023 * Looking for test storage... 00:16:33.023 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:33.023 17:09:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:33.023 17:09:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:33.023 17:09:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:33.282 17:09:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:33.282 17:09:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:33.282 17:09:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:33.282 17:09:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:33.282 17:09:30 -- scripts/common.sh@335 -- # IFS=.-: 00:16:33.282 17:09:30 -- scripts/common.sh@335 -- # read -ra ver1 00:16:33.282 17:09:30 -- scripts/common.sh@336 -- # IFS=.-: 00:16:33.282 17:09:30 -- scripts/common.sh@336 -- # read -ra ver2 00:16:33.282 17:09:30 -- scripts/common.sh@337 -- # local 'op=<' 00:16:33.282 17:09:30 -- scripts/common.sh@339 -- # ver1_l=2 00:16:33.282 17:09:30 -- scripts/common.sh@340 -- # ver2_l=1 00:16:33.282 17:09:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:33.282 17:09:30 -- scripts/common.sh@343 -- # case "$op" in 00:16:33.282 17:09:30 -- scripts/common.sh@344 -- # : 1 00:16:33.282 17:09:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:33.282 17:09:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:33.282 17:09:30 -- scripts/common.sh@364 -- # decimal 1 00:16:33.282 17:09:30 -- scripts/common.sh@352 -- # local d=1 00:16:33.282 17:09:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:33.282 17:09:30 -- scripts/common.sh@354 -- # echo 1 00:16:33.282 17:09:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:33.282 17:09:30 -- scripts/common.sh@365 -- # decimal 2 00:16:33.282 17:09:30 -- scripts/common.sh@352 -- # local d=2 00:16:33.282 17:09:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:33.282 17:09:30 -- scripts/common.sh@354 -- # echo 2 00:16:33.282 17:09:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:33.282 17:09:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:33.282 17:09:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:33.282 17:09:30 -- scripts/common.sh@367 -- # return 0 00:16:33.282 17:09:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:33.282 17:09:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:33.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.282 --rc genhtml_branch_coverage=1 00:16:33.282 --rc genhtml_function_coverage=1 00:16:33.282 --rc genhtml_legend=1 00:16:33.282 --rc geninfo_all_blocks=1 00:16:33.282 --rc geninfo_unexecuted_blocks=1 00:16:33.282 00:16:33.282 ' 00:16:33.282 17:09:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:33.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.282 --rc genhtml_branch_coverage=1 00:16:33.282 --rc genhtml_function_coverage=1 00:16:33.282 --rc genhtml_legend=1 00:16:33.282 --rc geninfo_all_blocks=1 00:16:33.282 --rc geninfo_unexecuted_blocks=1 00:16:33.282 00:16:33.282 ' 00:16:33.282 17:09:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:33.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.282 --rc genhtml_branch_coverage=1 00:16:33.282 --rc genhtml_function_coverage=1 00:16:33.282 --rc genhtml_legend=1 00:16:33.282 --rc geninfo_all_blocks=1 00:16:33.282 --rc geninfo_unexecuted_blocks=1 00:16:33.282 00:16:33.282 ' 00:16:33.282 17:09:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:33.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.283 --rc genhtml_branch_coverage=1 00:16:33.283 --rc genhtml_function_coverage=1 00:16:33.283 --rc genhtml_legend=1 00:16:33.283 --rc geninfo_all_blocks=1 00:16:33.283 --rc geninfo_unexecuted_blocks=1 00:16:33.283 00:16:33.283 ' 00:16:33.283 17:09:30 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:33.283 17:09:30 -- nvmf/common.sh@7 -- # uname -s 00:16:33.283 17:09:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:33.283 17:09:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:33.283 17:09:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:33.283 17:09:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:33.283 17:09:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:33.283 17:09:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:33.283 17:09:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:33.283 17:09:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:33.283 17:09:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:33.283 17:09:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:33.283 17:09:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.283 17:09:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.283 17:09:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:33.283 17:09:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:33.283 17:09:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:33.283 17:09:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:33.283 17:09:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:33.283 17:09:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:33.283 17:09:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:33.283 17:09:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.283 17:09:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.283 17:09:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.283 17:09:30 -- paths/export.sh@5 -- # export PATH 00:16:33.283 17:09:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.283 17:09:30 -- nvmf/common.sh@46 -- # : 0 00:16:33.283 17:09:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:33.283 17:09:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:33.283 17:09:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:33.283 17:09:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:33.283 17:09:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:33.283 17:09:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:33.283 17:09:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:33.283 17:09:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:33.283 17:09:30 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:33.283 17:09:30 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:33.283 17:09:30 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:33.283 17:09:30 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:33.283 17:09:30 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:33.283 17:09:30 -- compliance/compliance.sh@20 -- # nvmfpid=1722790 00:16:33.283 17:09:30 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1722790' 00:16:33.283 17:09:30 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:33.283 Process pid: 1722790 00:16:33.283 17:09:30 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:33.283 17:09:30 -- compliance/compliance.sh@24 -- # waitforlisten 1722790 00:16:33.283 17:09:30 -- common/autotest_common.sh@829 -- # '[' -z 1722790 ']' 00:16:33.283 17:09:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:33.283 17:09:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:33.283 17:09:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:33.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:33.283 17:09:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:33.283 17:09:30 -- common/autotest_common.sh@10 -- # set +x 00:16:33.283 [2024-11-27 17:09:30.086658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:33.283 [2024-11-27 17:09:30.086745] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:33.283 EAL: No free 2048 kB hugepages reported on node 1 00:16:33.283 [2024-11-27 17:09:30.154280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:33.541 [2024-11-27 17:09:30.248579] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:33.541 [2024-11-27 17:09:30.248730] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:33.541 [2024-11-27 17:09:30.248750] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:33.541 [2024-11-27 17:09:30.248764] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:33.541 [2024-11-27 17:09:30.248838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:33.541 [2024-11-27 17:09:30.248906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:33.541 [2024-11-27 17:09:30.248909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:34.475 17:09:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:34.475 17:09:31 -- common/autotest_common.sh@862 -- # return 0 00:16:34.475 17:09:31 -- compliance/compliance.sh@26 -- # sleep 1 00:16:35.408 17:09:32 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:35.408 17:09:32 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:35.408 17:09:32 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:35.408 17:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.408 17:09:32 -- common/autotest_common.sh@10 -- # set +x 00:16:35.408 17:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.408 17:09:32 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:35.408 17:09:32 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:35.408 17:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.408 17:09:32 -- common/autotest_common.sh@10 -- # set +x 00:16:35.408 malloc0 00:16:35.408 17:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.408 17:09:32 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:35.408 17:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.408 17:09:32 -- common/autotest_common.sh@10 -- # set +x 00:16:35.408 17:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.408 17:09:32 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:35.408 17:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.408 17:09:32 -- common/autotest_common.sh@10 -- # set +x 00:16:35.408 17:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.408 17:09:32 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:35.408 17:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.408 17:09:32 -- common/autotest_common.sh@10 -- # set +x 00:16:35.408 17:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.408 17:09:32 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:35.408 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.408 00:16:35.408 00:16:35.408 CUnit - A unit testing framework for C - Version 2.1-3 00:16:35.408 http://cunit.sourceforge.net/ 00:16:35.408 00:16:35.408 00:16:35.408 Suite: nvme_compliance 00:16:35.408 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-27 17:09:32.313330] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:35.408 [2024-11-27 17:09:32.313391] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:35.408 [2024-11-27 17:09:32.313420] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:35.408 passed 00:16:35.665 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:35.665 Test: admin_identify_ns ...[2024-11-27 17:09:32.548557] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:35.665 [2024-11-27 17:09:32.556542] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:35.665 passed 00:16:35.923 Test: admin_get_features_mandatory_features ...passed 00:16:35.923 Test: admin_get_features_optional_features ...passed 00:16:36.181 Test: admin_set_features_number_of_queues ...passed 00:16:36.181 Test: admin_get_log_page_mandatory_logs ...passed 00:16:36.438 Test: admin_get_log_page_with_lpo ...[2024-11-27 17:09:33.180552] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:36.438 passed 00:16:36.438 Test: fabric_property_get ...passed 00:16:36.438 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-27 17:09:33.365828] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:36.696 passed 00:16:36.696 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-27 17:09:33.536536] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:36.696 [2024-11-27 17:09:33.552538] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:36.696 passed 00:16:36.696 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-27 17:09:33.640578] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:36.953 passed 00:16:36.954 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-27 17:09:33.803538] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:36.954 [2024-11-27 17:09:33.827538] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:36.954 passed 00:16:37.211 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-27 17:09:33.917660] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:37.211 [2024-11-27 17:09:33.917721] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:37.211 passed 00:16:37.211 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-27 17:09:34.096554] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:37.211 [2024-11-27 17:09:34.102540] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:37.211 [2024-11-27 17:09:34.112540] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:37.211 [2024-11-27 17:09:34.120534] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:37.469 passed 00:16:37.469 Test: admin_create_io_sq_verify_pc ...[2024-11-27 17:09:34.251548] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:37.469 passed 00:16:38.840 Test: admin_create_io_qp_max_qps ...[2024-11-27 17:09:35.453542] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:39.097 passed 00:16:39.098 Test: admin_create_io_sq_shared_cq ...[2024-11-27 17:09:36.043534] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:39.354 passed 00:16:39.354 00:16:39.354 Run Summary: Type Total Ran Passed Failed Inactive 00:16:39.354 suites 1 1 n/a 0 0 00:16:39.354 tests 18 18 18 0 0 00:16:39.354 asserts 360 360 360 0 n/a 00:16:39.354 00:16:39.354 Elapsed time = 1.561 seconds 00:16:39.354 17:09:36 -- compliance/compliance.sh@42 -- # killprocess 1722790 00:16:39.354 17:09:36 -- common/autotest_common.sh@936 -- # '[' -z 1722790 ']' 00:16:39.354 17:09:36 -- common/autotest_common.sh@940 -- # kill -0 1722790 00:16:39.354 17:09:36 -- common/autotest_common.sh@941 -- # uname 00:16:39.354 17:09:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:39.354 17:09:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1722790 00:16:39.354 17:09:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:39.355 17:09:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:39.355 17:09:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1722790' 00:16:39.355 killing process with pid 1722790 00:16:39.355 17:09:36 -- common/autotest_common.sh@955 -- # kill 1722790 00:16:39.355 17:09:36 -- common/autotest_common.sh@960 -- # wait 1722790 00:16:39.612 17:09:36 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:39.612 17:09:36 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:39.612 00:16:39.612 real 0m6.533s 00:16:39.612 user 0m18.555s 00:16:39.612 sys 0m0.607s 00:16:39.612 17:09:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:39.612 17:09:36 -- common/autotest_common.sh@10 -- # set +x 00:16:39.612 ************************************ 00:16:39.612 END TEST nvmf_vfio_user_nvme_compliance 00:16:39.612 ************************************ 00:16:39.612 17:09:36 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:39.612 17:09:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:39.612 17:09:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:39.612 17:09:36 -- common/autotest_common.sh@10 -- # set +x 00:16:39.612 ************************************ 00:16:39.612 START TEST nvmf_vfio_user_fuzz 00:16:39.612 ************************************ 00:16:39.612 17:09:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:39.612 * Looking for test storage... 00:16:39.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:39.612 17:09:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:39.612 17:09:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:39.612 17:09:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:39.612 17:09:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:39.613 17:09:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:39.613 17:09:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:39.613 17:09:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:39.613 17:09:36 -- scripts/common.sh@335 -- # IFS=.-: 00:16:39.613 17:09:36 -- scripts/common.sh@335 -- # read -ra ver1 00:16:39.613 17:09:36 -- scripts/common.sh@336 -- # IFS=.-: 00:16:39.613 17:09:36 -- scripts/common.sh@336 -- # read -ra ver2 00:16:39.613 17:09:36 -- scripts/common.sh@337 -- # local 'op=<' 00:16:39.613 17:09:36 -- scripts/common.sh@339 -- # ver1_l=2 00:16:39.613 17:09:36 -- scripts/common.sh@340 -- # ver2_l=1 00:16:39.613 17:09:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:39.613 17:09:36 -- scripts/common.sh@343 -- # case "$op" in 00:16:39.613 17:09:36 -- scripts/common.sh@344 -- # : 1 00:16:39.613 17:09:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:39.613 17:09:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:39.613 17:09:36 -- scripts/common.sh@364 -- # decimal 1 00:16:39.613 17:09:36 -- scripts/common.sh@352 -- # local d=1 00:16:39.613 17:09:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:39.613 17:09:36 -- scripts/common.sh@354 -- # echo 1 00:16:39.613 17:09:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:39.613 17:09:36 -- scripts/common.sh@365 -- # decimal 2 00:16:39.613 17:09:36 -- scripts/common.sh@352 -- # local d=2 00:16:39.613 17:09:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:39.613 17:09:36 -- scripts/common.sh@354 -- # echo 2 00:16:39.613 17:09:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:39.613 17:09:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:39.613 17:09:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:39.613 17:09:36 -- scripts/common.sh@367 -- # return 0 00:16:39.613 17:09:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:39.613 17:09:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:39.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.613 --rc genhtml_branch_coverage=1 00:16:39.613 --rc genhtml_function_coverage=1 00:16:39.613 --rc genhtml_legend=1 00:16:39.613 --rc geninfo_all_blocks=1 00:16:39.613 --rc geninfo_unexecuted_blocks=1 00:16:39.613 00:16:39.613 ' 00:16:39.613 17:09:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:39.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.613 --rc genhtml_branch_coverage=1 00:16:39.613 --rc genhtml_function_coverage=1 00:16:39.613 --rc genhtml_legend=1 00:16:39.613 --rc geninfo_all_blocks=1 00:16:39.613 --rc geninfo_unexecuted_blocks=1 00:16:39.613 00:16:39.613 ' 00:16:39.613 17:09:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:39.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.613 --rc genhtml_branch_coverage=1 00:16:39.613 --rc genhtml_function_coverage=1 00:16:39.613 --rc genhtml_legend=1 00:16:39.613 --rc geninfo_all_blocks=1 00:16:39.613 --rc geninfo_unexecuted_blocks=1 00:16:39.613 00:16:39.613 ' 00:16:39.613 17:09:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:39.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.613 --rc genhtml_branch_coverage=1 00:16:39.613 --rc genhtml_function_coverage=1 00:16:39.613 --rc genhtml_legend=1 00:16:39.613 --rc geninfo_all_blocks=1 00:16:39.613 --rc geninfo_unexecuted_blocks=1 00:16:39.613 00:16:39.613 ' 00:16:39.613 17:09:36 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:39.613 17:09:36 -- nvmf/common.sh@7 -- # uname -s 00:16:39.871 17:09:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:39.871 17:09:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:39.871 17:09:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:39.871 17:09:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:39.871 17:09:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:39.871 17:09:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:39.871 17:09:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:39.871 17:09:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:39.871 17:09:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:39.871 17:09:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:39.871 17:09:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.871 17:09:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.871 17:09:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:39.871 17:09:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:39.871 17:09:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:39.871 17:09:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:39.871 17:09:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:39.871 17:09:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:39.871 17:09:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:39.871 17:09:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.871 17:09:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.871 17:09:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.871 17:09:36 -- paths/export.sh@5 -- # export PATH 00:16:39.871 17:09:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.871 17:09:36 -- nvmf/common.sh@46 -- # : 0 00:16:39.871 17:09:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:39.871 17:09:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:39.871 17:09:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:39.871 17:09:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:39.871 17:09:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:39.871 17:09:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:39.871 17:09:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:39.871 17:09:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:39.871 17:09:36 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:39.871 17:09:36 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1723664 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1723664' 00:16:39.872 Process pid: 1723664 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:39.872 17:09:36 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1723664 00:16:39.872 17:09:36 -- common/autotest_common.sh@829 -- # '[' -z 1723664 ']' 00:16:39.872 17:09:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:39.872 17:09:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:39.872 17:09:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:39.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:39.872 17:09:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:39.872 17:09:36 -- common/autotest_common.sh@10 -- # set +x 00:16:40.804 17:09:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:40.804 17:09:37 -- common/autotest_common.sh@862 -- # return 0 00:16:40.804 17:09:37 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:41.736 17:09:38 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:41.736 17:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.736 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:16:41.736 17:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.736 17:09:38 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:41.736 17:09:38 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:41.736 17:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.736 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:16:41.736 malloc0 00:16:41.736 17:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.736 17:09:38 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:41.736 17:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.737 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:16:41.737 17:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.737 17:09:38 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:41.737 17:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.737 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:16:41.997 17:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.997 17:09:38 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:41.997 17:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.997 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:16:41.997 17:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.997 17:09:38 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:41.997 17:09:38 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:14.059 Fuzzing completed. Shutting down the fuzz application 00:17:14.059 00:17:14.059 Dumping successful admin opcodes: 00:17:14.059 8, 9, 10, 24, 00:17:14.059 Dumping successful io opcodes: 00:17:14.059 0, 00:17:14.059 NS: 0x200003a1ef00 I/O qp, Total commands completed: 601551, total successful commands: 2325, random_seed: 3132157952 00:17:14.059 NS: 0x200003a1ef00 admin qp, Total commands completed: 150186, total successful commands: 1205, random_seed: 705216064 00:17:14.059 17:10:09 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:14.059 17:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.059 17:10:09 -- common/autotest_common.sh@10 -- # set +x 00:17:14.059 17:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.059 17:10:09 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1723664 00:17:14.059 17:10:09 -- common/autotest_common.sh@936 -- # '[' -z 1723664 ']' 00:17:14.059 17:10:09 -- common/autotest_common.sh@940 -- # kill -0 1723664 00:17:14.059 17:10:09 -- common/autotest_common.sh@941 -- # uname 00:17:14.059 17:10:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:14.059 17:10:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1723664 00:17:14.059 17:10:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:14.059 17:10:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:14.059 17:10:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1723664' 00:17:14.059 killing process with pid 1723664 00:17:14.059 17:10:09 -- common/autotest_common.sh@955 -- # kill 1723664 00:17:14.059 17:10:09 -- common/autotest_common.sh@960 -- # wait 1723664 00:17:14.059 17:10:09 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:14.059 17:10:09 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:14.059 00:17:14.059 real 0m33.061s 00:17:14.059 user 0m34.824s 00:17:14.059 sys 0m26.800s 00:17:14.059 17:10:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:14.059 17:10:09 -- common/autotest_common.sh@10 -- # set +x 00:17:14.059 ************************************ 00:17:14.059 END TEST nvmf_vfio_user_fuzz 00:17:14.059 ************************************ 00:17:14.059 17:10:09 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:14.059 17:10:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:14.059 17:10:09 -- common/autotest_common.sh@10 -- # set +x 00:17:14.059 ************************************ 00:17:14.059 START TEST nvmf_host_management 00:17:14.059 ************************************ 00:17:14.059 17:10:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:14.059 * Looking for test storage... 00:17:14.059 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:14.059 17:10:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:14.059 17:10:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:14.059 17:10:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:14.059 17:10:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:14.059 17:10:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:14.059 17:10:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:14.059 17:10:09 -- scripts/common.sh@335 -- # IFS=.-: 00:17:14.059 17:10:09 -- scripts/common.sh@335 -- # read -ra ver1 00:17:14.059 17:10:09 -- scripts/common.sh@336 -- # IFS=.-: 00:17:14.059 17:10:09 -- scripts/common.sh@336 -- # read -ra ver2 00:17:14.059 17:10:09 -- scripts/common.sh@337 -- # local 'op=<' 00:17:14.059 17:10:09 -- scripts/common.sh@339 -- # ver1_l=2 00:17:14.059 17:10:09 -- scripts/common.sh@340 -- # ver2_l=1 00:17:14.059 17:10:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:14.059 17:10:09 -- scripts/common.sh@343 -- # case "$op" in 00:17:14.059 17:10:09 -- scripts/common.sh@344 -- # : 1 00:17:14.059 17:10:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:14.059 17:10:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:14.059 17:10:09 -- scripts/common.sh@364 -- # decimal 1 00:17:14.059 17:10:09 -- scripts/common.sh@352 -- # local d=1 00:17:14.059 17:10:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:14.059 17:10:09 -- scripts/common.sh@354 -- # echo 1 00:17:14.059 17:10:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:14.059 17:10:09 -- scripts/common.sh@365 -- # decimal 2 00:17:14.059 17:10:09 -- scripts/common.sh@352 -- # local d=2 00:17:14.059 17:10:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:14.059 17:10:09 -- scripts/common.sh@354 -- # echo 2 00:17:14.059 17:10:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:14.059 17:10:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:14.059 17:10:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:14.059 17:10:09 -- scripts/common.sh@367 -- # return 0 00:17:14.059 17:10:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:14.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.059 --rc genhtml_branch_coverage=1 00:17:14.059 --rc genhtml_function_coverage=1 00:17:14.059 --rc genhtml_legend=1 00:17:14.059 --rc geninfo_all_blocks=1 00:17:14.059 --rc geninfo_unexecuted_blocks=1 00:17:14.059 00:17:14.059 ' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:14.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.059 --rc genhtml_branch_coverage=1 00:17:14.059 --rc genhtml_function_coverage=1 00:17:14.059 --rc genhtml_legend=1 00:17:14.059 --rc geninfo_all_blocks=1 00:17:14.059 --rc geninfo_unexecuted_blocks=1 00:17:14.059 00:17:14.059 ' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:14.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.059 --rc genhtml_branch_coverage=1 00:17:14.059 --rc genhtml_function_coverage=1 00:17:14.059 --rc genhtml_legend=1 00:17:14.059 --rc geninfo_all_blocks=1 00:17:14.059 --rc geninfo_unexecuted_blocks=1 00:17:14.059 00:17:14.059 ' 00:17:14.059 17:10:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:14.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.059 --rc genhtml_branch_coverage=1 00:17:14.059 --rc genhtml_function_coverage=1 00:17:14.059 --rc genhtml_legend=1 00:17:14.059 --rc geninfo_all_blocks=1 00:17:14.059 --rc geninfo_unexecuted_blocks=1 00:17:14.059 00:17:14.059 ' 00:17:14.059 17:10:09 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:14.060 17:10:09 -- nvmf/common.sh@7 -- # uname -s 00:17:14.060 17:10:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:14.060 17:10:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:14.060 17:10:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:14.060 17:10:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:14.060 17:10:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:14.060 17:10:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:14.060 17:10:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:14.060 17:10:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:14.060 17:10:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:14.060 17:10:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:14.060 17:10:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:14.060 17:10:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:14.060 17:10:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:14.060 17:10:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:14.060 17:10:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:14.060 17:10:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:14.060 17:10:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:14.060 17:10:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:14.060 17:10:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:14.060 17:10:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.060 17:10:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.060 17:10:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.060 17:10:09 -- paths/export.sh@5 -- # export PATH 00:17:14.060 17:10:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.060 17:10:09 -- nvmf/common.sh@46 -- # : 0 00:17:14.060 17:10:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:14.060 17:10:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:14.060 17:10:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:14.060 17:10:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:14.060 17:10:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:14.060 17:10:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:14.060 17:10:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:14.060 17:10:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:14.060 17:10:09 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:14.060 17:10:09 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:14.060 17:10:09 -- target/host_management.sh@104 -- # nvmftestinit 00:17:14.060 17:10:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:14.060 17:10:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:14.060 17:10:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:14.060 17:10:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:14.060 17:10:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:14.060 17:10:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:14.060 17:10:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:14.060 17:10:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:14.060 17:10:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:14.060 17:10:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:14.060 17:10:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:14.060 17:10:09 -- common/autotest_common.sh@10 -- # set +x 00:17:14.995 17:10:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.995 17:10:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:14.995 17:10:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:14.995 17:10:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:14.995 17:10:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:14.995 17:10:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:14.995 17:10:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:14.995 17:10:11 -- nvmf/common.sh@294 -- # net_devs=() 00:17:14.995 17:10:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:14.995 17:10:11 -- nvmf/common.sh@295 -- # e810=() 00:17:14.995 17:10:11 -- nvmf/common.sh@295 -- # local -ga e810 00:17:14.995 17:10:11 -- nvmf/common.sh@296 -- # x722=() 00:17:14.995 17:10:11 -- nvmf/common.sh@296 -- # local -ga x722 00:17:14.995 17:10:11 -- nvmf/common.sh@297 -- # mlx=() 00:17:14.995 17:10:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:14.995 17:10:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.995 17:10:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:14.995 17:10:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:14.995 17:10:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:14.995 17:10:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:14.995 17:10:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:14.995 17:10:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:14.995 17:10:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.995 17:10:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:14.995 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:14.995 17:10:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.996 17:10:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:14.996 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:14.996 17:10:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:14.996 17:10:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.996 17:10:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.996 17:10:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.996 17:10:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.996 17:10:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:14.996 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:14.996 17:10:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.996 17:10:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.996 17:10:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.996 17:10:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.996 17:10:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.996 17:10:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:14.996 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:14.996 17:10:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.996 17:10:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:14.996 17:10:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:14.996 17:10:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:14.996 17:10:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:14.996 17:10:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:14.996 17:10:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:14.996 17:10:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:14.996 17:10:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.996 17:10:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.996 17:10:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.996 17:10:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.996 17:10:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.996 17:10:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.996 17:10:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.996 17:10:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.996 17:10:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.996 17:10:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.996 17:10:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.996 17:10:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.996 17:10:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.996 17:10:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.996 17:10:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.996 17:10:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.996 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.996 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:17:14.996 00:17:14.996 --- 10.0.0.2 ping statistics --- 00:17:14.996 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.996 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:17:14.996 17:10:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.996 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.996 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:17:14.996 00:17:14.996 --- 10.0.0.1 ping statistics --- 00:17:14.996 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.996 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:17:14.996 17:10:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.996 17:10:11 -- nvmf/common.sh@410 -- # return 0 00:17:14.996 17:10:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.996 17:10:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.996 17:10:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.996 17:10:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.996 17:10:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.996 17:10:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.996 17:10:11 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:14.996 17:10:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:14.996 17:10:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:14.996 17:10:11 -- common/autotest_common.sh@10 -- # set +x 00:17:14.996 ************************************ 00:17:14.996 START TEST nvmf_host_management 00:17:14.996 ************************************ 00:17:14.996 17:10:11 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:14.996 17:10:11 -- target/host_management.sh@69 -- # starttarget 00:17:14.996 17:10:11 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:14.996 17:10:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.996 17:10:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:14.996 17:10:11 -- common/autotest_common.sh@10 -- # set +x 00:17:14.996 17:10:11 -- nvmf/common.sh@469 -- # nvmfpid=1729253 00:17:14.996 17:10:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:14.996 17:10:11 -- nvmf/common.sh@470 -- # waitforlisten 1729253 00:17:14.996 17:10:11 -- common/autotest_common.sh@829 -- # '[' -z 1729253 ']' 00:17:14.996 17:10:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.996 17:10:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.996 17:10:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.996 17:10:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.996 17:10:11 -- common/autotest_common.sh@10 -- # set +x 00:17:15.254 [2024-11-27 17:10:11.960191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:15.254 [2024-11-27 17:10:11.960265] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:15.254 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.254 [2024-11-27 17:10:12.027874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:15.254 [2024-11-27 17:10:12.113295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:15.254 [2024-11-27 17:10:12.113451] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:15.254 [2024-11-27 17:10:12.113469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:15.255 [2024-11-27 17:10:12.113482] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:15.255 [2024-11-27 17:10:12.113571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.255 [2024-11-27 17:10:12.113633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:15.255 [2024-11-27 17:10:12.113666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:15.255 [2024-11-27 17:10:12.113670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:16.188 17:10:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.188 17:10:12 -- common/autotest_common.sh@862 -- # return 0 00:17:16.188 17:10:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:16.188 17:10:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:16.188 17:10:12 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 17:10:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:16.189 17:10:12 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:16.189 17:10:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.189 17:10:12 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 [2024-11-27 17:10:12.949232] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:16.189 17:10:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.189 17:10:12 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:16.189 17:10:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:16.189 17:10:12 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 17:10:12 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:16.189 17:10:12 -- target/host_management.sh@23 -- # cat 00:17:16.189 17:10:12 -- target/host_management.sh@30 -- # rpc_cmd 00:17:16.189 17:10:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.189 17:10:12 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 Malloc0 00:17:16.189 [2024-11-27 17:10:13.010405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.189 17:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.189 17:10:13 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:16.189 17:10:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:16.189 17:10:13 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 17:10:13 -- target/host_management.sh@73 -- # perfpid=1729430 00:17:16.189 17:10:13 -- target/host_management.sh@74 -- # waitforlisten 1729430 /var/tmp/bdevperf.sock 00:17:16.189 17:10:13 -- common/autotest_common.sh@829 -- # '[' -z 1729430 ']' 00:17:16.189 17:10:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.189 17:10:13 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:16.189 17:10:13 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:16.189 17:10:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:16.189 17:10:13 -- nvmf/common.sh@520 -- # config=() 00:17:16.189 17:10:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.189 17:10:13 -- nvmf/common.sh@520 -- # local subsystem config 00:17:16.189 17:10:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:16.189 17:10:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:16.189 17:10:13 -- common/autotest_common.sh@10 -- # set +x 00:17:16.189 17:10:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:16.189 { 00:17:16.189 "params": { 00:17:16.189 "name": "Nvme$subsystem", 00:17:16.189 "trtype": "$TEST_TRANSPORT", 00:17:16.189 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.189 "adrfam": "ipv4", 00:17:16.189 "trsvcid": "$NVMF_PORT", 00:17:16.189 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.189 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.189 "hdgst": ${hdgst:-false}, 00:17:16.189 "ddgst": ${ddgst:-false} 00:17:16.189 }, 00:17:16.189 "method": "bdev_nvme_attach_controller" 00:17:16.189 } 00:17:16.189 EOF 00:17:16.189 )") 00:17:16.189 17:10:13 -- nvmf/common.sh@542 -- # cat 00:17:16.189 17:10:13 -- nvmf/common.sh@544 -- # jq . 00:17:16.189 17:10:13 -- nvmf/common.sh@545 -- # IFS=, 00:17:16.189 17:10:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:16.189 "params": { 00:17:16.189 "name": "Nvme0", 00:17:16.189 "trtype": "tcp", 00:17:16.189 "traddr": "10.0.0.2", 00:17:16.189 "adrfam": "ipv4", 00:17:16.189 "trsvcid": "4420", 00:17:16.189 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:16.189 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:16.189 "hdgst": false, 00:17:16.189 "ddgst": false 00:17:16.189 }, 00:17:16.189 "method": "bdev_nvme_attach_controller" 00:17:16.189 }' 00:17:16.189 [2024-11-27 17:10:13.087306] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:16.189 [2024-11-27 17:10:13.087392] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1729430 ] 00:17:16.189 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.447 [2024-11-27 17:10:13.147904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.447 [2024-11-27 17:10:13.233157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:16.705 Running I/O for 10 seconds... 00:17:17.273 17:10:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.273 17:10:14 -- common/autotest_common.sh@862 -- # return 0 00:17:17.273 17:10:14 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:17.273 17:10:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.273 17:10:14 -- common/autotest_common.sh@10 -- # set +x 00:17:17.273 17:10:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.273 17:10:14 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:17.273 17:10:14 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:17.273 17:10:14 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:17.273 17:10:14 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:17.273 17:10:14 -- target/host_management.sh@52 -- # local ret=1 00:17:17.273 17:10:14 -- target/host_management.sh@53 -- # local i 00:17:17.273 17:10:14 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:17.273 17:10:14 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:17.273 17:10:14 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:17.273 17:10:14 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:17.273 17:10:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.273 17:10:14 -- common/autotest_common.sh@10 -- # set +x 00:17:17.273 17:10:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.273 17:10:14 -- target/host_management.sh@55 -- # read_io_count=2411 00:17:17.273 17:10:14 -- target/host_management.sh@58 -- # '[' 2411 -ge 100 ']' 00:17:17.273 17:10:14 -- target/host_management.sh@59 -- # ret=0 00:17:17.273 17:10:14 -- target/host_management.sh@60 -- # break 00:17:17.273 17:10:14 -- target/host_management.sh@64 -- # return 0 00:17:17.273 17:10:14 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:17.273 17:10:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.274 17:10:14 -- common/autotest_common.sh@10 -- # set +x 00:17:17.274 [2024-11-27 17:10:14.102305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.102926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f3ad0 is same with the state(5) to be set 00:17:17.274 [2024-11-27 17:10:14.103336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:70528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:70656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:70784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:64000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:64256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:71040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:64384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.274 [2024-11-27 17:10:14.103668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:71168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.274 [2024-11-27 17:10:14.103682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:71296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:71552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:64512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:64640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:71680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:65024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.103979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.103996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:72192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:72320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:72576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:72832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:65152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:65280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:73600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.275 [2024-11-27 17:10:14.104711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.275 [2024-11-27 17:10:14.104727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.104981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.104997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:17.276 [2024-11-27 17:10:14.105456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:17.276 [2024-11-27 17:10:14.105601] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f1e630 was disconnected and freed. reset controller. 00:17:17.276 17:10:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.276 17:10:14 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:17.276 [2024-11-27 17:10:14.106832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:17.276 17:10:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.276 17:10:14 -- common/autotest_common.sh@10 -- # set +x 00:17:17.276 task offset: 69760 on job bdev=Nvme0n1 fails 00:17:17.276 00:17:17.276 Latency(us) 00:17:17.276 [2024-11-27T16:10:14.227Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:17.276 [2024-11-27T16:10:14.227Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:17.276 [2024-11-27T16:10:14.227Z] Job: Nvme0n1 ended in about 0.66 seconds with error 00:17:17.276 Verification LBA range: start 0x0 length 0x400 00:17:17.276 Nvme0n1 : 0.66 3896.74 243.55 96.93 0.00 15786.96 2694.26 21554.06 00:17:17.276 [2024-11-27T16:10:14.227Z] =================================================================================================================== 00:17:17.276 [2024-11-27T16:10:14.227Z] Total : 3896.74 243.55 96.93 0.00 15786.96 2694.26 21554.06 00:17:17.276 [2024-11-27 17:10:14.108769] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:17.276 [2024-11-27 17:10:14.108799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f241d0 (9): Bad file descriptor 00:17:17.276 17:10:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.276 17:10:14 -- target/host_management.sh@87 -- # sleep 1 00:17:17.276 [2024-11-27 17:10:14.119352] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:18.210 17:10:15 -- target/host_management.sh@91 -- # kill -9 1729430 00:17:18.210 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1729430) - No such process 00:17:18.210 17:10:15 -- target/host_management.sh@91 -- # true 00:17:18.210 17:10:15 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:18.210 17:10:15 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:18.210 17:10:15 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:18.210 17:10:15 -- nvmf/common.sh@520 -- # config=() 00:17:18.210 17:10:15 -- nvmf/common.sh@520 -- # local subsystem config 00:17:18.210 17:10:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:18.210 17:10:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:18.210 { 00:17:18.210 "params": { 00:17:18.210 "name": "Nvme$subsystem", 00:17:18.210 "trtype": "$TEST_TRANSPORT", 00:17:18.210 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.210 "adrfam": "ipv4", 00:17:18.210 "trsvcid": "$NVMF_PORT", 00:17:18.210 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.210 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.210 "hdgst": ${hdgst:-false}, 00:17:18.210 "ddgst": ${ddgst:-false} 00:17:18.210 }, 00:17:18.210 "method": "bdev_nvme_attach_controller" 00:17:18.210 } 00:17:18.210 EOF 00:17:18.210 )") 00:17:18.210 17:10:15 -- nvmf/common.sh@542 -- # cat 00:17:18.210 17:10:15 -- nvmf/common.sh@544 -- # jq . 00:17:18.210 17:10:15 -- nvmf/common.sh@545 -- # IFS=, 00:17:18.210 17:10:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:18.210 "params": { 00:17:18.210 "name": "Nvme0", 00:17:18.210 "trtype": "tcp", 00:17:18.210 "traddr": "10.0.0.2", 00:17:18.210 "adrfam": "ipv4", 00:17:18.210 "trsvcid": "4420", 00:17:18.210 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:18.210 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:18.210 "hdgst": false, 00:17:18.210 "ddgst": false 00:17:18.210 }, 00:17:18.210 "method": "bdev_nvme_attach_controller" 00:17:18.210 }' 00:17:18.469 [2024-11-27 17:10:15.161014] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:18.469 [2024-11-27 17:10:15.161105] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1729718 ] 00:17:18.469 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.469 [2024-11-27 17:10:15.220712] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.469 [2024-11-27 17:10:15.307438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:18.727 Running I/O for 1 seconds... 00:17:19.659 00:17:19.659 Latency(us) 00:17:19.659 [2024-11-27T16:10:16.610Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.659 [2024-11-27T16:10:16.610Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:19.659 Verification LBA range: start 0x0 length 0x400 00:17:19.659 Nvme0n1 : 1.05 3947.99 246.75 0.00 0.00 15344.85 3252.53 44855.75 00:17:19.659 [2024-11-27T16:10:16.610Z] =================================================================================================================== 00:17:19.659 [2024-11-27T16:10:16.610Z] Total : 3947.99 246.75 0.00 0.00 15344.85 3252.53 44855.75 00:17:19.917 17:10:16 -- target/host_management.sh@101 -- # stoptarget 00:17:19.917 17:10:16 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:19.917 17:10:16 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:19.917 17:10:16 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:19.917 17:10:16 -- target/host_management.sh@40 -- # nvmftestfini 00:17:19.917 17:10:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:19.917 17:10:16 -- nvmf/common.sh@116 -- # sync 00:17:19.917 17:10:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:19.917 17:10:16 -- nvmf/common.sh@119 -- # set +e 00:17:19.917 17:10:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:19.917 17:10:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:19.917 rmmod nvme_tcp 00:17:19.917 rmmod nvme_fabrics 00:17:19.917 rmmod nvme_keyring 00:17:19.917 17:10:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:19.917 17:10:16 -- nvmf/common.sh@123 -- # set -e 00:17:19.917 17:10:16 -- nvmf/common.sh@124 -- # return 0 00:17:19.917 17:10:16 -- nvmf/common.sh@477 -- # '[' -n 1729253 ']' 00:17:19.917 17:10:16 -- nvmf/common.sh@478 -- # killprocess 1729253 00:17:19.917 17:10:16 -- common/autotest_common.sh@936 -- # '[' -z 1729253 ']' 00:17:19.917 17:10:16 -- common/autotest_common.sh@940 -- # kill -0 1729253 00:17:19.917 17:10:16 -- common/autotest_common.sh@941 -- # uname 00:17:19.917 17:10:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.917 17:10:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1729253 00:17:19.917 17:10:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:19.917 17:10:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:19.917 17:10:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1729253' 00:17:19.917 killing process with pid 1729253 00:17:19.917 17:10:16 -- common/autotest_common.sh@955 -- # kill 1729253 00:17:19.917 17:10:16 -- common/autotest_common.sh@960 -- # wait 1729253 00:17:20.208 [2024-11-27 17:10:17.087167] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:20.208 17:10:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:20.208 17:10:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:20.208 17:10:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:20.208 17:10:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:20.208 17:10:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:20.208 17:10:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:20.208 17:10:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:20.208 17:10:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:22.764 17:10:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:22.764 00:17:22.764 real 0m7.250s 00:17:22.764 user 0m22.278s 00:17:22.764 sys 0m1.423s 00:17:22.764 17:10:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:22.764 17:10:19 -- common/autotest_common.sh@10 -- # set +x 00:17:22.764 ************************************ 00:17:22.764 END TEST nvmf_host_management 00:17:22.764 ************************************ 00:17:22.764 17:10:19 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:22.764 00:17:22.764 real 0m9.660s 00:17:22.764 user 0m23.197s 00:17:22.764 sys 0m2.953s 00:17:22.764 17:10:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:22.764 17:10:19 -- common/autotest_common.sh@10 -- # set +x 00:17:22.764 ************************************ 00:17:22.764 END TEST nvmf_host_management 00:17:22.764 ************************************ 00:17:22.764 17:10:19 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:22.764 17:10:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:22.764 17:10:19 -- common/autotest_common.sh@10 -- # set +x 00:17:22.764 ************************************ 00:17:22.764 START TEST nvmf_lvol 00:17:22.764 ************************************ 00:17:22.764 17:10:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:22.764 * Looking for test storage... 00:17:22.764 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:22.764 17:10:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:22.764 17:10:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:22.764 17:10:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:22.764 17:10:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:22.764 17:10:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:22.764 17:10:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:22.764 17:10:19 -- scripts/common.sh@335 -- # IFS=.-: 00:17:22.764 17:10:19 -- scripts/common.sh@335 -- # read -ra ver1 00:17:22.764 17:10:19 -- scripts/common.sh@336 -- # IFS=.-: 00:17:22.764 17:10:19 -- scripts/common.sh@336 -- # read -ra ver2 00:17:22.764 17:10:19 -- scripts/common.sh@337 -- # local 'op=<' 00:17:22.764 17:10:19 -- scripts/common.sh@339 -- # ver1_l=2 00:17:22.764 17:10:19 -- scripts/common.sh@340 -- # ver2_l=1 00:17:22.764 17:10:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:22.764 17:10:19 -- scripts/common.sh@343 -- # case "$op" in 00:17:22.764 17:10:19 -- scripts/common.sh@344 -- # : 1 00:17:22.764 17:10:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:22.764 17:10:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:22.764 17:10:19 -- scripts/common.sh@364 -- # decimal 1 00:17:22.764 17:10:19 -- scripts/common.sh@352 -- # local d=1 00:17:22.764 17:10:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:22.764 17:10:19 -- scripts/common.sh@354 -- # echo 1 00:17:22.764 17:10:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:22.764 17:10:19 -- scripts/common.sh@365 -- # decimal 2 00:17:22.764 17:10:19 -- scripts/common.sh@352 -- # local d=2 00:17:22.764 17:10:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:22.764 17:10:19 -- scripts/common.sh@354 -- # echo 2 00:17:22.764 17:10:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:22.764 17:10:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:22.764 17:10:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:22.764 17:10:19 -- scripts/common.sh@367 -- # return 0 00:17:22.764 17:10:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:22.764 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.764 --rc genhtml_branch_coverage=1 00:17:22.764 --rc genhtml_function_coverage=1 00:17:22.764 --rc genhtml_legend=1 00:17:22.764 --rc geninfo_all_blocks=1 00:17:22.764 --rc geninfo_unexecuted_blocks=1 00:17:22.764 00:17:22.764 ' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:22.764 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.764 --rc genhtml_branch_coverage=1 00:17:22.764 --rc genhtml_function_coverage=1 00:17:22.764 --rc genhtml_legend=1 00:17:22.764 --rc geninfo_all_blocks=1 00:17:22.764 --rc geninfo_unexecuted_blocks=1 00:17:22.764 00:17:22.764 ' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:22.764 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.764 --rc genhtml_branch_coverage=1 00:17:22.764 --rc genhtml_function_coverage=1 00:17:22.764 --rc genhtml_legend=1 00:17:22.764 --rc geninfo_all_blocks=1 00:17:22.764 --rc geninfo_unexecuted_blocks=1 00:17:22.764 00:17:22.764 ' 00:17:22.764 17:10:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:22.764 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.764 --rc genhtml_branch_coverage=1 00:17:22.764 --rc genhtml_function_coverage=1 00:17:22.764 --rc genhtml_legend=1 00:17:22.764 --rc geninfo_all_blocks=1 00:17:22.764 --rc geninfo_unexecuted_blocks=1 00:17:22.764 00:17:22.764 ' 00:17:22.764 17:10:19 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:22.764 17:10:19 -- nvmf/common.sh@7 -- # uname -s 00:17:22.764 17:10:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:22.764 17:10:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:22.764 17:10:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:22.764 17:10:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:22.764 17:10:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:22.764 17:10:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:22.764 17:10:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:22.764 17:10:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:22.764 17:10:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:22.764 17:10:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:22.764 17:10:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:22.764 17:10:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:22.764 17:10:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:22.764 17:10:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:22.764 17:10:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:22.764 17:10:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:22.764 17:10:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:22.764 17:10:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:22.764 17:10:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:22.765 17:10:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.765 17:10:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.765 17:10:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.765 17:10:19 -- paths/export.sh@5 -- # export PATH 00:17:22.765 17:10:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.765 17:10:19 -- nvmf/common.sh@46 -- # : 0 00:17:22.765 17:10:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:22.765 17:10:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:22.765 17:10:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:22.765 17:10:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:22.765 17:10:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:22.765 17:10:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:22.765 17:10:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:22.765 17:10:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:22.765 17:10:19 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:22.765 17:10:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:22.765 17:10:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:22.765 17:10:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:22.765 17:10:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:22.765 17:10:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:22.765 17:10:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:22.765 17:10:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:22.765 17:10:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:22.765 17:10:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:22.765 17:10:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:22.765 17:10:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:22.765 17:10:19 -- common/autotest_common.sh@10 -- # set +x 00:17:24.716 17:10:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:24.716 17:10:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:24.716 17:10:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:24.717 17:10:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:24.717 17:10:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:24.717 17:10:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:24.717 17:10:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:24.717 17:10:21 -- nvmf/common.sh@294 -- # net_devs=() 00:17:24.717 17:10:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:24.717 17:10:21 -- nvmf/common.sh@295 -- # e810=() 00:17:24.717 17:10:21 -- nvmf/common.sh@295 -- # local -ga e810 00:17:24.717 17:10:21 -- nvmf/common.sh@296 -- # x722=() 00:17:24.717 17:10:21 -- nvmf/common.sh@296 -- # local -ga x722 00:17:24.717 17:10:21 -- nvmf/common.sh@297 -- # mlx=() 00:17:24.717 17:10:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:24.717 17:10:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:24.717 17:10:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:24.717 17:10:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:24.717 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:24.717 17:10:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:24.717 17:10:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:24.717 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:24.717 17:10:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:24.717 17:10:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:24.717 17:10:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:24.717 17:10:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:24.717 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:24.717 17:10:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:24.717 17:10:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:24.717 17:10:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:24.717 17:10:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:24.717 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:24.717 17:10:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:24.717 17:10:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:24.717 17:10:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:24.717 17:10:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:24.717 17:10:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:24.717 17:10:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:24.717 17:10:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:24.717 17:10:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:24.717 17:10:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:24.717 17:10:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:24.717 17:10:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:24.717 17:10:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:24.717 17:10:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:24.717 17:10:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:24.717 17:10:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:24.717 17:10:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:24.717 17:10:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:24.717 17:10:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:24.717 17:10:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:24.717 17:10:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:24.717 17:10:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:24.717 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:24.717 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:17:24.717 00:17:24.717 --- 10.0.0.2 ping statistics --- 00:17:24.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:24.717 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:17:24.717 17:10:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:24.717 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:24.717 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:17:24.717 00:17:24.717 --- 10.0.0.1 ping statistics --- 00:17:24.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:24.717 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:17:24.717 17:10:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:24.717 17:10:21 -- nvmf/common.sh@410 -- # return 0 00:17:24.717 17:10:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:24.717 17:10:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:24.717 17:10:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:24.717 17:10:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:24.717 17:10:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:24.717 17:10:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:24.717 17:10:21 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:24.717 17:10:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:24.717 17:10:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:24.717 17:10:21 -- common/autotest_common.sh@10 -- # set +x 00:17:24.717 17:10:21 -- nvmf/common.sh@469 -- # nvmfpid=1731961 00:17:24.717 17:10:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:24.717 17:10:21 -- nvmf/common.sh@470 -- # waitforlisten 1731961 00:17:24.717 17:10:21 -- common/autotest_common.sh@829 -- # '[' -z 1731961 ']' 00:17:24.717 17:10:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:24.717 17:10:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:24.717 17:10:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:24.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:24.717 17:10:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:24.717 17:10:21 -- common/autotest_common.sh@10 -- # set +x 00:17:24.717 [2024-11-27 17:10:21.636852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:24.717 [2024-11-27 17:10:21.636917] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:24.976 EAL: No free 2048 kB hugepages reported on node 1 00:17:24.976 [2024-11-27 17:10:21.704511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:24.976 [2024-11-27 17:10:21.793628] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:24.976 [2024-11-27 17:10:21.793796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:24.976 [2024-11-27 17:10:21.793818] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:24.976 [2024-11-27 17:10:21.793833] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:24.976 [2024-11-27 17:10:21.793934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:24.976 [2024-11-27 17:10:21.793993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:24.976 [2024-11-27 17:10:21.793995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:25.909 17:10:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:25.909 17:10:22 -- common/autotest_common.sh@862 -- # return 0 00:17:25.909 17:10:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:25.909 17:10:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:25.909 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:17:25.909 17:10:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:25.909 17:10:22 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:26.166 [2024-11-27 17:10:22.915716] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.166 17:10:22 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:26.425 17:10:23 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:26.425 17:10:23 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:26.683 17:10:23 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:26.683 17:10:23 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:26.941 17:10:23 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:27.199 17:10:24 -- target/nvmf_lvol.sh@29 -- # lvs=947720d2-acd5-4b07-844d-92c62d07c520 00:17:27.199 17:10:24 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 947720d2-acd5-4b07-844d-92c62d07c520 lvol 20 00:17:27.457 17:10:24 -- target/nvmf_lvol.sh@32 -- # lvol=0b54135c-d6be-46dc-b0cd-bd687e153545 00:17:27.457 17:10:24 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:27.715 17:10:24 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 0b54135c-d6be-46dc-b0cd-bd687e153545 00:17:27.973 17:10:24 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:28.231 [2024-11-27 17:10:24.987606] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:28.231 17:10:25 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:28.488 17:10:25 -- target/nvmf_lvol.sh@42 -- # perf_pid=1732404 00:17:28.488 17:10:25 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:28.488 17:10:25 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:28.488 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.422 17:10:26 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 0b54135c-d6be-46dc-b0cd-bd687e153545 MY_SNAPSHOT 00:17:29.680 17:10:26 -- target/nvmf_lvol.sh@47 -- # snapshot=40750f3f-3d61-4479-a81f-89f50fd95308 00:17:29.680 17:10:26 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 0b54135c-d6be-46dc-b0cd-bd687e153545 30 00:17:30.247 17:10:26 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 40750f3f-3d61-4479-a81f-89f50fd95308 MY_CLONE 00:17:30.505 17:10:27 -- target/nvmf_lvol.sh@49 -- # clone=05bb2d85-1de0-4119-a7f1-b04bd341dda1 00:17:30.505 17:10:27 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 05bb2d85-1de0-4119-a7f1-b04bd341dda1 00:17:31.071 17:10:27 -- target/nvmf_lvol.sh@53 -- # wait 1732404 00:17:39.182 Initializing NVMe Controllers 00:17:39.182 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:39.182 Controller IO queue size 128, less than required. 00:17:39.182 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:39.182 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:39.182 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:39.182 Initialization complete. Launching workers. 00:17:39.182 ======================================================== 00:17:39.182 Latency(us) 00:17:39.182 Device Information : IOPS MiB/s Average min max 00:17:39.182 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10922.85 42.67 11720.64 480.94 76805.10 00:17:39.182 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10743.66 41.97 11916.41 1838.56 69673.11 00:17:39.182 ======================================================== 00:17:39.182 Total : 21666.51 84.63 11817.72 480.94 76805.10 00:17:39.182 00:17:39.182 17:10:35 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:39.182 17:10:35 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 0b54135c-d6be-46dc-b0cd-bd687e153545 00:17:39.440 17:10:36 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 947720d2-acd5-4b07-844d-92c62d07c520 00:17:39.697 17:10:36 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:39.697 17:10:36 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:39.697 17:10:36 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:39.697 17:10:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:39.698 17:10:36 -- nvmf/common.sh@116 -- # sync 00:17:39.698 17:10:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:39.698 17:10:36 -- nvmf/common.sh@119 -- # set +e 00:17:39.698 17:10:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:39.698 17:10:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:39.698 rmmod nvme_tcp 00:17:39.698 rmmod nvme_fabrics 00:17:39.698 rmmod nvme_keyring 00:17:39.698 17:10:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:39.698 17:10:36 -- nvmf/common.sh@123 -- # set -e 00:17:39.698 17:10:36 -- nvmf/common.sh@124 -- # return 0 00:17:39.698 17:10:36 -- nvmf/common.sh@477 -- # '[' -n 1731961 ']' 00:17:39.698 17:10:36 -- nvmf/common.sh@478 -- # killprocess 1731961 00:17:39.698 17:10:36 -- common/autotest_common.sh@936 -- # '[' -z 1731961 ']' 00:17:39.698 17:10:36 -- common/autotest_common.sh@940 -- # kill -0 1731961 00:17:39.698 17:10:36 -- common/autotest_common.sh@941 -- # uname 00:17:39.698 17:10:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.698 17:10:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1731961 00:17:39.698 17:10:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:39.698 17:10:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:39.698 17:10:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1731961' 00:17:39.698 killing process with pid 1731961 00:17:39.698 17:10:36 -- common/autotest_common.sh@955 -- # kill 1731961 00:17:39.698 17:10:36 -- common/autotest_common.sh@960 -- # wait 1731961 00:17:39.956 17:10:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:39.956 17:10:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:39.956 17:10:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:39.956 17:10:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:39.956 17:10:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:39.956 17:10:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.956 17:10:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:39.956 17:10:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.493 17:10:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:42.493 00:17:42.493 real 0m19.675s 00:17:42.493 user 1m6.792s 00:17:42.493 sys 0m5.475s 00:17:42.493 17:10:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:42.493 17:10:38 -- common/autotest_common.sh@10 -- # set +x 00:17:42.493 ************************************ 00:17:42.493 END TEST nvmf_lvol 00:17:42.493 ************************************ 00:17:42.493 17:10:38 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:42.494 17:10:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:42.494 17:10:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:42.494 17:10:38 -- common/autotest_common.sh@10 -- # set +x 00:17:42.494 ************************************ 00:17:42.494 START TEST nvmf_lvs_grow 00:17:42.494 ************************************ 00:17:42.494 17:10:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:42.494 * Looking for test storage... 00:17:42.494 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:42.494 17:10:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:42.494 17:10:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:42.494 17:10:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:42.494 17:10:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:42.494 17:10:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:42.494 17:10:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:42.494 17:10:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:42.494 17:10:39 -- scripts/common.sh@335 -- # IFS=.-: 00:17:42.494 17:10:39 -- scripts/common.sh@335 -- # read -ra ver1 00:17:42.494 17:10:39 -- scripts/common.sh@336 -- # IFS=.-: 00:17:42.494 17:10:39 -- scripts/common.sh@336 -- # read -ra ver2 00:17:42.494 17:10:39 -- scripts/common.sh@337 -- # local 'op=<' 00:17:42.494 17:10:39 -- scripts/common.sh@339 -- # ver1_l=2 00:17:42.494 17:10:39 -- scripts/common.sh@340 -- # ver2_l=1 00:17:42.494 17:10:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:42.494 17:10:39 -- scripts/common.sh@343 -- # case "$op" in 00:17:42.494 17:10:39 -- scripts/common.sh@344 -- # : 1 00:17:42.494 17:10:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:42.494 17:10:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:42.494 17:10:39 -- scripts/common.sh@364 -- # decimal 1 00:17:42.494 17:10:39 -- scripts/common.sh@352 -- # local d=1 00:17:42.494 17:10:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:42.494 17:10:39 -- scripts/common.sh@354 -- # echo 1 00:17:42.494 17:10:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:42.494 17:10:39 -- scripts/common.sh@365 -- # decimal 2 00:17:42.494 17:10:39 -- scripts/common.sh@352 -- # local d=2 00:17:42.494 17:10:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:42.494 17:10:39 -- scripts/common.sh@354 -- # echo 2 00:17:42.494 17:10:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:42.494 17:10:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:42.494 17:10:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:42.494 17:10:39 -- scripts/common.sh@367 -- # return 0 00:17:42.494 17:10:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:42.494 17:10:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:42.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.494 --rc genhtml_branch_coverage=1 00:17:42.494 --rc genhtml_function_coverage=1 00:17:42.494 --rc genhtml_legend=1 00:17:42.494 --rc geninfo_all_blocks=1 00:17:42.494 --rc geninfo_unexecuted_blocks=1 00:17:42.494 00:17:42.494 ' 00:17:42.494 17:10:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:42.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.494 --rc genhtml_branch_coverage=1 00:17:42.494 --rc genhtml_function_coverage=1 00:17:42.494 --rc genhtml_legend=1 00:17:42.494 --rc geninfo_all_blocks=1 00:17:42.494 --rc geninfo_unexecuted_blocks=1 00:17:42.494 00:17:42.494 ' 00:17:42.494 17:10:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:42.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.494 --rc genhtml_branch_coverage=1 00:17:42.494 --rc genhtml_function_coverage=1 00:17:42.494 --rc genhtml_legend=1 00:17:42.494 --rc geninfo_all_blocks=1 00:17:42.494 --rc geninfo_unexecuted_blocks=1 00:17:42.494 00:17:42.494 ' 00:17:42.494 17:10:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:42.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.494 --rc genhtml_branch_coverage=1 00:17:42.494 --rc genhtml_function_coverage=1 00:17:42.494 --rc genhtml_legend=1 00:17:42.494 --rc geninfo_all_blocks=1 00:17:42.494 --rc geninfo_unexecuted_blocks=1 00:17:42.494 00:17:42.494 ' 00:17:42.494 17:10:39 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:42.494 17:10:39 -- nvmf/common.sh@7 -- # uname -s 00:17:42.494 17:10:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:42.494 17:10:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:42.494 17:10:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:42.494 17:10:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:42.494 17:10:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:42.494 17:10:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:42.494 17:10:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:42.494 17:10:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:42.494 17:10:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:42.494 17:10:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:42.494 17:10:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.494 17:10:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.494 17:10:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:42.494 17:10:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:42.494 17:10:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:42.494 17:10:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:42.494 17:10:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:42.494 17:10:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:42.494 17:10:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:42.494 17:10:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.494 17:10:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.494 17:10:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.494 17:10:39 -- paths/export.sh@5 -- # export PATH 00:17:42.494 17:10:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.494 17:10:39 -- nvmf/common.sh@46 -- # : 0 00:17:42.494 17:10:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:42.494 17:10:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:42.494 17:10:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:42.494 17:10:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:42.494 17:10:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:42.494 17:10:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:42.494 17:10:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:42.494 17:10:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:42.494 17:10:39 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:42.494 17:10:39 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:42.494 17:10:39 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:42.494 17:10:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:42.494 17:10:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:42.494 17:10:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:42.494 17:10:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:42.494 17:10:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:42.494 17:10:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.494 17:10:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:42.494 17:10:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.494 17:10:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:42.494 17:10:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:42.494 17:10:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:42.494 17:10:39 -- common/autotest_common.sh@10 -- # set +x 00:17:44.397 17:10:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:44.397 17:10:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:44.397 17:10:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:44.397 17:10:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:44.397 17:10:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:44.397 17:10:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:44.397 17:10:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:44.397 17:10:41 -- nvmf/common.sh@294 -- # net_devs=() 00:17:44.397 17:10:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:44.397 17:10:41 -- nvmf/common.sh@295 -- # e810=() 00:17:44.397 17:10:41 -- nvmf/common.sh@295 -- # local -ga e810 00:17:44.397 17:10:41 -- nvmf/common.sh@296 -- # x722=() 00:17:44.397 17:10:41 -- nvmf/common.sh@296 -- # local -ga x722 00:17:44.397 17:10:41 -- nvmf/common.sh@297 -- # mlx=() 00:17:44.397 17:10:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:44.397 17:10:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:44.397 17:10:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:44.397 17:10:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:44.397 17:10:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:44.397 17:10:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.397 17:10:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:44.397 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:44.397 17:10:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.397 17:10:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:44.397 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:44.397 17:10:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:44.397 17:10:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:44.397 17:10:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.397 17:10:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.397 17:10:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.397 17:10:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.397 17:10:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:44.398 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:44.398 17:10:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.398 17:10:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.398 17:10:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.398 17:10:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.398 17:10:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.398 17:10:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:44.398 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:44.398 17:10:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.398 17:10:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:44.398 17:10:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:44.398 17:10:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:44.398 17:10:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:44.398 17:10:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:44.398 17:10:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:44.398 17:10:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:44.398 17:10:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:44.398 17:10:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:44.398 17:10:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:44.398 17:10:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:44.398 17:10:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:44.398 17:10:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:44.398 17:10:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:44.398 17:10:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:44.398 17:10:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:44.398 17:10:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:44.398 17:10:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:44.398 17:10:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:44.398 17:10:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:44.398 17:10:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:44.398 17:10:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:44.398 17:10:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:44.398 17:10:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:44.398 17:10:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:44.398 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:44.398 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:17:44.398 00:17:44.398 --- 10.0.0.2 ping statistics --- 00:17:44.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.398 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:17:44.398 17:10:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:44.398 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:44.398 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:17:44.398 00:17:44.398 --- 10.0.0.1 ping statistics --- 00:17:44.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.398 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:17:44.398 17:10:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:44.398 17:10:41 -- nvmf/common.sh@410 -- # return 0 00:17:44.398 17:10:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:44.398 17:10:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:44.398 17:10:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:44.398 17:10:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:44.398 17:10:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:44.398 17:10:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:44.398 17:10:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:44.398 17:10:41 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:44.398 17:10:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.398 17:10:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.398 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:17:44.657 17:10:41 -- nvmf/common.sh@469 -- # nvmfpid=1735719 00:17:44.657 17:10:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:44.657 17:10:41 -- nvmf/common.sh@470 -- # waitforlisten 1735719 00:17:44.657 17:10:41 -- common/autotest_common.sh@829 -- # '[' -z 1735719 ']' 00:17:44.657 17:10:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.657 17:10:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.657 17:10:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.657 17:10:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.657 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:17:44.657 [2024-11-27 17:10:41.394855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:44.657 [2024-11-27 17:10:41.394966] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.657 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.657 [2024-11-27 17:10:41.463555] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.657 [2024-11-27 17:10:41.553802] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:44.657 [2024-11-27 17:10:41.553954] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.657 [2024-11-27 17:10:41.553972] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.657 [2024-11-27 17:10:41.553985] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.657 [2024-11-27 17:10:41.554012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:45.591 17:10:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:45.591 17:10:42 -- common/autotest_common.sh@862 -- # return 0 00:17:45.591 17:10:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.591 17:10:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:45.591 17:10:42 -- common/autotest_common.sh@10 -- # set +x 00:17:45.591 17:10:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.591 17:10:42 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:45.861 [2024-11-27 17:10:42.657591] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:45.861 17:10:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:45.861 17:10:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:45.861 17:10:42 -- common/autotest_common.sh@10 -- # set +x 00:17:45.861 ************************************ 00:17:45.861 START TEST lvs_grow_clean 00:17:45.861 ************************************ 00:17:45.861 17:10:42 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:45.861 17:10:42 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:46.120 17:10:42 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:46.120 17:10:42 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:46.378 17:10:43 -- target/nvmf_lvs_grow.sh@28 -- # lvs=1e3111be-1426-4765-910e-ddd9add40c3f 00:17:46.378 17:10:43 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:17:46.378 17:10:43 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:46.637 17:10:43 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:46.637 17:10:43 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:46.637 17:10:43 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1e3111be-1426-4765-910e-ddd9add40c3f lvol 150 00:17:46.895 17:10:43 -- target/nvmf_lvs_grow.sh@33 -- # lvol=da61ff11-fd95-4c8e-979c-0e991e79008b 00:17:46.895 17:10:43 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:46.895 17:10:43 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:47.154 [2024-11-27 17:10:43.979868] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:47.154 [2024-11-27 17:10:43.979957] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:47.154 true 00:17:47.154 17:10:43 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:17:47.154 17:10:43 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:47.412 17:10:44 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:47.412 17:10:44 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:47.670 17:10:44 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 da61ff11-fd95-4c8e-979c-0e991e79008b 00:17:47.928 17:10:44 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:48.186 [2024-11-27 17:10:44.999019] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.186 17:10:45 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:48.444 17:10:45 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1736300 00:17:48.444 17:10:45 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:48.444 17:10:45 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:48.444 17:10:45 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1736300 /var/tmp/bdevperf.sock 00:17:48.444 17:10:45 -- common/autotest_common.sh@829 -- # '[' -z 1736300 ']' 00:17:48.444 17:10:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.444 17:10:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:48.444 17:10:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.444 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.444 17:10:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:48.444 17:10:45 -- common/autotest_common.sh@10 -- # set +x 00:17:48.444 [2024-11-27 17:10:45.305865] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:48.444 [2024-11-27 17:10:45.305934] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1736300 ] 00:17:48.444 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.444 [2024-11-27 17:10:45.367888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.702 [2024-11-27 17:10:45.458162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:49.635 17:10:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:49.635 17:10:46 -- common/autotest_common.sh@862 -- # return 0 00:17:49.635 17:10:46 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:49.893 Nvme0n1 00:17:49.893 17:10:46 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:50.152 [ 00:17:50.152 { 00:17:50.152 "name": "Nvme0n1", 00:17:50.152 "aliases": [ 00:17:50.152 "da61ff11-fd95-4c8e-979c-0e991e79008b" 00:17:50.152 ], 00:17:50.152 "product_name": "NVMe disk", 00:17:50.152 "block_size": 4096, 00:17:50.152 "num_blocks": 38912, 00:17:50.152 "uuid": "da61ff11-fd95-4c8e-979c-0e991e79008b", 00:17:50.152 "assigned_rate_limits": { 00:17:50.152 "rw_ios_per_sec": 0, 00:17:50.152 "rw_mbytes_per_sec": 0, 00:17:50.152 "r_mbytes_per_sec": 0, 00:17:50.152 "w_mbytes_per_sec": 0 00:17:50.152 }, 00:17:50.152 "claimed": false, 00:17:50.152 "zoned": false, 00:17:50.152 "supported_io_types": { 00:17:50.152 "read": true, 00:17:50.152 "write": true, 00:17:50.152 "unmap": true, 00:17:50.152 "write_zeroes": true, 00:17:50.152 "flush": true, 00:17:50.152 "reset": true, 00:17:50.152 "compare": true, 00:17:50.152 "compare_and_write": true, 00:17:50.152 "abort": true, 00:17:50.152 "nvme_admin": true, 00:17:50.152 "nvme_io": true 00:17:50.152 }, 00:17:50.152 "driver_specific": { 00:17:50.152 "nvme": [ 00:17:50.152 { 00:17:50.152 "trid": { 00:17:50.152 "trtype": "TCP", 00:17:50.152 "adrfam": "IPv4", 00:17:50.152 "traddr": "10.0.0.2", 00:17:50.152 "trsvcid": "4420", 00:17:50.152 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:50.152 }, 00:17:50.152 "ctrlr_data": { 00:17:50.152 "cntlid": 1, 00:17:50.152 "vendor_id": "0x8086", 00:17:50.152 "model_number": "SPDK bdev Controller", 00:17:50.152 "serial_number": "SPDK0", 00:17:50.152 "firmware_revision": "24.01.1", 00:17:50.152 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:50.152 "oacs": { 00:17:50.152 "security": 0, 00:17:50.152 "format": 0, 00:17:50.152 "firmware": 0, 00:17:50.152 "ns_manage": 0 00:17:50.152 }, 00:17:50.152 "multi_ctrlr": true, 00:17:50.152 "ana_reporting": false 00:17:50.152 }, 00:17:50.152 "vs": { 00:17:50.152 "nvme_version": "1.3" 00:17:50.152 }, 00:17:50.152 "ns_data": { 00:17:50.152 "id": 1, 00:17:50.152 "can_share": true 00:17:50.152 } 00:17:50.152 } 00:17:50.152 ], 00:17:50.152 "mp_policy": "active_passive" 00:17:50.152 } 00:17:50.152 } 00:17:50.152 ] 00:17:50.152 17:10:46 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1736451 00:17:50.152 17:10:46 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:50.152 17:10:46 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:50.152 Running I/O for 10 seconds... 00:17:51.527 Latency(us) 00:17:51.527 [2024-11-27T16:10:48.478Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.527 [2024-11-27T16:10:48.478Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:51.527 Nvme0n1 : 1.00 14644.00 57.20 0.00 0.00 0.00 0.00 0.00 00:17:51.527 [2024-11-27T16:10:48.478Z] =================================================================================================================== 00:17:51.527 [2024-11-27T16:10:48.478Z] Total : 14644.00 57.20 0.00 0.00 0.00 0.00 0.00 00:17:51.527 00:17:52.093 17:10:48 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:17:52.352 [2024-11-27T16:10:49.303Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:52.352 Nvme0n1 : 2.00 14791.50 57.78 0.00 0.00 0.00 0.00 0.00 00:17:52.352 [2024-11-27T16:10:49.303Z] =================================================================================================================== 00:17:52.352 [2024-11-27T16:10:49.303Z] Total : 14791.50 57.78 0.00 0.00 0.00 0.00 0.00 00:17:52.352 00:17:52.352 true 00:17:52.352 17:10:49 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:17:52.352 17:10:49 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:52.652 17:10:49 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:52.652 17:10:49 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:52.652 17:10:49 -- target/nvmf_lvs_grow.sh@65 -- # wait 1736451 00:17:53.239 [2024-11-27T16:10:50.190Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.239 Nvme0n1 : 3.00 15012.67 58.64 0.00 0.00 0.00 0.00 0.00 00:17:53.239 [2024-11-27T16:10:50.190Z] =================================================================================================================== 00:17:53.239 [2024-11-27T16:10:50.190Z] Total : 15012.67 58.64 0.00 0.00 0.00 0.00 0.00 00:17:53.239 00:17:54.173 [2024-11-27T16:10:51.124Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:54.173 Nvme0n1 : 4.00 15152.25 59.19 0.00 0.00 0.00 0.00 0.00 00:17:54.173 [2024-11-27T16:10:51.124Z] =================================================================================================================== 00:17:54.173 [2024-11-27T16:10:51.124Z] Total : 15152.25 59.19 0.00 0.00 0.00 0.00 0.00 00:17:54.173 00:17:55.547 [2024-11-27T16:10:52.498Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.547 Nvme0n1 : 5.00 15235.80 59.51 0.00 0.00 0.00 0.00 0.00 00:17:55.547 [2024-11-27T16:10:52.498Z] =================================================================================================================== 00:17:55.547 [2024-11-27T16:10:52.498Z] Total : 15235.80 59.51 0.00 0.00 0.00 0.00 0.00 00:17:55.547 00:17:56.482 [2024-11-27T16:10:53.433Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.482 Nvme0n1 : 6.00 15218.00 59.45 0.00 0.00 0.00 0.00 0.00 00:17:56.482 [2024-11-27T16:10:53.433Z] =================================================================================================================== 00:17:56.482 [2024-11-27T16:10:53.433Z] Total : 15218.00 59.45 0.00 0.00 0.00 0.00 0.00 00:17:56.482 00:17:57.416 [2024-11-27T16:10:54.367Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.416 Nvme0n1 : 7.00 15248.57 59.56 0.00 0.00 0.00 0.00 0.00 00:17:57.416 [2024-11-27T16:10:54.367Z] =================================================================================================================== 00:17:57.416 [2024-11-27T16:10:54.367Z] Total : 15248.57 59.56 0.00 0.00 0.00 0.00 0.00 00:17:57.416 00:17:58.350 [2024-11-27T16:10:55.301Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.350 Nvme0n1 : 8.00 15273.12 59.66 0.00 0.00 0.00 0.00 0.00 00:17:58.350 [2024-11-27T16:10:55.301Z] =================================================================================================================== 00:17:58.350 [2024-11-27T16:10:55.301Z] Total : 15273.12 59.66 0.00 0.00 0.00 0.00 0.00 00:17:58.350 00:17:59.286 [2024-11-27T16:10:56.237Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.286 Nvme0n1 : 9.00 15293.33 59.74 0.00 0.00 0.00 0.00 0.00 00:17:59.286 [2024-11-27T16:10:56.237Z] =================================================================================================================== 00:17:59.286 [2024-11-27T16:10:56.237Z] Total : 15293.33 59.74 0.00 0.00 0.00 0.00 0.00 00:17:59.286 00:18:00.221 [2024-11-27T16:10:57.172Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.221 Nvme0n1 : 10.00 15315.80 59.83 0.00 0.00 0.00 0.00 0.00 00:18:00.221 [2024-11-27T16:10:57.172Z] =================================================================================================================== 00:18:00.221 [2024-11-27T16:10:57.172Z] Total : 15315.80 59.83 0.00 0.00 0.00 0.00 0.00 00:18:00.221 00:18:00.221 00:18:00.221 Latency(us) 00:18:00.221 [2024-11-27T16:10:57.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:00.221 [2024-11-27T16:10:57.172Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.221 Nvme0n1 : 10.00 15309.40 59.80 0.00 0.00 8354.85 4708.88 16796.63 00:18:00.221 [2024-11-27T16:10:57.172Z] =================================================================================================================== 00:18:00.221 [2024-11-27T16:10:57.172Z] Total : 15309.40 59.80 0.00 0.00 8354.85 4708.88 16796.63 00:18:00.221 0 00:18:00.221 17:10:57 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1736300 00:18:00.221 17:10:57 -- common/autotest_common.sh@936 -- # '[' -z 1736300 ']' 00:18:00.221 17:10:57 -- common/autotest_common.sh@940 -- # kill -0 1736300 00:18:00.221 17:10:57 -- common/autotest_common.sh@941 -- # uname 00:18:00.221 17:10:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:00.221 17:10:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1736300 00:18:00.221 17:10:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:00.221 17:10:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:00.221 17:10:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1736300' 00:18:00.221 killing process with pid 1736300 00:18:00.221 17:10:57 -- common/autotest_common.sh@955 -- # kill 1736300 00:18:00.221 Received shutdown signal, test time was about 10.000000 seconds 00:18:00.221 00:18:00.221 Latency(us) 00:18:00.221 [2024-11-27T16:10:57.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:00.221 [2024-11-27T16:10:57.172Z] =================================================================================================================== 00:18:00.221 [2024-11-27T16:10:57.172Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:00.221 17:10:57 -- common/autotest_common.sh@960 -- # wait 1736300 00:18:00.479 17:10:57 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:01.046 17:10:57 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:01.046 17:10:57 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:01.046 17:10:57 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:01.046 17:10:57 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:01.046 17:10:57 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:01.304 [2024-11-27 17:10:58.178397] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:01.304 17:10:58 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:01.304 17:10:58 -- common/autotest_common.sh@650 -- # local es=0 00:18:01.304 17:10:58 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:01.304 17:10:58 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:01.304 17:10:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.304 17:10:58 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:01.304 17:10:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.304 17:10:58 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:01.304 17:10:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.304 17:10:58 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:01.304 17:10:58 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:01.304 17:10:58 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:01.562 request: 00:18:01.562 { 00:18:01.562 "uuid": "1e3111be-1426-4765-910e-ddd9add40c3f", 00:18:01.562 "method": "bdev_lvol_get_lvstores", 00:18:01.562 "req_id": 1 00:18:01.562 } 00:18:01.562 Got JSON-RPC error response 00:18:01.562 response: 00:18:01.562 { 00:18:01.562 "code": -19, 00:18:01.562 "message": "No such device" 00:18:01.562 } 00:18:01.562 17:10:58 -- common/autotest_common.sh@653 -- # es=1 00:18:01.562 17:10:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:01.562 17:10:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:01.562 17:10:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:01.562 17:10:58 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:01.820 aio_bdev 00:18:01.820 17:10:58 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev da61ff11-fd95-4c8e-979c-0e991e79008b 00:18:01.820 17:10:58 -- common/autotest_common.sh@897 -- # local bdev_name=da61ff11-fd95-4c8e-979c-0e991e79008b 00:18:01.820 17:10:58 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:01.820 17:10:58 -- common/autotest_common.sh@899 -- # local i 00:18:01.820 17:10:58 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:01.820 17:10:58 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:01.820 17:10:58 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:02.078 17:10:58 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b da61ff11-fd95-4c8e-979c-0e991e79008b -t 2000 00:18:02.337 [ 00:18:02.337 { 00:18:02.337 "name": "da61ff11-fd95-4c8e-979c-0e991e79008b", 00:18:02.337 "aliases": [ 00:18:02.337 "lvs/lvol" 00:18:02.337 ], 00:18:02.337 "product_name": "Logical Volume", 00:18:02.337 "block_size": 4096, 00:18:02.337 "num_blocks": 38912, 00:18:02.337 "uuid": "da61ff11-fd95-4c8e-979c-0e991e79008b", 00:18:02.337 "assigned_rate_limits": { 00:18:02.337 "rw_ios_per_sec": 0, 00:18:02.337 "rw_mbytes_per_sec": 0, 00:18:02.337 "r_mbytes_per_sec": 0, 00:18:02.337 "w_mbytes_per_sec": 0 00:18:02.337 }, 00:18:02.337 "claimed": false, 00:18:02.337 "zoned": false, 00:18:02.337 "supported_io_types": { 00:18:02.337 "read": true, 00:18:02.337 "write": true, 00:18:02.337 "unmap": true, 00:18:02.337 "write_zeroes": true, 00:18:02.337 "flush": false, 00:18:02.337 "reset": true, 00:18:02.337 "compare": false, 00:18:02.337 "compare_and_write": false, 00:18:02.337 "abort": false, 00:18:02.337 "nvme_admin": false, 00:18:02.337 "nvme_io": false 00:18:02.337 }, 00:18:02.337 "driver_specific": { 00:18:02.337 "lvol": { 00:18:02.337 "lvol_store_uuid": "1e3111be-1426-4765-910e-ddd9add40c3f", 00:18:02.337 "base_bdev": "aio_bdev", 00:18:02.337 "thin_provision": false, 00:18:02.337 "snapshot": false, 00:18:02.337 "clone": false, 00:18:02.337 "esnap_clone": false 00:18:02.337 } 00:18:02.337 } 00:18:02.337 } 00:18:02.337 ] 00:18:02.337 17:10:59 -- common/autotest_common.sh@905 -- # return 0 00:18:02.337 17:10:59 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:02.337 17:10:59 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:02.595 17:10:59 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:02.595 17:10:59 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:02.595 17:10:59 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:02.853 17:10:59 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:02.853 17:10:59 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete da61ff11-fd95-4c8e-979c-0e991e79008b 00:18:03.111 17:10:59 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1e3111be-1426-4765-910e-ddd9add40c3f 00:18:03.369 17:11:00 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:03.627 00:18:03.627 real 0m17.851s 00:18:03.627 user 0m17.663s 00:18:03.627 sys 0m1.776s 00:18:03.627 17:11:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:03.627 17:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:03.627 ************************************ 00:18:03.627 END TEST lvs_grow_clean 00:18:03.627 ************************************ 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:03.627 17:11:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:03.627 17:11:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:03.627 17:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:03.627 ************************************ 00:18:03.627 START TEST lvs_grow_dirty 00:18:03.627 ************************************ 00:18:03.627 17:11:00 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:03.627 17:11:00 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:04.192 17:11:00 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:04.192 17:11:00 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:04.450 17:11:01 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:04.450 17:11:01 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:04.450 17:11:01 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:04.709 17:11:01 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:04.709 17:11:01 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:04.709 17:11:01 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f6f0788d-e1f2-4c12-8773-398c99776e3f lvol 150 00:18:04.968 17:11:01 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:04.968 17:11:01 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:04.968 17:11:01 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:05.226 [2024-11-27 17:11:01.938961] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:05.226 [2024-11-27 17:11:01.939042] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:05.226 true 00:18:05.226 17:11:01 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:05.226 17:11:01 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:05.485 17:11:02 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:05.485 17:11:02 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:05.742 17:11:02 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:06.000 17:11:02 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:06.259 17:11:02 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:06.517 17:11:03 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1738541 00:18:06.517 17:11:03 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:06.517 17:11:03 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:06.517 17:11:03 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1738541 /var/tmp/bdevperf.sock 00:18:06.517 17:11:03 -- common/autotest_common.sh@829 -- # '[' -z 1738541 ']' 00:18:06.517 17:11:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:06.517 17:11:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.517 17:11:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:06.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:06.517 17:11:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.517 17:11:03 -- common/autotest_common.sh@10 -- # set +x 00:18:06.517 [2024-11-27 17:11:03.273259] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:06.517 [2024-11-27 17:11:03.273326] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1738541 ] 00:18:06.517 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.517 [2024-11-27 17:11:03.333942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.517 [2024-11-27 17:11:03.422348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.452 17:11:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.452 17:11:04 -- common/autotest_common.sh@862 -- # return 0 00:18:07.452 17:11:04 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:07.709 Nvme0n1 00:18:07.709 17:11:04 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:07.967 [ 00:18:07.967 { 00:18:07.968 "name": "Nvme0n1", 00:18:07.968 "aliases": [ 00:18:07.968 "c635f051-e2c7-4d13-a8cd-b9f17edc54f1" 00:18:07.968 ], 00:18:07.968 "product_name": "NVMe disk", 00:18:07.968 "block_size": 4096, 00:18:07.968 "num_blocks": 38912, 00:18:07.968 "uuid": "c635f051-e2c7-4d13-a8cd-b9f17edc54f1", 00:18:07.968 "assigned_rate_limits": { 00:18:07.968 "rw_ios_per_sec": 0, 00:18:07.968 "rw_mbytes_per_sec": 0, 00:18:07.968 "r_mbytes_per_sec": 0, 00:18:07.968 "w_mbytes_per_sec": 0 00:18:07.968 }, 00:18:07.968 "claimed": false, 00:18:07.968 "zoned": false, 00:18:07.968 "supported_io_types": { 00:18:07.968 "read": true, 00:18:07.968 "write": true, 00:18:07.968 "unmap": true, 00:18:07.968 "write_zeroes": true, 00:18:07.968 "flush": true, 00:18:07.968 "reset": true, 00:18:07.968 "compare": true, 00:18:07.968 "compare_and_write": true, 00:18:07.968 "abort": true, 00:18:07.968 "nvme_admin": true, 00:18:07.968 "nvme_io": true 00:18:07.968 }, 00:18:07.968 "driver_specific": { 00:18:07.968 "nvme": [ 00:18:07.968 { 00:18:07.968 "trid": { 00:18:07.968 "trtype": "TCP", 00:18:07.968 "adrfam": "IPv4", 00:18:07.968 "traddr": "10.0.0.2", 00:18:07.968 "trsvcid": "4420", 00:18:07.968 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:07.968 }, 00:18:07.968 "ctrlr_data": { 00:18:07.968 "cntlid": 1, 00:18:07.968 "vendor_id": "0x8086", 00:18:07.968 "model_number": "SPDK bdev Controller", 00:18:07.968 "serial_number": "SPDK0", 00:18:07.968 "firmware_revision": "24.01.1", 00:18:07.968 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:07.968 "oacs": { 00:18:07.968 "security": 0, 00:18:07.968 "format": 0, 00:18:07.968 "firmware": 0, 00:18:07.968 "ns_manage": 0 00:18:07.968 }, 00:18:07.968 "multi_ctrlr": true, 00:18:07.968 "ana_reporting": false 00:18:07.968 }, 00:18:07.968 "vs": { 00:18:07.968 "nvme_version": "1.3" 00:18:07.968 }, 00:18:07.968 "ns_data": { 00:18:07.968 "id": 1, 00:18:07.968 "can_share": true 00:18:07.968 } 00:18:07.968 } 00:18:07.968 ], 00:18:07.968 "mp_policy": "active_passive" 00:18:07.968 } 00:18:07.968 } 00:18:07.968 ] 00:18:07.968 17:11:04 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1738687 00:18:07.968 17:11:04 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:07.968 17:11:04 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:08.226 Running I/O for 10 seconds... 00:18:09.160 Latency(us) 00:18:09.160 [2024-11-27T16:11:06.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.160 [2024-11-27T16:11:06.111Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:09.160 Nvme0n1 : 1.00 14641.00 57.19 0.00 0.00 0.00 0.00 0.00 00:18:09.160 [2024-11-27T16:11:06.111Z] =================================================================================================================== 00:18:09.160 [2024-11-27T16:11:06.111Z] Total : 14641.00 57.19 0.00 0.00 0.00 0.00 0.00 00:18:09.160 00:18:10.094 17:11:06 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:10.094 [2024-11-27T16:11:07.045Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.094 Nvme0n1 : 2.00 14742.50 57.59 0.00 0.00 0.00 0.00 0.00 00:18:10.094 [2024-11-27T16:11:07.045Z] =================================================================================================================== 00:18:10.094 [2024-11-27T16:11:07.045Z] Total : 14742.50 57.59 0.00 0.00 0.00 0.00 0.00 00:18:10.094 00:18:10.353 true 00:18:10.353 17:11:07 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:10.353 17:11:07 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:10.611 17:11:07 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:10.611 17:11:07 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:10.611 17:11:07 -- target/nvmf_lvs_grow.sh@65 -- # wait 1738687 00:18:11.176 [2024-11-27T16:11:08.127Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:11.176 Nvme0n1 : 3.00 14892.33 58.17 0.00 0.00 0.00 0.00 0.00 00:18:11.176 [2024-11-27T16:11:08.127Z] =================================================================================================================== 00:18:11.176 [2024-11-27T16:11:08.127Z] Total : 14892.33 58.17 0.00 0.00 0.00 0.00 0.00 00:18:11.176 00:18:12.110 [2024-11-27T16:11:09.061Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:12.110 Nvme0n1 : 4.00 15017.50 58.66 0.00 0.00 0.00 0.00 0.00 00:18:12.110 [2024-11-27T16:11:09.061Z] =================================================================================================================== 00:18:12.110 [2024-11-27T16:11:09.061Z] Total : 15017.50 58.66 0.00 0.00 0.00 0.00 0.00 00:18:12.110 00:18:13.042 [2024-11-27T16:11:09.993Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:13.042 Nvme0n1 : 5.00 15117.20 59.05 0.00 0.00 0.00 0.00 0.00 00:18:13.042 [2024-11-27T16:11:09.993Z] =================================================================================================================== 00:18:13.042 [2024-11-27T16:11:09.993Z] Total : 15117.20 59.05 0.00 0.00 0.00 0.00 0.00 00:18:13.042 00:18:14.412 [2024-11-27T16:11:11.363Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:14.412 Nvme0n1 : 6.00 15150.17 59.18 0.00 0.00 0.00 0.00 0.00 00:18:14.412 [2024-11-27T16:11:11.363Z] =================================================================================================================== 00:18:14.412 [2024-11-27T16:11:11.363Z] Total : 15150.17 59.18 0.00 0.00 0.00 0.00 0.00 00:18:14.412 00:18:15.343 [2024-11-27T16:11:12.294Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:15.343 Nvme0n1 : 7.00 15210.00 59.41 0.00 0.00 0.00 0.00 0.00 00:18:15.343 [2024-11-27T16:11:12.294Z] =================================================================================================================== 00:18:15.343 [2024-11-27T16:11:12.294Z] Total : 15210.00 59.41 0.00 0.00 0.00 0.00 0.00 00:18:15.343 00:18:16.275 [2024-11-27T16:11:13.226Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:16.275 Nvme0n1 : 8.00 15285.38 59.71 0.00 0.00 0.00 0.00 0.00 00:18:16.275 [2024-11-27T16:11:13.226Z] =================================================================================================================== 00:18:16.275 [2024-11-27T16:11:13.226Z] Total : 15285.38 59.71 0.00 0.00 0.00 0.00 0.00 00:18:16.275 00:18:17.208 [2024-11-27T16:11:14.159Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:17.208 Nvme0n1 : 9.00 15302.22 59.77 0.00 0.00 0.00 0.00 0.00 00:18:17.208 [2024-11-27T16:11:14.159Z] =================================================================================================================== 00:18:17.208 [2024-11-27T16:11:14.159Z] Total : 15302.22 59.77 0.00 0.00 0.00 0.00 0.00 00:18:17.208 00:18:18.141 [2024-11-27T16:11:15.092Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:18.141 Nvme0n1 : 10.00 15322.60 59.85 0.00 0.00 0.00 0.00 0.00 00:18:18.141 [2024-11-27T16:11:15.092Z] =================================================================================================================== 00:18:18.141 [2024-11-27T16:11:15.092Z] Total : 15322.60 59.85 0.00 0.00 0.00 0.00 0.00 00:18:18.141 00:18:18.141 00:18:18.141 Latency(us) 00:18:18.141 [2024-11-27T16:11:15.092Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.141 [2024-11-27T16:11:15.092Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:18.141 Nvme0n1 : 10.00 15328.55 59.88 0.00 0.00 8345.65 2669.99 15922.82 00:18:18.141 [2024-11-27T16:11:15.093Z] =================================================================================================================== 00:18:18.142 [2024-11-27T16:11:15.093Z] Total : 15328.55 59.88 0.00 0.00 8345.65 2669.99 15922.82 00:18:18.142 0 00:18:18.142 17:11:15 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1738541 00:18:18.142 17:11:15 -- common/autotest_common.sh@936 -- # '[' -z 1738541 ']' 00:18:18.142 17:11:15 -- common/autotest_common.sh@940 -- # kill -0 1738541 00:18:18.142 17:11:15 -- common/autotest_common.sh@941 -- # uname 00:18:18.142 17:11:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.142 17:11:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1738541 00:18:18.142 17:11:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:18.142 17:11:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:18.142 17:11:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1738541' 00:18:18.142 killing process with pid 1738541 00:18:18.142 17:11:15 -- common/autotest_common.sh@955 -- # kill 1738541 00:18:18.142 Received shutdown signal, test time was about 10.000000 seconds 00:18:18.142 00:18:18.142 Latency(us) 00:18:18.142 [2024-11-27T16:11:15.093Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.142 [2024-11-27T16:11:15.093Z] =================================================================================================================== 00:18:18.142 [2024-11-27T16:11:15.093Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:18.142 17:11:15 -- common/autotest_common.sh@960 -- # wait 1738541 00:18:18.399 17:11:15 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:18.657 17:11:15 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:18.657 17:11:15 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1735719 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@74 -- # wait 1735719 00:18:18.916 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1735719 Killed "${NVMF_APP[@]}" "$@" 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:18.916 17:11:15 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:18.916 17:11:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:18.916 17:11:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:18.916 17:11:15 -- common/autotest_common.sh@10 -- # set +x 00:18:18.916 17:11:15 -- nvmf/common.sh@469 -- # nvmfpid=1740048 00:18:18.916 17:11:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:18.916 17:11:15 -- nvmf/common.sh@470 -- # waitforlisten 1740048 00:18:18.916 17:11:15 -- common/autotest_common.sh@829 -- # '[' -z 1740048 ']' 00:18:18.916 17:11:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:18.916 17:11:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.916 17:11:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:18.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:18.916 17:11:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.916 17:11:15 -- common/autotest_common.sh@10 -- # set +x 00:18:18.916 [2024-11-27 17:11:15.856052] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.916 [2024-11-27 17:11:15.856131] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:19.175 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.175 [2024-11-27 17:11:15.924282] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.175 [2024-11-27 17:11:16.012039] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:19.175 [2024-11-27 17:11:16.012195] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:19.175 [2024-11-27 17:11:16.012211] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:19.175 [2024-11-27 17:11:16.012223] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:19.175 [2024-11-27 17:11:16.012252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:20.192 17:11:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.192 17:11:16 -- common/autotest_common.sh@862 -- # return 0 00:18:20.192 17:11:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:20.192 17:11:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:20.192 17:11:16 -- common/autotest_common.sh@10 -- # set +x 00:18:20.192 17:11:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:20.192 17:11:16 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:20.192 [2024-11-27 17:11:17.130286] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:20.192 [2024-11-27 17:11:17.130429] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:20.192 [2024-11-27 17:11:17.130488] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:20.450 17:11:17 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:20.450 17:11:17 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:20.450 17:11:17 -- common/autotest_common.sh@897 -- # local bdev_name=c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:20.450 17:11:17 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:20.450 17:11:17 -- common/autotest_common.sh@899 -- # local i 00:18:20.450 17:11:17 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:20.450 17:11:17 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:20.450 17:11:17 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:20.707 17:11:17 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c635f051-e2c7-4d13-a8cd-b9f17edc54f1 -t 2000 00:18:20.965 [ 00:18:20.965 { 00:18:20.965 "name": "c635f051-e2c7-4d13-a8cd-b9f17edc54f1", 00:18:20.965 "aliases": [ 00:18:20.965 "lvs/lvol" 00:18:20.965 ], 00:18:20.965 "product_name": "Logical Volume", 00:18:20.965 "block_size": 4096, 00:18:20.965 "num_blocks": 38912, 00:18:20.965 "uuid": "c635f051-e2c7-4d13-a8cd-b9f17edc54f1", 00:18:20.965 "assigned_rate_limits": { 00:18:20.965 "rw_ios_per_sec": 0, 00:18:20.965 "rw_mbytes_per_sec": 0, 00:18:20.965 "r_mbytes_per_sec": 0, 00:18:20.965 "w_mbytes_per_sec": 0 00:18:20.965 }, 00:18:20.965 "claimed": false, 00:18:20.965 "zoned": false, 00:18:20.965 "supported_io_types": { 00:18:20.965 "read": true, 00:18:20.965 "write": true, 00:18:20.965 "unmap": true, 00:18:20.965 "write_zeroes": true, 00:18:20.965 "flush": false, 00:18:20.965 "reset": true, 00:18:20.965 "compare": false, 00:18:20.965 "compare_and_write": false, 00:18:20.965 "abort": false, 00:18:20.965 "nvme_admin": false, 00:18:20.965 "nvme_io": false 00:18:20.965 }, 00:18:20.965 "driver_specific": { 00:18:20.965 "lvol": { 00:18:20.965 "lvol_store_uuid": "f6f0788d-e1f2-4c12-8773-398c99776e3f", 00:18:20.965 "base_bdev": "aio_bdev", 00:18:20.966 "thin_provision": false, 00:18:20.966 "snapshot": false, 00:18:20.966 "clone": false, 00:18:20.966 "esnap_clone": false 00:18:20.966 } 00:18:20.966 } 00:18:20.966 } 00:18:20.966 ] 00:18:20.966 17:11:17 -- common/autotest_common.sh@905 -- # return 0 00:18:20.966 17:11:17 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:20.966 17:11:17 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:21.224 17:11:17 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:21.224 17:11:17 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:21.224 17:11:17 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:21.481 17:11:18 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:21.481 17:11:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:21.739 [2024-11-27 17:11:18.471519] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:21.739 17:11:18 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:21.739 17:11:18 -- common/autotest_common.sh@650 -- # local es=0 00:18:21.739 17:11:18 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:21.739 17:11:18 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:21.739 17:11:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:21.739 17:11:18 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:21.739 17:11:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:21.739 17:11:18 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:21.740 17:11:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:21.740 17:11:18 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:21.740 17:11:18 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:21.740 17:11:18 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:21.998 request: 00:18:21.998 { 00:18:21.998 "uuid": "f6f0788d-e1f2-4c12-8773-398c99776e3f", 00:18:21.998 "method": "bdev_lvol_get_lvstores", 00:18:21.998 "req_id": 1 00:18:21.998 } 00:18:21.998 Got JSON-RPC error response 00:18:21.998 response: 00:18:21.998 { 00:18:21.998 "code": -19, 00:18:21.998 "message": "No such device" 00:18:21.998 } 00:18:21.998 17:11:18 -- common/autotest_common.sh@653 -- # es=1 00:18:21.998 17:11:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:21.998 17:11:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:21.998 17:11:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:21.998 17:11:18 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:22.256 aio_bdev 00:18:22.256 17:11:19 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:22.256 17:11:19 -- common/autotest_common.sh@897 -- # local bdev_name=c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:22.256 17:11:19 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:22.256 17:11:19 -- common/autotest_common.sh@899 -- # local i 00:18:22.256 17:11:19 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:22.256 17:11:19 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:22.256 17:11:19 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:22.512 17:11:19 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c635f051-e2c7-4d13-a8cd-b9f17edc54f1 -t 2000 00:18:22.769 [ 00:18:22.769 { 00:18:22.769 "name": "c635f051-e2c7-4d13-a8cd-b9f17edc54f1", 00:18:22.769 "aliases": [ 00:18:22.769 "lvs/lvol" 00:18:22.769 ], 00:18:22.769 "product_name": "Logical Volume", 00:18:22.769 "block_size": 4096, 00:18:22.769 "num_blocks": 38912, 00:18:22.769 "uuid": "c635f051-e2c7-4d13-a8cd-b9f17edc54f1", 00:18:22.769 "assigned_rate_limits": { 00:18:22.769 "rw_ios_per_sec": 0, 00:18:22.769 "rw_mbytes_per_sec": 0, 00:18:22.769 "r_mbytes_per_sec": 0, 00:18:22.769 "w_mbytes_per_sec": 0 00:18:22.769 }, 00:18:22.769 "claimed": false, 00:18:22.769 "zoned": false, 00:18:22.769 "supported_io_types": { 00:18:22.769 "read": true, 00:18:22.769 "write": true, 00:18:22.769 "unmap": true, 00:18:22.769 "write_zeroes": true, 00:18:22.769 "flush": false, 00:18:22.769 "reset": true, 00:18:22.769 "compare": false, 00:18:22.769 "compare_and_write": false, 00:18:22.769 "abort": false, 00:18:22.769 "nvme_admin": false, 00:18:22.769 "nvme_io": false 00:18:22.769 }, 00:18:22.769 "driver_specific": { 00:18:22.769 "lvol": { 00:18:22.769 "lvol_store_uuid": "f6f0788d-e1f2-4c12-8773-398c99776e3f", 00:18:22.769 "base_bdev": "aio_bdev", 00:18:22.769 "thin_provision": false, 00:18:22.769 "snapshot": false, 00:18:22.769 "clone": false, 00:18:22.769 "esnap_clone": false 00:18:22.769 } 00:18:22.769 } 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 17:11:19 -- common/autotest_common.sh@905 -- # return 0 00:18:22.769 17:11:19 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:22.769 17:11:19 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:23.027 17:11:19 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:23.027 17:11:19 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:23.027 17:11:19 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:23.285 17:11:20 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:23.285 17:11:20 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c635f051-e2c7-4d13-a8cd-b9f17edc54f1 00:18:23.544 17:11:20 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f6f0788d-e1f2-4c12-8773-398c99776e3f 00:18:23.802 17:11:20 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:24.060 17:11:20 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:24.060 00:18:24.060 real 0m20.282s 00:18:24.060 user 0m50.104s 00:18:24.060 sys 0m4.962s 00:18:24.060 17:11:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:24.060 17:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:24.060 ************************************ 00:18:24.060 END TEST lvs_grow_dirty 00:18:24.060 ************************************ 00:18:24.060 17:11:20 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:24.060 17:11:20 -- common/autotest_common.sh@806 -- # type=--id 00:18:24.060 17:11:20 -- common/autotest_common.sh@807 -- # id=0 00:18:24.060 17:11:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:24.060 17:11:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:24.060 17:11:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:24.060 17:11:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:24.060 17:11:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:24.060 17:11:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:24.060 nvmf_trace.0 00:18:24.060 17:11:20 -- common/autotest_common.sh@821 -- # return 0 00:18:24.060 17:11:20 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:24.060 17:11:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:24.060 17:11:20 -- nvmf/common.sh@116 -- # sync 00:18:24.060 17:11:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:24.060 17:11:20 -- nvmf/common.sh@119 -- # set +e 00:18:24.060 17:11:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:24.060 17:11:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:24.060 rmmod nvme_tcp 00:18:24.060 rmmod nvme_fabrics 00:18:24.060 rmmod nvme_keyring 00:18:24.060 17:11:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:24.060 17:11:20 -- nvmf/common.sh@123 -- # set -e 00:18:24.060 17:11:20 -- nvmf/common.sh@124 -- # return 0 00:18:24.060 17:11:20 -- nvmf/common.sh@477 -- # '[' -n 1740048 ']' 00:18:24.060 17:11:20 -- nvmf/common.sh@478 -- # killprocess 1740048 00:18:24.060 17:11:20 -- common/autotest_common.sh@936 -- # '[' -z 1740048 ']' 00:18:24.060 17:11:20 -- common/autotest_common.sh@940 -- # kill -0 1740048 00:18:24.060 17:11:20 -- common/autotest_common.sh@941 -- # uname 00:18:24.060 17:11:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:24.060 17:11:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1740048 00:18:24.060 17:11:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:24.060 17:11:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:24.060 17:11:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1740048' 00:18:24.060 killing process with pid 1740048 00:18:24.060 17:11:20 -- common/autotest_common.sh@955 -- # kill 1740048 00:18:24.060 17:11:20 -- common/autotest_common.sh@960 -- # wait 1740048 00:18:24.318 17:11:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:24.318 17:11:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:24.318 17:11:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:24.318 17:11:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:24.318 17:11:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:24.318 17:11:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:24.318 17:11:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:24.318 17:11:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.852 17:11:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:26.852 00:18:26.852 real 0m44.309s 00:18:26.852 user 1m14.523s 00:18:26.852 sys 0m8.671s 00:18:26.852 17:11:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:26.852 17:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:26.852 ************************************ 00:18:26.852 END TEST nvmf_lvs_grow 00:18:26.852 ************************************ 00:18:26.852 17:11:23 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:26.852 17:11:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:26.852 17:11:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:26.852 17:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:26.852 ************************************ 00:18:26.852 START TEST nvmf_bdev_io_wait 00:18:26.852 ************************************ 00:18:26.852 17:11:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:26.852 * Looking for test storage... 00:18:26.852 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:26.852 17:11:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:26.852 17:11:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:26.852 17:11:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:26.852 17:11:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:26.852 17:11:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:26.852 17:11:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:26.852 17:11:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:26.852 17:11:23 -- scripts/common.sh@335 -- # IFS=.-: 00:18:26.852 17:11:23 -- scripts/common.sh@335 -- # read -ra ver1 00:18:26.852 17:11:23 -- scripts/common.sh@336 -- # IFS=.-: 00:18:26.852 17:11:23 -- scripts/common.sh@336 -- # read -ra ver2 00:18:26.852 17:11:23 -- scripts/common.sh@337 -- # local 'op=<' 00:18:26.852 17:11:23 -- scripts/common.sh@339 -- # ver1_l=2 00:18:26.852 17:11:23 -- scripts/common.sh@340 -- # ver2_l=1 00:18:26.852 17:11:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:26.852 17:11:23 -- scripts/common.sh@343 -- # case "$op" in 00:18:26.852 17:11:23 -- scripts/common.sh@344 -- # : 1 00:18:26.853 17:11:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:26.853 17:11:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:26.853 17:11:23 -- scripts/common.sh@364 -- # decimal 1 00:18:26.853 17:11:23 -- scripts/common.sh@352 -- # local d=1 00:18:26.853 17:11:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:26.853 17:11:23 -- scripts/common.sh@354 -- # echo 1 00:18:26.853 17:11:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:26.853 17:11:23 -- scripts/common.sh@365 -- # decimal 2 00:18:26.853 17:11:23 -- scripts/common.sh@352 -- # local d=2 00:18:26.853 17:11:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:26.853 17:11:23 -- scripts/common.sh@354 -- # echo 2 00:18:26.853 17:11:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:26.853 17:11:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:26.853 17:11:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:26.853 17:11:23 -- scripts/common.sh@367 -- # return 0 00:18:26.853 17:11:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:26.853 17:11:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:26.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.853 --rc genhtml_branch_coverage=1 00:18:26.853 --rc genhtml_function_coverage=1 00:18:26.853 --rc genhtml_legend=1 00:18:26.853 --rc geninfo_all_blocks=1 00:18:26.853 --rc geninfo_unexecuted_blocks=1 00:18:26.853 00:18:26.853 ' 00:18:26.853 17:11:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:26.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.853 --rc genhtml_branch_coverage=1 00:18:26.853 --rc genhtml_function_coverage=1 00:18:26.853 --rc genhtml_legend=1 00:18:26.853 --rc geninfo_all_blocks=1 00:18:26.853 --rc geninfo_unexecuted_blocks=1 00:18:26.853 00:18:26.853 ' 00:18:26.853 17:11:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:26.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.853 --rc genhtml_branch_coverage=1 00:18:26.853 --rc genhtml_function_coverage=1 00:18:26.853 --rc genhtml_legend=1 00:18:26.853 --rc geninfo_all_blocks=1 00:18:26.853 --rc geninfo_unexecuted_blocks=1 00:18:26.853 00:18:26.853 ' 00:18:26.853 17:11:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:26.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.853 --rc genhtml_branch_coverage=1 00:18:26.853 --rc genhtml_function_coverage=1 00:18:26.853 --rc genhtml_legend=1 00:18:26.853 --rc geninfo_all_blocks=1 00:18:26.853 --rc geninfo_unexecuted_blocks=1 00:18:26.853 00:18:26.853 ' 00:18:26.853 17:11:23 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:26.853 17:11:23 -- nvmf/common.sh@7 -- # uname -s 00:18:26.853 17:11:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:26.853 17:11:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:26.853 17:11:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:26.853 17:11:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:26.853 17:11:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:26.853 17:11:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:26.853 17:11:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:26.853 17:11:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:26.853 17:11:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:26.853 17:11:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:26.853 17:11:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:26.853 17:11:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:26.853 17:11:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:26.853 17:11:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:26.853 17:11:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:26.853 17:11:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:26.853 17:11:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:26.853 17:11:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:26.853 17:11:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:26.853 17:11:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.853 17:11:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.853 17:11:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.853 17:11:23 -- paths/export.sh@5 -- # export PATH 00:18:26.853 17:11:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.853 17:11:23 -- nvmf/common.sh@46 -- # : 0 00:18:26.853 17:11:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:26.853 17:11:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:26.853 17:11:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:26.853 17:11:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:26.853 17:11:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:26.853 17:11:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:26.853 17:11:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:26.853 17:11:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:26.853 17:11:23 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:26.853 17:11:23 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:26.853 17:11:23 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:26.853 17:11:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:26.853 17:11:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:26.853 17:11:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:26.853 17:11:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:26.853 17:11:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:26.853 17:11:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:26.853 17:11:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:26.853 17:11:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.853 17:11:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:26.853 17:11:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:26.853 17:11:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:26.853 17:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:28.754 17:11:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:28.754 17:11:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:28.754 17:11:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:28.754 17:11:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:28.754 17:11:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:28.754 17:11:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:28.754 17:11:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:28.754 17:11:25 -- nvmf/common.sh@294 -- # net_devs=() 00:18:28.754 17:11:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:28.754 17:11:25 -- nvmf/common.sh@295 -- # e810=() 00:18:28.754 17:11:25 -- nvmf/common.sh@295 -- # local -ga e810 00:18:28.754 17:11:25 -- nvmf/common.sh@296 -- # x722=() 00:18:28.754 17:11:25 -- nvmf/common.sh@296 -- # local -ga x722 00:18:28.754 17:11:25 -- nvmf/common.sh@297 -- # mlx=() 00:18:28.754 17:11:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:28.754 17:11:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:28.754 17:11:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:28.754 17:11:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:28.754 17:11:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:28.754 17:11:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:28.754 17:11:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:28.754 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:28.754 17:11:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:28.754 17:11:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:28.754 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:28.754 17:11:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:28.754 17:11:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:28.754 17:11:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:28.754 17:11:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:28.754 17:11:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:28.754 17:11:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:28.754 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:28.754 17:11:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:28.754 17:11:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:28.754 17:11:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:28.754 17:11:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:28.754 17:11:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:28.754 17:11:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:28.754 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:28.754 17:11:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:28.754 17:11:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:28.754 17:11:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:28.754 17:11:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:28.754 17:11:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:28.755 17:11:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:28.755 17:11:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:28.755 17:11:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:28.755 17:11:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:28.755 17:11:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:28.755 17:11:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:28.755 17:11:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:28.755 17:11:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:28.755 17:11:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:28.755 17:11:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:28.755 17:11:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:28.755 17:11:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:28.755 17:11:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:28.755 17:11:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:28.755 17:11:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:28.755 17:11:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:28.755 17:11:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:28.755 17:11:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:28.755 17:11:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:28.755 17:11:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:28.755 17:11:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:28.755 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:28.755 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:18:28.755 00:18:28.755 --- 10.0.0.2 ping statistics --- 00:18:28.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:28.755 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:18:28.755 17:11:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:28.755 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:28.755 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:18:28.755 00:18:28.755 --- 10.0.0.1 ping statistics --- 00:18:28.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:28.755 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:18:28.755 17:11:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:28.755 17:11:25 -- nvmf/common.sh@410 -- # return 0 00:18:28.755 17:11:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:28.755 17:11:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:28.755 17:11:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:28.755 17:11:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:28.755 17:11:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:28.755 17:11:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:28.755 17:11:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:28.755 17:11:25 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:28.755 17:11:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:28.755 17:11:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:28.755 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:28.755 17:11:25 -- nvmf/common.sh@469 -- # nvmfpid=1742621 00:18:28.755 17:11:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:28.755 17:11:25 -- nvmf/common.sh@470 -- # waitforlisten 1742621 00:18:28.755 17:11:25 -- common/autotest_common.sh@829 -- # '[' -z 1742621 ']' 00:18:28.755 17:11:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:28.755 17:11:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:28.755 17:11:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:28.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:28.755 17:11:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:28.755 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:28.755 [2024-11-27 17:11:25.578648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:28.755 [2024-11-27 17:11:25.578736] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:28.755 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.755 [2024-11-27 17:11:25.648850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:29.013 [2024-11-27 17:11:25.744316] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:29.013 [2024-11-27 17:11:25.744498] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:29.013 [2024-11-27 17:11:25.744518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:29.013 [2024-11-27 17:11:25.744541] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:29.013 [2024-11-27 17:11:25.744599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:29.013 [2024-11-27 17:11:25.744656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:29.013 [2024-11-27 17:11:25.744713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:29.013 [2024-11-27 17:11:25.744716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:29.013 17:11:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:29.013 17:11:25 -- common/autotest_common.sh@862 -- # return 0 00:18:29.014 17:11:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:29.014 17:11:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:29.014 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.014 17:11:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:29.014 17:11:25 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:29.014 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.014 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.014 17:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.014 17:11:25 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:29.014 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.014 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.014 17:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.014 17:11:25 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:29.014 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.014 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.014 [2024-11-27 17:11:25.937419] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:29.014 17:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.014 17:11:25 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:29.014 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.014 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.272 Malloc0 00:18:29.272 17:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.272 17:11:25 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:29.272 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.272 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.272 17:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.272 17:11:25 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:29.272 17:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.272 17:11:25 -- common/autotest_common.sh@10 -- # set +x 00:18:29.272 17:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:29.272 17:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.272 17:11:26 -- common/autotest_common.sh@10 -- # set +x 00:18:29.272 [2024-11-27 17:11:26.011193] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:29.272 17:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1742767 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@30 -- # READ_PID=1742768 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:29.272 17:11:26 -- nvmf/common.sh@520 -- # config=() 00:18:29.272 17:11:26 -- nvmf/common.sh@520 -- # local subsystem config 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1742771 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:29.272 17:11:26 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:29.272 17:11:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:29.272 17:11:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:29.272 { 00:18:29.272 "params": { 00:18:29.272 "name": "Nvme$subsystem", 00:18:29.272 "trtype": "$TEST_TRANSPORT", 00:18:29.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "$NVMF_PORT", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:29.273 "hdgst": ${hdgst:-false}, 00:18:29.273 "ddgst": ${ddgst:-false} 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 } 00:18:29.273 EOF 00:18:29.273 )") 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # config=() 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # local subsystem config 00:18:29.273 17:11:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1742773 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:29.273 { 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme$subsystem", 00:18:29.273 "trtype": "$TEST_TRANSPORT", 00:18:29.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "$NVMF_PORT", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:29.273 "hdgst": ${hdgst:-false}, 00:18:29.273 "ddgst": ${ddgst:-false} 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 } 00:18:29.273 EOF 00:18:29.273 )") 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@35 -- # sync 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # config=() 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # local subsystem config 00:18:29.273 17:11:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # cat 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:29.273 { 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme$subsystem", 00:18:29.273 "trtype": "$TEST_TRANSPORT", 00:18:29.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "$NVMF_PORT", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:29.273 "hdgst": ${hdgst:-false}, 00:18:29.273 "ddgst": ${ddgst:-false} 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 } 00:18:29.273 EOF 00:18:29.273 )") 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # config=() 00:18:29.273 17:11:26 -- nvmf/common.sh@520 -- # local subsystem config 00:18:29.273 17:11:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # cat 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:29.273 { 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme$subsystem", 00:18:29.273 "trtype": "$TEST_TRANSPORT", 00:18:29.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "$NVMF_PORT", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:29.273 "hdgst": ${hdgst:-false}, 00:18:29.273 "ddgst": ${ddgst:-false} 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 } 00:18:29.273 EOF 00:18:29.273 )") 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # cat 00:18:29.273 17:11:26 -- target/bdev_io_wait.sh@37 -- # wait 1742767 00:18:29.273 17:11:26 -- nvmf/common.sh@542 -- # cat 00:18:29.273 17:11:26 -- nvmf/common.sh@544 -- # jq . 00:18:29.273 17:11:26 -- nvmf/common.sh@544 -- # jq . 00:18:29.273 17:11:26 -- nvmf/common.sh@544 -- # jq . 00:18:29.273 17:11:26 -- nvmf/common.sh@544 -- # jq . 00:18:29.273 17:11:26 -- nvmf/common.sh@545 -- # IFS=, 00:18:29.273 17:11:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme1", 00:18:29.273 "trtype": "tcp", 00:18:29.273 "traddr": "10.0.0.2", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "4420", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:29.273 "hdgst": false, 00:18:29.273 "ddgst": false 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 }' 00:18:29.273 17:11:26 -- nvmf/common.sh@545 -- # IFS=, 00:18:29.273 17:11:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme1", 00:18:29.273 "trtype": "tcp", 00:18:29.273 "traddr": "10.0.0.2", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "4420", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:29.273 "hdgst": false, 00:18:29.273 "ddgst": false 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 }' 00:18:29.273 17:11:26 -- nvmf/common.sh@545 -- # IFS=, 00:18:29.273 17:11:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme1", 00:18:29.273 "trtype": "tcp", 00:18:29.273 "traddr": "10.0.0.2", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "4420", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:29.273 "hdgst": false, 00:18:29.273 "ddgst": false 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 }' 00:18:29.273 17:11:26 -- nvmf/common.sh@545 -- # IFS=, 00:18:29.273 17:11:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:29.273 "params": { 00:18:29.273 "name": "Nvme1", 00:18:29.273 "trtype": "tcp", 00:18:29.273 "traddr": "10.0.0.2", 00:18:29.273 "adrfam": "ipv4", 00:18:29.273 "trsvcid": "4420", 00:18:29.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:29.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:29.273 "hdgst": false, 00:18:29.273 "ddgst": false 00:18:29.273 }, 00:18:29.273 "method": "bdev_nvme_attach_controller" 00:18:29.273 }' 00:18:29.273 [2024-11-27 17:11:26.057845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:29.273 [2024-11-27 17:11:26.057920] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:29.273 [2024-11-27 17:11:26.058027] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:29.273 [2024-11-27 17:11:26.058027] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:29.273 [2024-11-27 17:11:26.058027] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:29.273 [2024-11-27 17:11:26.058110] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 17:11:26.058111] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 17:11:26.058111] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:29.273 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:29.273 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:29.273 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.273 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.531 [2024-11-27 17:11:26.233400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.531 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.531 [2024-11-27 17:11:26.306788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.531 [2024-11-27 17:11:26.307800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:29.531 [2024-11-27 17:11:26.371723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:29.531 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.531 [2024-11-27 17:11:26.403928] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.531 [2024-11-27 17:11:26.477601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:29.790 [2024-11-27 17:11:26.505738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.790 [2024-11-27 17:11:26.581220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:29.790 Running I/O for 1 seconds... 00:18:30.048 Running I/O for 1 seconds... 00:18:30.048 Running I/O for 1 seconds... 00:18:30.048 Running I/O for 1 seconds... 00:18:30.984 00:18:30.984 Latency(us) 00:18:30.984 [2024-11-27T16:11:27.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.984 [2024-11-27T16:11:27.935Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:30.984 Nvme1n1 : 1.00 197438.06 771.24 0.00 0.00 645.83 262.45 910.22 00:18:30.984 [2024-11-27T16:11:27.935Z] =================================================================================================================== 00:18:30.984 [2024-11-27T16:11:27.935Z] Total : 197438.06 771.24 0.00 0.00 645.83 262.45 910.22 00:18:30.984 00:18:30.984 Latency(us) 00:18:30.984 [2024-11-27T16:11:27.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.984 [2024-11-27T16:11:27.935Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:30.984 Nvme1n1 : 1.01 11378.43 44.45 0.00 0.00 11212.20 5485.61 20583.16 00:18:30.984 [2024-11-27T16:11:27.935Z] =================================================================================================================== 00:18:30.984 [2024-11-27T16:11:27.935Z] Total : 11378.43 44.45 0.00 0.00 11212.20 5485.61 20583.16 00:18:30.984 00:18:30.984 Latency(us) 00:18:30.984 [2024-11-27T16:11:27.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.984 [2024-11-27T16:11:27.935Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:30.984 Nvme1n1 : 1.01 7531.77 29.42 0.00 0.00 16904.13 9709.04 29709.65 00:18:30.984 [2024-11-27T16:11:27.935Z] =================================================================================================================== 00:18:30.984 [2024-11-27T16:11:27.935Z] Total : 7531.77 29.42 0.00 0.00 16904.13 9709.04 29709.65 00:18:30.984 00:18:30.984 Latency(us) 00:18:30.984 [2024-11-27T16:11:27.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.984 [2024-11-27T16:11:27.935Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:30.984 Nvme1n1 : 1.01 9236.74 36.08 0.00 0.00 13795.06 7961.41 25243.50 00:18:30.984 [2024-11-27T16:11:27.935Z] =================================================================================================================== 00:18:30.984 [2024-11-27T16:11:27.935Z] Total : 9236.74 36.08 0.00 0.00 13795.06 7961.41 25243.50 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@38 -- # wait 1742768 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@39 -- # wait 1742771 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@40 -- # wait 1742773 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:31.551 17:11:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:31.551 17:11:28 -- common/autotest_common.sh@10 -- # set +x 00:18:31.551 17:11:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:31.551 17:11:28 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:31.551 17:11:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:31.551 17:11:28 -- nvmf/common.sh@116 -- # sync 00:18:31.551 17:11:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:31.551 17:11:28 -- nvmf/common.sh@119 -- # set +e 00:18:31.551 17:11:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:31.551 17:11:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:31.551 rmmod nvme_tcp 00:18:31.551 rmmod nvme_fabrics 00:18:31.551 rmmod nvme_keyring 00:18:31.551 17:11:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:31.551 17:11:28 -- nvmf/common.sh@123 -- # set -e 00:18:31.551 17:11:28 -- nvmf/common.sh@124 -- # return 0 00:18:31.551 17:11:28 -- nvmf/common.sh@477 -- # '[' -n 1742621 ']' 00:18:31.551 17:11:28 -- nvmf/common.sh@478 -- # killprocess 1742621 00:18:31.551 17:11:28 -- common/autotest_common.sh@936 -- # '[' -z 1742621 ']' 00:18:31.551 17:11:28 -- common/autotest_common.sh@940 -- # kill -0 1742621 00:18:31.551 17:11:28 -- common/autotest_common.sh@941 -- # uname 00:18:31.551 17:11:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:31.551 17:11:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1742621 00:18:31.551 17:11:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:31.551 17:11:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:31.551 17:11:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1742621' 00:18:31.551 killing process with pid 1742621 00:18:31.551 17:11:28 -- common/autotest_common.sh@955 -- # kill 1742621 00:18:31.551 17:11:28 -- common/autotest_common.sh@960 -- # wait 1742621 00:18:31.810 17:11:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:31.810 17:11:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:31.810 17:11:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:31.810 17:11:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:31.810 17:11:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:31.810 17:11:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:31.810 17:11:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:31.810 17:11:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:33.715 17:11:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:33.715 00:18:33.715 real 0m7.316s 00:18:33.715 user 0m16.619s 00:18:33.715 sys 0m3.773s 00:18:33.715 17:11:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:33.715 17:11:30 -- common/autotest_common.sh@10 -- # set +x 00:18:33.715 ************************************ 00:18:33.715 END TEST nvmf_bdev_io_wait 00:18:33.715 ************************************ 00:18:33.715 17:11:30 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:33.715 17:11:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:33.715 17:11:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:33.715 17:11:30 -- common/autotest_common.sh@10 -- # set +x 00:18:33.715 ************************************ 00:18:33.715 START TEST nvmf_queue_depth 00:18:33.715 ************************************ 00:18:33.715 17:11:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:33.715 * Looking for test storage... 00:18:33.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:33.715 17:11:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:33.715 17:11:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:33.715 17:11:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:33.973 17:11:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:33.973 17:11:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:33.973 17:11:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:33.973 17:11:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:33.973 17:11:30 -- scripts/common.sh@335 -- # IFS=.-: 00:18:33.973 17:11:30 -- scripts/common.sh@335 -- # read -ra ver1 00:18:33.973 17:11:30 -- scripts/common.sh@336 -- # IFS=.-: 00:18:33.973 17:11:30 -- scripts/common.sh@336 -- # read -ra ver2 00:18:33.973 17:11:30 -- scripts/common.sh@337 -- # local 'op=<' 00:18:33.973 17:11:30 -- scripts/common.sh@339 -- # ver1_l=2 00:18:33.973 17:11:30 -- scripts/common.sh@340 -- # ver2_l=1 00:18:33.973 17:11:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:33.973 17:11:30 -- scripts/common.sh@343 -- # case "$op" in 00:18:33.973 17:11:30 -- scripts/common.sh@344 -- # : 1 00:18:33.973 17:11:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:33.973 17:11:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:33.973 17:11:30 -- scripts/common.sh@364 -- # decimal 1 00:18:33.973 17:11:30 -- scripts/common.sh@352 -- # local d=1 00:18:33.973 17:11:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:33.973 17:11:30 -- scripts/common.sh@354 -- # echo 1 00:18:33.973 17:11:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:33.973 17:11:30 -- scripts/common.sh@365 -- # decimal 2 00:18:33.973 17:11:30 -- scripts/common.sh@352 -- # local d=2 00:18:33.973 17:11:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:33.973 17:11:30 -- scripts/common.sh@354 -- # echo 2 00:18:33.973 17:11:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:33.973 17:11:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:33.973 17:11:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:33.973 17:11:30 -- scripts/common.sh@367 -- # return 0 00:18:33.973 17:11:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:33.973 17:11:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:33.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:33.973 --rc genhtml_branch_coverage=1 00:18:33.973 --rc genhtml_function_coverage=1 00:18:33.973 --rc genhtml_legend=1 00:18:33.973 --rc geninfo_all_blocks=1 00:18:33.973 --rc geninfo_unexecuted_blocks=1 00:18:33.973 00:18:33.973 ' 00:18:33.973 17:11:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:33.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:33.973 --rc genhtml_branch_coverage=1 00:18:33.973 --rc genhtml_function_coverage=1 00:18:33.973 --rc genhtml_legend=1 00:18:33.973 --rc geninfo_all_blocks=1 00:18:33.973 --rc geninfo_unexecuted_blocks=1 00:18:33.973 00:18:33.973 ' 00:18:33.973 17:11:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:33.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:33.973 --rc genhtml_branch_coverage=1 00:18:33.973 --rc genhtml_function_coverage=1 00:18:33.973 --rc genhtml_legend=1 00:18:33.973 --rc geninfo_all_blocks=1 00:18:33.973 --rc geninfo_unexecuted_blocks=1 00:18:33.973 00:18:33.973 ' 00:18:33.973 17:11:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:33.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:33.973 --rc genhtml_branch_coverage=1 00:18:33.973 --rc genhtml_function_coverage=1 00:18:33.973 --rc genhtml_legend=1 00:18:33.973 --rc geninfo_all_blocks=1 00:18:33.973 --rc geninfo_unexecuted_blocks=1 00:18:33.973 00:18:33.973 ' 00:18:33.973 17:11:30 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:33.973 17:11:30 -- nvmf/common.sh@7 -- # uname -s 00:18:33.973 17:11:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:33.973 17:11:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:33.973 17:11:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:33.973 17:11:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:33.973 17:11:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:33.973 17:11:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:33.973 17:11:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:33.973 17:11:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:33.973 17:11:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:33.973 17:11:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:33.973 17:11:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:33.973 17:11:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:33.973 17:11:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:33.973 17:11:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:33.973 17:11:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:33.973 17:11:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:33.973 17:11:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:33.973 17:11:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:33.973 17:11:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:33.973 17:11:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.974 17:11:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.974 17:11:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.974 17:11:30 -- paths/export.sh@5 -- # export PATH 00:18:33.974 17:11:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.974 17:11:30 -- nvmf/common.sh@46 -- # : 0 00:18:33.974 17:11:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:33.974 17:11:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:33.974 17:11:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:33.974 17:11:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:33.974 17:11:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:33.974 17:11:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:33.974 17:11:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:33.974 17:11:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:33.974 17:11:30 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:33.974 17:11:30 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:33.974 17:11:30 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:33.974 17:11:30 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:33.974 17:11:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:33.974 17:11:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:33.974 17:11:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:33.974 17:11:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:33.974 17:11:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:33.974 17:11:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:33.974 17:11:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:33.974 17:11:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:33.974 17:11:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:33.974 17:11:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:33.974 17:11:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:33.974 17:11:30 -- common/autotest_common.sh@10 -- # set +x 00:18:36.505 17:11:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:36.505 17:11:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:36.505 17:11:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:36.505 17:11:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:36.505 17:11:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:36.505 17:11:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:36.505 17:11:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:36.505 17:11:32 -- nvmf/common.sh@294 -- # net_devs=() 00:18:36.505 17:11:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:36.505 17:11:32 -- nvmf/common.sh@295 -- # e810=() 00:18:36.505 17:11:32 -- nvmf/common.sh@295 -- # local -ga e810 00:18:36.505 17:11:32 -- nvmf/common.sh@296 -- # x722=() 00:18:36.505 17:11:32 -- nvmf/common.sh@296 -- # local -ga x722 00:18:36.505 17:11:32 -- nvmf/common.sh@297 -- # mlx=() 00:18:36.505 17:11:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:36.505 17:11:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:36.505 17:11:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:36.505 17:11:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:36.505 17:11:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:36.505 17:11:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:36.505 17:11:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:36.505 17:11:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:36.505 17:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:36.506 17:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:36.506 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:36.506 17:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:36.506 17:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:36.506 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:36.506 17:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:36.506 17:11:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:36.506 17:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:36.506 17:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:36.506 17:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:36.506 17:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:36.506 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:36.506 17:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:36.506 17:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:36.506 17:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:36.506 17:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:36.506 17:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:36.506 17:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:36.506 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:36.506 17:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:36.506 17:11:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:36.506 17:11:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:36.506 17:11:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:36.506 17:11:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:36.506 17:11:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:36.506 17:11:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:36.506 17:11:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:36.506 17:11:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:36.506 17:11:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:36.506 17:11:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:36.506 17:11:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:36.506 17:11:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:36.506 17:11:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:36.506 17:11:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:36.506 17:11:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:36.506 17:11:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:36.506 17:11:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:36.506 17:11:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:36.506 17:11:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:36.506 17:11:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:36.506 17:11:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:36.506 17:11:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:36.506 17:11:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:36.506 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:36.506 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:18:36.506 00:18:36.506 --- 10.0.0.2 ping statistics --- 00:18:36.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:36.506 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:18:36.506 17:11:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:36.506 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:36.506 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:18:36.506 00:18:36.506 --- 10.0.0.1 ping statistics --- 00:18:36.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:36.506 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:18:36.506 17:11:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:36.506 17:11:32 -- nvmf/common.sh@410 -- # return 0 00:18:36.506 17:11:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:36.506 17:11:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:36.506 17:11:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:36.506 17:11:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:36.506 17:11:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:36.506 17:11:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:36.506 17:11:33 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:36.506 17:11:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:36.506 17:11:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:36.506 17:11:33 -- common/autotest_common.sh@10 -- # set +x 00:18:36.506 17:11:33 -- nvmf/common.sh@469 -- # nvmfpid=1745021 00:18:36.506 17:11:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:36.506 17:11:33 -- nvmf/common.sh@470 -- # waitforlisten 1745021 00:18:36.506 17:11:33 -- common/autotest_common.sh@829 -- # '[' -z 1745021 ']' 00:18:36.506 17:11:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:36.506 17:11:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:36.506 17:11:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:36.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:36.506 17:11:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:36.506 17:11:33 -- common/autotest_common.sh@10 -- # set +x 00:18:36.506 [2024-11-27 17:11:33.045003] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:36.506 [2024-11-27 17:11:33.045068] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:36.506 EAL: No free 2048 kB hugepages reported on node 1 00:18:36.506 [2024-11-27 17:11:33.107337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:36.506 [2024-11-27 17:11:33.190289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:36.506 [2024-11-27 17:11:33.190434] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:36.506 [2024-11-27 17:11:33.190451] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:36.506 [2024-11-27 17:11:33.190463] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:36.506 [2024-11-27 17:11:33.190489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:37.072 17:11:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:37.072 17:11:34 -- common/autotest_common.sh@862 -- # return 0 00:18:37.072 17:11:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:37.072 17:11:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:37.072 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 17:11:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:37.330 17:11:34 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:37.330 17:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 [2024-11-27 17:11:34.032458] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:37.330 17:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.330 17:11:34 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:37.330 17:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 Malloc0 00:18:37.330 17:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.330 17:11:34 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:37.330 17:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 17:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.330 17:11:34 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:37.330 17:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 17:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.330 17:11:34 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:37.330 17:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 [2024-11-27 17:11:34.093210] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:37.330 17:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.330 17:11:34 -- target/queue_depth.sh@30 -- # bdevperf_pid=1745175 00:18:37.330 17:11:34 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:37.330 17:11:34 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:37.330 17:11:34 -- target/queue_depth.sh@33 -- # waitforlisten 1745175 /var/tmp/bdevperf.sock 00:18:37.330 17:11:34 -- common/autotest_common.sh@829 -- # '[' -z 1745175 ']' 00:18:37.330 17:11:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:37.330 17:11:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:37.330 17:11:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:37.330 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:37.330 17:11:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:37.330 17:11:34 -- common/autotest_common.sh@10 -- # set +x 00:18:37.330 [2024-11-27 17:11:34.140675] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:37.330 [2024-11-27 17:11:34.140748] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1745175 ] 00:18:37.330 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.330 [2024-11-27 17:11:34.205477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.588 [2024-11-27 17:11:34.296684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:38.522 17:11:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:38.522 17:11:35 -- common/autotest_common.sh@862 -- # return 0 00:18:38.522 17:11:35 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:38.522 17:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:38.522 17:11:35 -- common/autotest_common.sh@10 -- # set +x 00:18:38.522 NVMe0n1 00:18:38.522 17:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:38.522 17:11:35 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:38.522 Running I/O for 10 seconds... 00:18:48.492 00:18:48.492 Latency(us) 00:18:48.492 [2024-11-27T16:11:45.443Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:48.492 [2024-11-27T16:11:45.443Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:48.492 Verification LBA range: start 0x0 length 0x4000 00:18:48.492 NVMe0n1 : 10.07 12245.13 47.83 0.00 0.00 83295.81 14951.92 62914.56 00:18:48.492 [2024-11-27T16:11:45.443Z] =================================================================================================================== 00:18:48.492 [2024-11-27T16:11:45.443Z] Total : 12245.13 47.83 0.00 0.00 83295.81 14951.92 62914.56 00:18:48.492 0 00:18:48.492 17:11:45 -- target/queue_depth.sh@39 -- # killprocess 1745175 00:18:48.492 17:11:45 -- common/autotest_common.sh@936 -- # '[' -z 1745175 ']' 00:18:48.492 17:11:45 -- common/autotest_common.sh@940 -- # kill -0 1745175 00:18:48.492 17:11:45 -- common/autotest_common.sh@941 -- # uname 00:18:48.492 17:11:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:48.492 17:11:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1745175 00:18:48.751 17:11:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:48.751 17:11:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:48.751 17:11:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1745175' 00:18:48.751 killing process with pid 1745175 00:18:48.751 17:11:45 -- common/autotest_common.sh@955 -- # kill 1745175 00:18:48.751 Received shutdown signal, test time was about 10.000000 seconds 00:18:48.751 00:18:48.751 Latency(us) 00:18:48.751 [2024-11-27T16:11:45.702Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:48.751 [2024-11-27T16:11:45.702Z] =================================================================================================================== 00:18:48.751 [2024-11-27T16:11:45.702Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:48.751 17:11:45 -- common/autotest_common.sh@960 -- # wait 1745175 00:18:48.751 17:11:45 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:48.751 17:11:45 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:48.751 17:11:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:48.751 17:11:45 -- nvmf/common.sh@116 -- # sync 00:18:48.751 17:11:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:48.751 17:11:45 -- nvmf/common.sh@119 -- # set +e 00:18:48.751 17:11:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:48.751 17:11:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:48.751 rmmod nvme_tcp 00:18:48.751 rmmod nvme_fabrics 00:18:49.009 rmmod nvme_keyring 00:18:49.009 17:11:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:49.009 17:11:45 -- nvmf/common.sh@123 -- # set -e 00:18:49.009 17:11:45 -- nvmf/common.sh@124 -- # return 0 00:18:49.009 17:11:45 -- nvmf/common.sh@477 -- # '[' -n 1745021 ']' 00:18:49.009 17:11:45 -- nvmf/common.sh@478 -- # killprocess 1745021 00:18:49.009 17:11:45 -- common/autotest_common.sh@936 -- # '[' -z 1745021 ']' 00:18:49.009 17:11:45 -- common/autotest_common.sh@940 -- # kill -0 1745021 00:18:49.009 17:11:45 -- common/autotest_common.sh@941 -- # uname 00:18:49.009 17:11:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:49.009 17:11:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1745021 00:18:49.009 17:11:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:49.009 17:11:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:49.009 17:11:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1745021' 00:18:49.009 killing process with pid 1745021 00:18:49.009 17:11:45 -- common/autotest_common.sh@955 -- # kill 1745021 00:18:49.009 17:11:45 -- common/autotest_common.sh@960 -- # wait 1745021 00:18:49.269 17:11:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:49.269 17:11:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:49.269 17:11:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:49.269 17:11:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:49.269 17:11:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:49.269 17:11:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:49.269 17:11:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:49.269 17:11:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.172 17:11:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:51.172 00:18:51.172 real 0m17.472s 00:18:51.172 user 0m24.944s 00:18:51.172 sys 0m3.214s 00:18:51.172 17:11:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:51.172 17:11:48 -- common/autotest_common.sh@10 -- # set +x 00:18:51.172 ************************************ 00:18:51.172 END TEST nvmf_queue_depth 00:18:51.172 ************************************ 00:18:51.172 17:11:48 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:51.172 17:11:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:51.172 17:11:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:51.172 17:11:48 -- common/autotest_common.sh@10 -- # set +x 00:18:51.172 ************************************ 00:18:51.172 START TEST nvmf_multipath 00:18:51.172 ************************************ 00:18:51.172 17:11:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:51.432 * Looking for test storage... 00:18:51.432 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:51.432 17:11:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:51.432 17:11:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:51.432 17:11:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:51.432 17:11:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:51.432 17:11:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:51.432 17:11:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:51.432 17:11:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:51.432 17:11:48 -- scripts/common.sh@335 -- # IFS=.-: 00:18:51.432 17:11:48 -- scripts/common.sh@335 -- # read -ra ver1 00:18:51.432 17:11:48 -- scripts/common.sh@336 -- # IFS=.-: 00:18:51.432 17:11:48 -- scripts/common.sh@336 -- # read -ra ver2 00:18:51.432 17:11:48 -- scripts/common.sh@337 -- # local 'op=<' 00:18:51.432 17:11:48 -- scripts/common.sh@339 -- # ver1_l=2 00:18:51.432 17:11:48 -- scripts/common.sh@340 -- # ver2_l=1 00:18:51.432 17:11:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:51.432 17:11:48 -- scripts/common.sh@343 -- # case "$op" in 00:18:51.432 17:11:48 -- scripts/common.sh@344 -- # : 1 00:18:51.432 17:11:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:51.432 17:11:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:51.432 17:11:48 -- scripts/common.sh@364 -- # decimal 1 00:18:51.432 17:11:48 -- scripts/common.sh@352 -- # local d=1 00:18:51.432 17:11:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:51.432 17:11:48 -- scripts/common.sh@354 -- # echo 1 00:18:51.432 17:11:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:51.432 17:11:48 -- scripts/common.sh@365 -- # decimal 2 00:18:51.432 17:11:48 -- scripts/common.sh@352 -- # local d=2 00:18:51.432 17:11:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:51.432 17:11:48 -- scripts/common.sh@354 -- # echo 2 00:18:51.432 17:11:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:51.432 17:11:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:51.432 17:11:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:51.432 17:11:48 -- scripts/common.sh@367 -- # return 0 00:18:51.432 17:11:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:51.432 17:11:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:51.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:51.432 --rc genhtml_branch_coverage=1 00:18:51.432 --rc genhtml_function_coverage=1 00:18:51.432 --rc genhtml_legend=1 00:18:51.432 --rc geninfo_all_blocks=1 00:18:51.432 --rc geninfo_unexecuted_blocks=1 00:18:51.432 00:18:51.432 ' 00:18:51.432 17:11:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:51.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:51.432 --rc genhtml_branch_coverage=1 00:18:51.432 --rc genhtml_function_coverage=1 00:18:51.432 --rc genhtml_legend=1 00:18:51.432 --rc geninfo_all_blocks=1 00:18:51.432 --rc geninfo_unexecuted_blocks=1 00:18:51.432 00:18:51.432 ' 00:18:51.432 17:11:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:51.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:51.432 --rc genhtml_branch_coverage=1 00:18:51.432 --rc genhtml_function_coverage=1 00:18:51.432 --rc genhtml_legend=1 00:18:51.432 --rc geninfo_all_blocks=1 00:18:51.432 --rc geninfo_unexecuted_blocks=1 00:18:51.432 00:18:51.432 ' 00:18:51.432 17:11:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:51.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:51.432 --rc genhtml_branch_coverage=1 00:18:51.432 --rc genhtml_function_coverage=1 00:18:51.432 --rc genhtml_legend=1 00:18:51.432 --rc geninfo_all_blocks=1 00:18:51.432 --rc geninfo_unexecuted_blocks=1 00:18:51.432 00:18:51.432 ' 00:18:51.432 17:11:48 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:51.432 17:11:48 -- nvmf/common.sh@7 -- # uname -s 00:18:51.432 17:11:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:51.432 17:11:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:51.432 17:11:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:51.432 17:11:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:51.432 17:11:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:51.432 17:11:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:51.432 17:11:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:51.432 17:11:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:51.432 17:11:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:51.432 17:11:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:51.432 17:11:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.432 17:11:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.432 17:11:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:51.432 17:11:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:51.432 17:11:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:51.432 17:11:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:51.432 17:11:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:51.432 17:11:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:51.432 17:11:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:51.432 17:11:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.432 17:11:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.432 17:11:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.432 17:11:48 -- paths/export.sh@5 -- # export PATH 00:18:51.432 17:11:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.432 17:11:48 -- nvmf/common.sh@46 -- # : 0 00:18:51.432 17:11:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:51.432 17:11:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:51.432 17:11:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:51.432 17:11:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:51.432 17:11:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:51.432 17:11:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:51.432 17:11:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:51.432 17:11:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:51.432 17:11:48 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:51.432 17:11:48 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:51.432 17:11:48 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:51.432 17:11:48 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:51.432 17:11:48 -- target/multipath.sh@43 -- # nvmftestinit 00:18:51.432 17:11:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:51.432 17:11:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:51.433 17:11:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:51.433 17:11:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:51.433 17:11:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:51.433 17:11:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.433 17:11:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.433 17:11:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.433 17:11:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:51.433 17:11:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:51.433 17:11:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:51.433 17:11:48 -- common/autotest_common.sh@10 -- # set +x 00:18:53.972 17:11:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:53.972 17:11:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:53.972 17:11:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:53.972 17:11:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:53.972 17:11:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:53.972 17:11:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:53.972 17:11:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:53.972 17:11:50 -- nvmf/common.sh@294 -- # net_devs=() 00:18:53.972 17:11:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:53.972 17:11:50 -- nvmf/common.sh@295 -- # e810=() 00:18:53.972 17:11:50 -- nvmf/common.sh@295 -- # local -ga e810 00:18:53.972 17:11:50 -- nvmf/common.sh@296 -- # x722=() 00:18:53.972 17:11:50 -- nvmf/common.sh@296 -- # local -ga x722 00:18:53.972 17:11:50 -- nvmf/common.sh@297 -- # mlx=() 00:18:53.972 17:11:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:53.972 17:11:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:53.972 17:11:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:53.972 17:11:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:53.972 17:11:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:53.972 17:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.972 17:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:53.972 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:53.972 17:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.972 17:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:53.972 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:53.972 17:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:53.972 17:11:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:53.972 17:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.972 17:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.972 17:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.972 17:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.972 17:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:53.972 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:53.972 17:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.972 17:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.972 17:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.972 17:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.972 17:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.972 17:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:53.973 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:53.973 17:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.973 17:11:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:53.973 17:11:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:53.973 17:11:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:53.973 17:11:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:53.973 17:11:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:53.973 17:11:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:53.973 17:11:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:53.973 17:11:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:53.973 17:11:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:53.973 17:11:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:53.973 17:11:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:53.973 17:11:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:53.973 17:11:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:53.973 17:11:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:53.973 17:11:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:53.973 17:11:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:53.973 17:11:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:53.973 17:11:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:53.973 17:11:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:53.973 17:11:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:53.973 17:11:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:53.973 17:11:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:53.973 17:11:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:53.973 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:53.973 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:18:53.973 00:18:53.973 --- 10.0.0.2 ping statistics --- 00:18:53.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.973 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:18:53.973 17:11:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:53.973 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:53.973 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:18:53.973 00:18:53.973 --- 10.0.0.1 ping statistics --- 00:18:53.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.973 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:18:53.973 17:11:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:53.973 17:11:50 -- nvmf/common.sh@410 -- # return 0 00:18:53.973 17:11:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:53.973 17:11:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:53.973 17:11:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:53.973 17:11:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:53.973 17:11:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:53.973 17:11:50 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:53.973 17:11:50 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:53.973 only one NIC for nvmf test 00:18:53.973 17:11:50 -- target/multipath.sh@47 -- # nvmftestfini 00:18:53.973 17:11:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:53.973 17:11:50 -- nvmf/common.sh@116 -- # sync 00:18:53.973 17:11:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:53.973 17:11:50 -- nvmf/common.sh@119 -- # set +e 00:18:53.973 17:11:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:53.973 17:11:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:53.973 rmmod nvme_tcp 00:18:53.973 rmmod nvme_fabrics 00:18:53.973 rmmod nvme_keyring 00:18:53.973 17:11:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:53.973 17:11:50 -- nvmf/common.sh@123 -- # set -e 00:18:53.973 17:11:50 -- nvmf/common.sh@124 -- # return 0 00:18:53.973 17:11:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:53.973 17:11:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:53.973 17:11:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:53.973 17:11:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:53.973 17:11:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:53.973 17:11:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.973 17:11:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.973 17:11:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.958 17:11:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.958 17:11:52 -- target/multipath.sh@48 -- # exit 0 00:18:55.958 17:11:52 -- target/multipath.sh@1 -- # nvmftestfini 00:18:55.958 17:11:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:55.958 17:11:52 -- nvmf/common.sh@116 -- # sync 00:18:55.958 17:11:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:55.958 17:11:52 -- nvmf/common.sh@119 -- # set +e 00:18:55.958 17:11:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:55.958 17:11:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:55.958 17:11:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:55.958 17:11:52 -- nvmf/common.sh@123 -- # set -e 00:18:55.958 17:11:52 -- nvmf/common.sh@124 -- # return 0 00:18:55.958 17:11:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:55.958 17:11:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:55.958 17:11:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:55.958 17:11:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:55.958 17:11:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:55.958 17:11:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:55.958 17:11:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.958 17:11:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.958 17:11:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.958 17:11:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.958 00:18:55.958 real 0m4.517s 00:18:55.958 user 0m0.928s 00:18:55.958 sys 0m1.577s 00:18:55.958 17:11:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:55.958 17:11:52 -- common/autotest_common.sh@10 -- # set +x 00:18:55.958 ************************************ 00:18:55.958 END TEST nvmf_multipath 00:18:55.958 ************************************ 00:18:55.958 17:11:52 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:55.958 17:11:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:55.958 17:11:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:55.958 17:11:52 -- common/autotest_common.sh@10 -- # set +x 00:18:55.958 ************************************ 00:18:55.958 START TEST nvmf_zcopy 00:18:55.958 ************************************ 00:18:55.958 17:11:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:55.958 * Looking for test storage... 00:18:55.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:55.958 17:11:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:55.958 17:11:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:55.958 17:11:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:55.958 17:11:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:55.958 17:11:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:55.958 17:11:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:55.958 17:11:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:55.958 17:11:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:55.958 17:11:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:55.958 17:11:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:55.958 17:11:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:55.958 17:11:52 -- scripts/common.sh@337 -- # local 'op=<' 00:18:55.958 17:11:52 -- scripts/common.sh@339 -- # ver1_l=2 00:18:55.958 17:11:52 -- scripts/common.sh@340 -- # ver2_l=1 00:18:55.958 17:11:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:55.958 17:11:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:55.958 17:11:52 -- scripts/common.sh@344 -- # : 1 00:18:55.958 17:11:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:55.958 17:11:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:55.958 17:11:52 -- scripts/common.sh@364 -- # decimal 1 00:18:55.958 17:11:52 -- scripts/common.sh@352 -- # local d=1 00:18:55.958 17:11:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:55.958 17:11:52 -- scripts/common.sh@354 -- # echo 1 00:18:55.959 17:11:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:55.959 17:11:52 -- scripts/common.sh@365 -- # decimal 2 00:18:55.959 17:11:52 -- scripts/common.sh@352 -- # local d=2 00:18:55.959 17:11:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:55.959 17:11:52 -- scripts/common.sh@354 -- # echo 2 00:18:55.959 17:11:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:55.959 17:11:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:55.959 17:11:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:55.959 17:11:52 -- scripts/common.sh@367 -- # return 0 00:18:55.959 17:11:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:55.959 17:11:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:55.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.959 --rc genhtml_branch_coverage=1 00:18:55.959 --rc genhtml_function_coverage=1 00:18:55.959 --rc genhtml_legend=1 00:18:55.959 --rc geninfo_all_blocks=1 00:18:55.959 --rc geninfo_unexecuted_blocks=1 00:18:55.959 00:18:55.959 ' 00:18:55.959 17:11:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:55.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.959 --rc genhtml_branch_coverage=1 00:18:55.959 --rc genhtml_function_coverage=1 00:18:55.959 --rc genhtml_legend=1 00:18:55.959 --rc geninfo_all_blocks=1 00:18:55.959 --rc geninfo_unexecuted_blocks=1 00:18:55.959 00:18:55.959 ' 00:18:55.959 17:11:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:55.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.959 --rc genhtml_branch_coverage=1 00:18:55.959 --rc genhtml_function_coverage=1 00:18:55.959 --rc genhtml_legend=1 00:18:55.959 --rc geninfo_all_blocks=1 00:18:55.959 --rc geninfo_unexecuted_blocks=1 00:18:55.959 00:18:55.959 ' 00:18:55.959 17:11:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:55.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.959 --rc genhtml_branch_coverage=1 00:18:55.959 --rc genhtml_function_coverage=1 00:18:55.959 --rc genhtml_legend=1 00:18:55.959 --rc geninfo_all_blocks=1 00:18:55.959 --rc geninfo_unexecuted_blocks=1 00:18:55.959 00:18:55.959 ' 00:18:55.959 17:11:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:55.959 17:11:52 -- nvmf/common.sh@7 -- # uname -s 00:18:55.959 17:11:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:55.959 17:11:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:55.959 17:11:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:55.959 17:11:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:55.959 17:11:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:55.959 17:11:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:55.959 17:11:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:55.959 17:11:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:55.959 17:11:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:55.959 17:11:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:55.959 17:11:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.959 17:11:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.959 17:11:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:55.959 17:11:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:55.959 17:11:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:55.959 17:11:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:55.959 17:11:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:55.959 17:11:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:55.959 17:11:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:55.959 17:11:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.959 17:11:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.959 17:11:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.959 17:11:52 -- paths/export.sh@5 -- # export PATH 00:18:55.959 17:11:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.959 17:11:52 -- nvmf/common.sh@46 -- # : 0 00:18:55.959 17:11:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:55.959 17:11:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:55.959 17:11:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:55.959 17:11:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:55.959 17:11:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:55.959 17:11:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:55.959 17:11:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:55.959 17:11:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:55.959 17:11:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:55.959 17:11:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:55.959 17:11:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:55.959 17:11:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:55.959 17:11:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:55.959 17:11:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:55.959 17:11:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.959 17:11:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.959 17:11:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.959 17:11:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:55.959 17:11:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:55.959 17:11:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:55.959 17:11:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.491 17:11:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:58.491 17:11:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:58.491 17:11:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:58.491 17:11:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:58.491 17:11:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:58.491 17:11:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:58.492 17:11:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:58.492 17:11:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:58.492 17:11:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:58.492 17:11:54 -- nvmf/common.sh@295 -- # e810=() 00:18:58.492 17:11:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:58.492 17:11:54 -- nvmf/common.sh@296 -- # x722=() 00:18:58.492 17:11:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:58.492 17:11:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:58.492 17:11:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:58.492 17:11:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:58.492 17:11:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:58.492 17:11:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:58.492 17:11:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:58.492 17:11:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:58.492 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:58.492 17:11:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:58.492 17:11:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:58.492 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:58.492 17:11:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:58.492 17:11:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:58.492 17:11:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:58.492 17:11:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:58.492 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:58.492 17:11:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:58.492 17:11:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:58.492 17:11:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:58.492 17:11:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:58.492 17:11:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:58.492 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:58.492 17:11:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:58.492 17:11:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:58.492 17:11:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:58.492 17:11:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:58.492 17:11:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:58.492 17:11:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:58.492 17:11:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:58.492 17:11:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:58.492 17:11:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:58.492 17:11:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:58.492 17:11:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:58.492 17:11:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:58.492 17:11:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:58.492 17:11:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:58.492 17:11:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:58.492 17:11:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:58.492 17:11:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:58.492 17:11:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:58.492 17:11:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:58.492 17:11:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:58.492 17:11:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:58.492 17:11:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:58.492 17:11:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:58.492 17:11:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:58.492 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:58.492 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:18:58.492 00:18:58.492 --- 10.0.0.2 ping statistics --- 00:18:58.492 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.492 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:18:58.492 17:11:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:58.492 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:58.492 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:18:58.492 00:18:58.492 --- 10.0.0.1 ping statistics --- 00:18:58.492 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.492 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:18:58.492 17:11:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:58.492 17:11:55 -- nvmf/common.sh@410 -- # return 0 00:18:58.492 17:11:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:58.492 17:11:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:58.492 17:11:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:58.492 17:11:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:58.492 17:11:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:58.492 17:11:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:58.492 17:11:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:58.492 17:11:55 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:58.492 17:11:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:58.492 17:11:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:58.492 17:11:55 -- common/autotest_common.sh@10 -- # set +x 00:18:58.492 17:11:55 -- nvmf/common.sh@469 -- # nvmfpid=1750439 00:18:58.492 17:11:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:58.492 17:11:55 -- nvmf/common.sh@470 -- # waitforlisten 1750439 00:18:58.492 17:11:55 -- common/autotest_common.sh@829 -- # '[' -z 1750439 ']' 00:18:58.492 17:11:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:58.492 17:11:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:58.492 17:11:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:58.492 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:58.492 17:11:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:58.492 17:11:55 -- common/autotest_common.sh@10 -- # set +x 00:18:58.492 [2024-11-27 17:11:55.110036] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:58.492 [2024-11-27 17:11:55.110103] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:58.492 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.492 [2024-11-27 17:11:55.176732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:58.492 [2024-11-27 17:11:55.267881] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:58.492 [2024-11-27 17:11:55.268048] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:58.492 [2024-11-27 17:11:55.268067] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:58.492 [2024-11-27 17:11:55.268081] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:58.492 [2024-11-27 17:11:55.268111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:59.427 17:11:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:59.427 17:11:56 -- common/autotest_common.sh@862 -- # return 0 00:18:59.427 17:11:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:59.427 17:11:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 17:11:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:59.427 17:11:56 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:59.427 17:11:56 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 [2024-11-27 17:11:56.142230] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 [2024-11-27 17:11:56.158420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 malloc0 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:59.427 17:11:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.427 17:11:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.427 17:11:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.427 17:11:56 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:59.427 17:11:56 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:59.427 17:11:56 -- nvmf/common.sh@520 -- # config=() 00:18:59.427 17:11:56 -- nvmf/common.sh@520 -- # local subsystem config 00:18:59.427 17:11:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:59.427 17:11:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:59.427 { 00:18:59.427 "params": { 00:18:59.427 "name": "Nvme$subsystem", 00:18:59.427 "trtype": "$TEST_TRANSPORT", 00:18:59.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:59.427 "adrfam": "ipv4", 00:18:59.427 "trsvcid": "$NVMF_PORT", 00:18:59.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:59.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:59.427 "hdgst": ${hdgst:-false}, 00:18:59.427 "ddgst": ${ddgst:-false} 00:18:59.427 }, 00:18:59.427 "method": "bdev_nvme_attach_controller" 00:18:59.427 } 00:18:59.427 EOF 00:18:59.427 )") 00:18:59.427 17:11:56 -- nvmf/common.sh@542 -- # cat 00:18:59.427 17:11:56 -- nvmf/common.sh@544 -- # jq . 00:18:59.427 17:11:56 -- nvmf/common.sh@545 -- # IFS=, 00:18:59.427 17:11:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:59.427 "params": { 00:18:59.427 "name": "Nvme1", 00:18:59.427 "trtype": "tcp", 00:18:59.427 "traddr": "10.0.0.2", 00:18:59.427 "adrfam": "ipv4", 00:18:59.427 "trsvcid": "4420", 00:18:59.427 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:59.427 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:59.427 "hdgst": false, 00:18:59.427 "ddgst": false 00:18:59.427 }, 00:18:59.427 "method": "bdev_nvme_attach_controller" 00:18:59.427 }' 00:18:59.427 [2024-11-27 17:11:56.230774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:59.427 [2024-11-27 17:11:56.230863] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1750596 ] 00:18:59.427 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.427 [2024-11-27 17:11:56.293370] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.685 [2024-11-27 17:11:56.385319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.685 Running I/O for 10 seconds... 00:19:11.887 00:19:11.887 Latency(us) 00:19:11.887 [2024-11-27T16:12:08.838Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:11.887 [2024-11-27T16:12:08.838Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:11.887 Verification LBA range: start 0x0 length 0x1000 00:19:11.887 Nvme1n1 : 10.05 8572.26 66.97 0.00 0.00 14842.74 3422.44 44273.21 00:19:11.887 [2024-11-27T16:12:08.838Z] =================================================================================================================== 00:19:11.887 [2024-11-27T16:12:08.838Z] Total : 8572.26 66.97 0.00 0.00 14842.74 3422.44 44273.21 00:19:11.887 17:12:06 -- target/zcopy.sh@39 -- # perfpid=1752049 00:19:11.887 17:12:06 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:11.887 17:12:06 -- common/autotest_common.sh@10 -- # set +x 00:19:11.887 17:12:06 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:11.887 17:12:06 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:11.887 17:12:06 -- nvmf/common.sh@520 -- # config=() 00:19:11.887 17:12:06 -- nvmf/common.sh@520 -- # local subsystem config 00:19:11.887 17:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:11.887 17:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:11.887 { 00:19:11.887 "params": { 00:19:11.887 "name": "Nvme$subsystem", 00:19:11.887 "trtype": "$TEST_TRANSPORT", 00:19:11.887 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:11.887 "adrfam": "ipv4", 00:19:11.887 "trsvcid": "$NVMF_PORT", 00:19:11.887 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:11.887 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:11.887 "hdgst": ${hdgst:-false}, 00:19:11.887 "ddgst": ${ddgst:-false} 00:19:11.887 }, 00:19:11.887 "method": "bdev_nvme_attach_controller" 00:19:11.887 } 00:19:11.888 EOF 00:19:11.888 )") 00:19:11.888 17:12:06 -- nvmf/common.sh@542 -- # cat 00:19:11.888 [2024-11-27 17:12:06.886957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 17:12:06 -- nvmf/common.sh@544 -- # jq . 00:19:11.888 [2024-11-27 17:12:06.887004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 17:12:06 -- nvmf/common.sh@545 -- # IFS=, 00:19:11.888 17:12:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:11.888 "params": { 00:19:11.888 "name": "Nvme1", 00:19:11.888 "trtype": "tcp", 00:19:11.888 "traddr": "10.0.0.2", 00:19:11.888 "adrfam": "ipv4", 00:19:11.888 "trsvcid": "4420", 00:19:11.888 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:11.888 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:11.888 "hdgst": false, 00:19:11.888 "ddgst": false 00:19:11.888 }, 00:19:11.888 "method": "bdev_nvme_attach_controller" 00:19:11.888 }' 00:19:11.888 [2024-11-27 17:12:06.894914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.894941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.902932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.902958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.910954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.910979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.918979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.919004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.923281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:11.888 [2024-11-27 17:12:06.923349] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1752049 ] 00:19:11.888 [2024-11-27 17:12:06.926998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.927024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.935020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.935046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.943042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.943067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.951065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.951089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 EAL: No free 2048 kB hugepages reported on node 1 00:19:11.888 [2024-11-27 17:12:06.959086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.959110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.967107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.967132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.975128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.975161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.983150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.983175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.991175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.991200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:06.991300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:11.888 [2024-11-27 17:12:06.999234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:06.999272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.007239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.007274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.015243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.015268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.023266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.023291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.031286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.031311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.039309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.039335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.047359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.047397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.055357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.055384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.063377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.063405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.071397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.071422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.079419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.079445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.083599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:11.888 [2024-11-27 17:12:07.087441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.087466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.095464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.095488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.103509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.103560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.111540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.111578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.119567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.119617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.127585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.127627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.135610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.135652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.143628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.143667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.151624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.151650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.159669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.159709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.167693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.167735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.175688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.175713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.183720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.183749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.191745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.191774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.199766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.199794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.207813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.207842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.215832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.215860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.223859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.223887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.231882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.231910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.239901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.239928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 [2024-11-27 17:12:07.247949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.247979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.888 Running I/O for 5 seconds... 00:19:11.888 [2024-11-27 17:12:07.255969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.888 [2024-11-27 17:12:07.255995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.268386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.268419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.278589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.278630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.291004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.291036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.302437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.302469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.313602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.313632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.324892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.324922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.336117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.336148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.347560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.347591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.358754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.358786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.371995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.372026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.382355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.382386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.393814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.393845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.407121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.407152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.417716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.417747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.428948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.428980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.441807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.441845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.450850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.450881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.463033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.463064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.475850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.475881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.485931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.485962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.496953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.496994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.508073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.508103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.519251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.519282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.532607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.532639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.542940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.542983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.554505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.554549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.565918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.565949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.577163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.577194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.588103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.588134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.599047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.599079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.611872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.611903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.621701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.621732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.633463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.633496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.644851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.644881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.655839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.655870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.668989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.669023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.679543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.679574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.690701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.690732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.703567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.703602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.714362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.714393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.725388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.725420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.736448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.736480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.747724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.747755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.760833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.760863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.771484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.771538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.782161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.782193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.793424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.793455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.804602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.804633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.817780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.817811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.827944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.827975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.838843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.838873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.850092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.850123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.861058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.861089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.873967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.889 [2024-11-27 17:12:07.873998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.889 [2024-11-27 17:12:07.884034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.884066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.895158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.895189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.907814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.907846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.916920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.916950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.930090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.930120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.940624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.940656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.951737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.951768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.962930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.962961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.973974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.974006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.985021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.985052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:07.995727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:07.995758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.008151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.008183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.018267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.018298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.029536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.029567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.042202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.042233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.052410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.052440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.063735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.063766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.076638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.076669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.086957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.086988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.097814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.097844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.110471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.110501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.121212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.121243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.132150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.132182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.142645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.142676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.153477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.153507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.164718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.164748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.175791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.175822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.188354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.188385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.197877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.197907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.209129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.209160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.220700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.220731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.232320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.232352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.243615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.243647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.254633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.254664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.265741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.265772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.277226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.277258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.288659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.288691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.300216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.300248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.313187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.313218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.323304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.323335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.335043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.335074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.345907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.345938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.358939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.358970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.369274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.369305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.380268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.380299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.393693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.393724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.404535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.404576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.415562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.415593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.428327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.428359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.438395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.438427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.449640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.449673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.462268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.462297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.473539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.473568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.482010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.482037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.890 [2024-11-27 17:12:08.493037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.890 [2024-11-27 17:12:08.493065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.505725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.505754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.514905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.514933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.525634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.525662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.535631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.535659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.546048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.546076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.556272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.556308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.566831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.566859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.576739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.576767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.586712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.586739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.596964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.596992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.607230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.607257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.617816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.617844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.628127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.628156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.638477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.638505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.649004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.649032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.659648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.659678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.670203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.670235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.682344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.682375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.691826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.691853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.704356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.704383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.714251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.714279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.724499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.724535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.734950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.734988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.746181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.746212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.759699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.759734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.770088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.770119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.781147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.781178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.793991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.794022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.803401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.803432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.814929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.814957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.891 [2024-11-27 17:12:08.827536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.891 [2024-11-27 17:12:08.827568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.837667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.837696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.848646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.848676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.861678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.861707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.872233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.872264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.883460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.883491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.896475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.896506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.906928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.906960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.918191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.918223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.931481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.931511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.942291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.150 [2024-11-27 17:12:08.942322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.150 [2024-11-27 17:12:08.953852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:08.953884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:08.964494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:08.964535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:08.975259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:08.975305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:08.986434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:08.986465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:08.997343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:08.997372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.008438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.008470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.020097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.020129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.031358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.031389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.045010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.045041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.055294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.055325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.066767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.066794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.077338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.077369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.088231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.088262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.151 [2024-11-27 17:12:09.099307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.151 [2024-11-27 17:12:09.099338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.112318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.112349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.122817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.122860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.133557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.133610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.146412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.146444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.156676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.156705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.167605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.167634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.180283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.180314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.192021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.192061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.201601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.201630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.211764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.211792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.222648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.222677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.235762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.235790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.245659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.245687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.408 [2024-11-27 17:12:09.256379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.408 [2024-11-27 17:12:09.256409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.269497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.269538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.281750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.281778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.290926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.290957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.303094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.303126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.313601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.313629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.324428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.324458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.337643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.337671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.409 [2024-11-27 17:12:09.348177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.409 [2024-11-27 17:12:09.348208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.359610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.359641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.370842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.370877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.382190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.382220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.393159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.393190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.403783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.403818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.414504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.414545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.425365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.425396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.436376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.436407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.449021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.449052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.459179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.459210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.470607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.470638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.481910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.481941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.494649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.494681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.505208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.505238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.516210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.516241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.527068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.527099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.538157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.538188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.550918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.550948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.561032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.561062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.573004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.573035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.584070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.584101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.596990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.597021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.667 [2024-11-27 17:12:09.607141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.667 [2024-11-27 17:12:09.607172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.618339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.618369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.629199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.629230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.640967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.641000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.651575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.651605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.662615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.662645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.675383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.675413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.686026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.686056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.697232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.697263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.708194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.708224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.719284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.719315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.730397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.730427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.741235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.741264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.754254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.754284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.764711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.764741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.775451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.775481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.788608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.788638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.798830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.798861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.810470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.810500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.821330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.821361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.833983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.834013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.844536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.844565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.855517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.855555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.927 [2024-11-27 17:12:09.867958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.927 [2024-11-27 17:12:09.867987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.877020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.877050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.890460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.890490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.901051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.901080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.912365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.912395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.925600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.925630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.935898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.935927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.946624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.946655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.957339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.957369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.968804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.968846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.980089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.980119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:09.991412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:09.991444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.003002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.003033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.015188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.015228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.027232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.027266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.039575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.039611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.050579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.050611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.186 [2024-11-27 17:12:10.061790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.186 [2024-11-27 17:12:10.061822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.074808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.074844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.085120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.085150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.096502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.096540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.107195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.107226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.118046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.118076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.187 [2024-11-27 17:12:10.128831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.187 [2024-11-27 17:12:10.128861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.140241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.140272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.153490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.153520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.163806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.163836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.175566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.175596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.186007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.186037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.196757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.196787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.208036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.208066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.219145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.219175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.231817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.231847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.242017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.242048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.252904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.252943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.263988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.264017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.274708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.274743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.285817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.285847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.296886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.296915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.308183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.308213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.319514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.319555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.330129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.330159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.340762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.340792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.351562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.351591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.362730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.362760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.375769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.375798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.445 [2024-11-27 17:12:10.386058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.445 [2024-11-27 17:12:10.386088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.397435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.397465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.410316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.410346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.420841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.420870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.431897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.431926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.442564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.442593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.453392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.453422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.464396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.464435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.475376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.475405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.488096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.488125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.497523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.497562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.509218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.509248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.519604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.519634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.530853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.530884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.543433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.543463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.553555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.553585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.565802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.565832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.576666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.576696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.587349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.587379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.598238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.598268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.609337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.609367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.621961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.621991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.631898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.631927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.642966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.642995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.704 [2024-11-27 17:12:10.653627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.704 [2024-11-27 17:12:10.653658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.664504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.664544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.677473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.677512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.687816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.687846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.698741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.698770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.711552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.711582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.721893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.721923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.732660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.732690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.745764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.745794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.755905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.755935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.767293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.767323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.778056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.778085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.788850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.788880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.801486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.801515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.811383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.811412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.822857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.822887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.833638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.833668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.844548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.844577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.857473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.857502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.867629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.867659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.878290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.878320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.891098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.891135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.900990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.901021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.963 [2024-11-27 17:12:10.911486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:13.963 [2024-11-27 17:12:10.911515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.922138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.922168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.933337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.933367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.944146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.944176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.955309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.955339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.966649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.966679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.977954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.977984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:10.989092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:10.989123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.000286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.000318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.010479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.010509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.021730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.021760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.032642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.032672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.045608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.045639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.055989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.056020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.067290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.067321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.080219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.080249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.090795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.090826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.101616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.101647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.114021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.114050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.124040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.124071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.135154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.135187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.146369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.146399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.157170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.157201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.222 [2024-11-27 17:12:11.168094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.222 [2024-11-27 17:12:11.168125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.179318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.179357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.190405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.190435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.202037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.202067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.212804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.212834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.224003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.224034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.234712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.234742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.245920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.245950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.258714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.258744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.481 [2024-11-27 17:12:11.269394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.481 [2024-11-27 17:12:11.269424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.280669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.280699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.293769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.293799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.304264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.304293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.315567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.315597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.326514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.326554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.337433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.337463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.348153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.348182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.359018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.359047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.371593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.371622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.381725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.381755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.392859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.392888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.405669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.405699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.415973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.416003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.482 [2024-11-27 17:12:11.426843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.482 [2024-11-27 17:12:11.426873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.740 [2024-11-27 17:12:11.439724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.740 [2024-11-27 17:12:11.439754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.740 [2024-11-27 17:12:11.450106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.450137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.461434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.461465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.474476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.474506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.484439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.484469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.495612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.495641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.506499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.506538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.517724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.517753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.528582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.528612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.539442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.539473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.552454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.552484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.562285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.562314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.573445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.573475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.584802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.584831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.595693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.595723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.607971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.608001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.617360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.617390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.628560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.628590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.639780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.639810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.650698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.650728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.663849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.663878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.674602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.674632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:14.741 [2024-11-27 17:12:11.685348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:14.741 [2024-11-27 17:12:11.685378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.697992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.698022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.707760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.707790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.718808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.718838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.729806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.729837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.740588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.740618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.753591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.753621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.764104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.764133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.774887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.774916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.787581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.787611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.797968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.797998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.808554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.808584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.819624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.819654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.830037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.830067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.841213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.841243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.852077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.852107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.862951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.862981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.874107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.874137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.885243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.885272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.896477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.896507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.907328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.907357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.918472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.918502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.929638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.929668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.000 [2024-11-27 17:12:11.943006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.000 [2024-11-27 17:12:11.943045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:11.953576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:11.953607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:11.964702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:11.964732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:11.975418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:11.975448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:11.986556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:11.986586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:11.999023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:11.999053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.009369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.009400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.020651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.020682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.034353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.034384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.044968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.044998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.055839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.055869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.067270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.067300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.078384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.078414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.091427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.091457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.101745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.101775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.113092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.113122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.126347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.126377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.136441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.136470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.147617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.147646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.160241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.160286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.170295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.170325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.181574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.181605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.192640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.192670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.259 [2024-11-27 17:12:12.203604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.259 [2024-11-27 17:12:12.203635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.216588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.216620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.226929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.226960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.237766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.237797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.249201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.249232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.260417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.260448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.272473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.272503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.278262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.278292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 00:19:15.518 Latency(us) 00:19:15.518 [2024-11-27T16:12:12.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:15.518 [2024-11-27T16:12:12.469Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:15.518 Nvme1n1 : 5.01 11588.07 90.53 0.00 0.00 11030.46 4684.61 20874.43 00:19:15.518 [2024-11-27T16:12:12.469Z] =================================================================================================================== 00:19:15.518 [2024-11-27T16:12:12.469Z] Total : 11588.07 90.53 0.00 0.00 11030.46 4684.61 20874.43 00:19:15.518 [2024-11-27 17:12:12.286281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.286310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.294305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.294334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.302375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.302424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.310397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.310459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.318432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.318495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.330471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.330541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.338477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.338533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.346498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.346559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.354512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.518 [2024-11-27 17:12:12.354584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.518 [2024-11-27 17:12:12.362550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.362608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.370582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.370627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.378602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.378659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.386625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.386682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.394639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.394688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.402655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.402705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.410700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.410748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.418698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.418743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.426690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.426719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.434713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.434743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.442773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.442823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.450790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.450838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.458812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.458860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.519 [2024-11-27 17:12:12.466797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.519 [2024-11-27 17:12:12.466823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.474840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.474890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.482878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.482924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.490902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.490949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.498883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.498907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.506902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.506927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 [2024-11-27 17:12:12.514923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.777 [2024-11-27 17:12:12.514948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.777 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1752049) - No such process 00:19:15.777 17:12:12 -- target/zcopy.sh@49 -- # wait 1752049 00:19:15.777 17:12:12 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:15.777 17:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:15.777 17:12:12 -- common/autotest_common.sh@10 -- # set +x 00:19:15.777 17:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:15.777 17:12:12 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:15.777 17:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:15.777 17:12:12 -- common/autotest_common.sh@10 -- # set +x 00:19:15.777 delay0 00:19:15.777 17:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:15.777 17:12:12 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:15.777 17:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:15.777 17:12:12 -- common/autotest_common.sh@10 -- # set +x 00:19:15.777 17:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:15.777 17:12:12 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:15.777 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.777 [2024-11-27 17:12:12.680660] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:23.887 Initializing NVMe Controllers 00:19:23.887 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:23.887 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:23.887 Initialization complete. Launching workers. 00:19:23.887 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 264, failed: 17182 00:19:23.887 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 17330, failed to submit 116 00:19:23.887 success 17248, unsuccess 82, failed 0 00:19:23.887 17:12:19 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:23.887 17:12:19 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:23.887 17:12:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:23.887 17:12:19 -- nvmf/common.sh@116 -- # sync 00:19:23.887 17:12:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:23.887 17:12:19 -- nvmf/common.sh@119 -- # set +e 00:19:23.887 17:12:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:23.887 17:12:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:23.887 rmmod nvme_tcp 00:19:23.887 rmmod nvme_fabrics 00:19:23.887 rmmod nvme_keyring 00:19:23.887 17:12:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:23.887 17:12:19 -- nvmf/common.sh@123 -- # set -e 00:19:23.887 17:12:19 -- nvmf/common.sh@124 -- # return 0 00:19:23.887 17:12:19 -- nvmf/common.sh@477 -- # '[' -n 1750439 ']' 00:19:23.887 17:12:19 -- nvmf/common.sh@478 -- # killprocess 1750439 00:19:23.887 17:12:19 -- common/autotest_common.sh@936 -- # '[' -z 1750439 ']' 00:19:23.887 17:12:19 -- common/autotest_common.sh@940 -- # kill -0 1750439 00:19:23.887 17:12:19 -- common/autotest_common.sh@941 -- # uname 00:19:23.887 17:12:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:23.887 17:12:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1750439 00:19:23.887 17:12:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:23.887 17:12:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:23.887 17:12:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1750439' 00:19:23.887 killing process with pid 1750439 00:19:23.887 17:12:19 -- common/autotest_common.sh@955 -- # kill 1750439 00:19:23.887 17:12:19 -- common/autotest_common.sh@960 -- # wait 1750439 00:19:23.887 17:12:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.887 17:12:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.887 17:12:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.887 17:12:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.887 17:12:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.887 17:12:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.887 17:12:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.887 17:12:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.262 17:12:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.262 00:19:25.262 real 0m29.513s 00:19:25.262 user 0m42.306s 00:19:25.262 sys 0m9.137s 00:19:25.262 17:12:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:25.262 17:12:22 -- common/autotest_common.sh@10 -- # set +x 00:19:25.262 ************************************ 00:19:25.262 END TEST nvmf_zcopy 00:19:25.262 ************************************ 00:19:25.262 17:12:22 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:25.262 17:12:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:25.262 17:12:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:25.262 17:12:22 -- common/autotest_common.sh@10 -- # set +x 00:19:25.262 ************************************ 00:19:25.262 START TEST nvmf_nmic 00:19:25.262 ************************************ 00:19:25.262 17:12:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:25.522 * Looking for test storage... 00:19:25.522 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.522 17:12:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:25.522 17:12:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:25.522 17:12:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:25.522 17:12:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:25.522 17:12:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:25.522 17:12:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:25.522 17:12:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:25.522 17:12:22 -- scripts/common.sh@335 -- # IFS=.-: 00:19:25.522 17:12:22 -- scripts/common.sh@335 -- # read -ra ver1 00:19:25.522 17:12:22 -- scripts/common.sh@336 -- # IFS=.-: 00:19:25.522 17:12:22 -- scripts/common.sh@336 -- # read -ra ver2 00:19:25.522 17:12:22 -- scripts/common.sh@337 -- # local 'op=<' 00:19:25.522 17:12:22 -- scripts/common.sh@339 -- # ver1_l=2 00:19:25.522 17:12:22 -- scripts/common.sh@340 -- # ver2_l=1 00:19:25.522 17:12:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:25.522 17:12:22 -- scripts/common.sh@343 -- # case "$op" in 00:19:25.522 17:12:22 -- scripts/common.sh@344 -- # : 1 00:19:25.522 17:12:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:25.522 17:12:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:25.522 17:12:22 -- scripts/common.sh@364 -- # decimal 1 00:19:25.522 17:12:22 -- scripts/common.sh@352 -- # local d=1 00:19:25.522 17:12:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:25.522 17:12:22 -- scripts/common.sh@354 -- # echo 1 00:19:25.522 17:12:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:25.522 17:12:22 -- scripts/common.sh@365 -- # decimal 2 00:19:25.522 17:12:22 -- scripts/common.sh@352 -- # local d=2 00:19:25.522 17:12:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:25.522 17:12:22 -- scripts/common.sh@354 -- # echo 2 00:19:25.522 17:12:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:25.522 17:12:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:25.522 17:12:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:25.522 17:12:22 -- scripts/common.sh@367 -- # return 0 00:19:25.522 17:12:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:25.522 17:12:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:25.522 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.522 --rc genhtml_branch_coverage=1 00:19:25.522 --rc genhtml_function_coverage=1 00:19:25.522 --rc genhtml_legend=1 00:19:25.522 --rc geninfo_all_blocks=1 00:19:25.522 --rc geninfo_unexecuted_blocks=1 00:19:25.522 00:19:25.522 ' 00:19:25.522 17:12:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:25.522 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.522 --rc genhtml_branch_coverage=1 00:19:25.522 --rc genhtml_function_coverage=1 00:19:25.522 --rc genhtml_legend=1 00:19:25.522 --rc geninfo_all_blocks=1 00:19:25.522 --rc geninfo_unexecuted_blocks=1 00:19:25.522 00:19:25.522 ' 00:19:25.522 17:12:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:25.522 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.522 --rc genhtml_branch_coverage=1 00:19:25.522 --rc genhtml_function_coverage=1 00:19:25.522 --rc genhtml_legend=1 00:19:25.522 --rc geninfo_all_blocks=1 00:19:25.522 --rc geninfo_unexecuted_blocks=1 00:19:25.522 00:19:25.522 ' 00:19:25.522 17:12:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:25.522 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.522 --rc genhtml_branch_coverage=1 00:19:25.522 --rc genhtml_function_coverage=1 00:19:25.522 --rc genhtml_legend=1 00:19:25.522 --rc geninfo_all_blocks=1 00:19:25.522 --rc geninfo_unexecuted_blocks=1 00:19:25.522 00:19:25.522 ' 00:19:25.522 17:12:22 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.522 17:12:22 -- nvmf/common.sh@7 -- # uname -s 00:19:25.522 17:12:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.522 17:12:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.522 17:12:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.522 17:12:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.522 17:12:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.522 17:12:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.522 17:12:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.522 17:12:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.522 17:12:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.522 17:12:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.522 17:12:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.522 17:12:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.522 17:12:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.522 17:12:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.522 17:12:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.522 17:12:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.522 17:12:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.522 17:12:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.522 17:12:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.523 17:12:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.523 17:12:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.523 17:12:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.523 17:12:22 -- paths/export.sh@5 -- # export PATH 00:19:25.523 17:12:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.523 17:12:22 -- nvmf/common.sh@46 -- # : 0 00:19:25.523 17:12:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.523 17:12:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.523 17:12:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.523 17:12:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.523 17:12:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.523 17:12:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.523 17:12:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.523 17:12:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.523 17:12:22 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.523 17:12:22 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.523 17:12:22 -- target/nmic.sh@14 -- # nvmftestinit 00:19:25.523 17:12:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.523 17:12:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.523 17:12:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.523 17:12:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.523 17:12:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.523 17:12:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.523 17:12:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.523 17:12:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.523 17:12:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.523 17:12:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.523 17:12:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.523 17:12:22 -- common/autotest_common.sh@10 -- # set +x 00:19:27.425 17:12:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.425 17:12:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.425 17:12:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.425 17:12:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.425 17:12:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.425 17:12:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.425 17:12:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.425 17:12:24 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.425 17:12:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.425 17:12:24 -- nvmf/common.sh@295 -- # e810=() 00:19:27.425 17:12:24 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.425 17:12:24 -- nvmf/common.sh@296 -- # x722=() 00:19:27.425 17:12:24 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.425 17:12:24 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.425 17:12:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.425 17:12:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.425 17:12:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.425 17:12:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.425 17:12:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.425 17:12:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.425 17:12:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.425 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.425 17:12:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.425 17:12:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.425 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.425 17:12:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:27.425 17:12:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.425 17:12:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.425 17:12:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.425 17:12:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.425 17:12:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:27.425 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:27.425 17:12:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.425 17:12:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.425 17:12:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.425 17:12:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.425 17:12:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.425 17:12:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:27.425 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:27.425 17:12:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.425 17:12:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:27.425 17:12:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:27.425 17:12:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:27.425 17:12:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:27.426 17:12:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.426 17:12:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:27.426 17:12:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:27.426 17:12:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:27.426 17:12:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:27.426 17:12:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:27.426 17:12:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:27.426 17:12:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:27.426 17:12:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.426 17:12:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:27.426 17:12:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:27.426 17:12:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:27.426 17:12:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:27.684 17:12:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:27.684 17:12:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:27.684 17:12:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:27.684 17:12:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:27.684 17:12:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:27.684 17:12:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:27.684 17:12:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:27.684 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:27.684 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:19:27.684 00:19:27.684 --- 10.0.0.2 ping statistics --- 00:19:27.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.684 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:19:27.684 17:12:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:27.684 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:27.684 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.055 ms 00:19:27.684 00:19:27.684 --- 10.0.0.1 ping statistics --- 00:19:27.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.684 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:19:27.684 17:12:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:27.684 17:12:24 -- nvmf/common.sh@410 -- # return 0 00:19:27.684 17:12:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:27.684 17:12:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:27.684 17:12:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:27.684 17:12:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:27.684 17:12:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:27.684 17:12:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:27.684 17:12:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:27.684 17:12:24 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:27.684 17:12:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:27.684 17:12:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:27.684 17:12:24 -- common/autotest_common.sh@10 -- # set +x 00:19:27.684 17:12:24 -- nvmf/common.sh@469 -- # nvmfpid=1756010 00:19:27.684 17:12:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:27.684 17:12:24 -- nvmf/common.sh@470 -- # waitforlisten 1756010 00:19:27.684 17:12:24 -- common/autotest_common.sh@829 -- # '[' -z 1756010 ']' 00:19:27.684 17:12:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:27.684 17:12:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:27.684 17:12:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:27.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:27.684 17:12:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:27.684 17:12:24 -- common/autotest_common.sh@10 -- # set +x 00:19:27.684 [2024-11-27 17:12:24.533455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:27.684 [2024-11-27 17:12:24.533561] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:27.684 EAL: No free 2048 kB hugepages reported on node 1 00:19:27.684 [2024-11-27 17:12:24.598225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:27.943 [2024-11-27 17:12:24.690765] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:27.943 [2024-11-27 17:12:24.690919] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:27.943 [2024-11-27 17:12:24.690936] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:27.943 [2024-11-27 17:12:24.690948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:27.943 [2024-11-27 17:12:24.691908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:27.943 [2024-11-27 17:12:24.692007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:27.943 [2024-11-27 17:12:24.692063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:27.943 [2024-11-27 17:12:24.692066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:28.878 17:12:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:28.878 17:12:25 -- common/autotest_common.sh@862 -- # return 0 00:19:28.878 17:12:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:28.878 17:12:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 17:12:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:28.878 17:12:25 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 [2024-11-27 17:12:25.598343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 Malloc0 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 [2024-11-27 17:12:25.652317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:28.878 test case1: single bdev can't be used in multiple subsystems 00:19:28.878 17:12:25 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.878 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.878 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.878 17:12:25 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:28.878 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.879 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.879 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.879 17:12:25 -- target/nmic.sh@28 -- # nmic_status=0 00:19:28.879 17:12:25 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:28.879 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.879 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.879 [2024-11-27 17:12:25.676186] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:28.879 [2024-11-27 17:12:25.676214] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:28.879 [2024-11-27 17:12:25.676229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:28.879 request: 00:19:28.879 { 00:19:28.879 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:28.879 "namespace": { 00:19:28.879 "bdev_name": "Malloc0" 00:19:28.879 }, 00:19:28.879 "method": "nvmf_subsystem_add_ns", 00:19:28.879 "req_id": 1 00:19:28.879 } 00:19:28.879 Got JSON-RPC error response 00:19:28.879 response: 00:19:28.879 { 00:19:28.879 "code": -32602, 00:19:28.879 "message": "Invalid parameters" 00:19:28.879 } 00:19:28.879 17:12:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:28.879 17:12:25 -- target/nmic.sh@29 -- # nmic_status=1 00:19:28.879 17:12:25 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:28.879 17:12:25 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:28.879 Adding namespace failed - expected result. 00:19:28.879 17:12:25 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:28.879 test case2: host connect to nvmf target in multiple paths 00:19:28.879 17:12:25 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:28.879 17:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.879 17:12:25 -- common/autotest_common.sh@10 -- # set +x 00:19:28.879 [2024-11-27 17:12:25.684303] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:28.879 17:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.879 17:12:25 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:29.445 17:12:26 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:30.379 17:12:27 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:30.379 17:12:27 -- common/autotest_common.sh@1187 -- # local i=0 00:19:30.379 17:12:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:30.379 17:12:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:30.379 17:12:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:32.279 17:12:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:32.279 17:12:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:32.279 17:12:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:32.279 17:12:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:32.279 17:12:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:32.279 17:12:29 -- common/autotest_common.sh@1197 -- # return 0 00:19:32.279 17:12:29 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:32.279 [global] 00:19:32.279 thread=1 00:19:32.279 invalidate=1 00:19:32.279 rw=write 00:19:32.279 time_based=1 00:19:32.279 runtime=1 00:19:32.279 ioengine=libaio 00:19:32.279 direct=1 00:19:32.279 bs=4096 00:19:32.279 iodepth=1 00:19:32.279 norandommap=0 00:19:32.279 numjobs=1 00:19:32.279 00:19:32.279 verify_dump=1 00:19:32.279 verify_backlog=512 00:19:32.279 verify_state_save=0 00:19:32.279 do_verify=1 00:19:32.279 verify=crc32c-intel 00:19:32.279 [job0] 00:19:32.279 filename=/dev/nvme0n1 00:19:32.279 Could not set queue depth (nvme0n1) 00:19:32.536 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.536 fio-3.35 00:19:32.536 Starting 1 thread 00:19:33.909 00:19:33.909 job0: (groupid=0, jobs=1): err= 0: pid=1756675: Wed Nov 27 17:12:30 2024 00:19:33.909 read: IOPS=21, BW=86.5KiB/s (88.6kB/s)(88.0KiB/1017msec) 00:19:33.909 slat (nsec): min=15729, max=46246, avg=30528.18, stdev=8071.07 00:19:33.909 clat (usec): min=40415, max=41038, avg=40929.30, stdev=119.36 00:19:33.909 lat (usec): min=40431, max=41055, avg=40959.83, stdev=122.44 00:19:33.909 clat percentiles (usec): 00:19:33.909 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:33.909 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:33.909 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:33.909 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.909 | 99.99th=[41157] 00:19:33.909 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:19:33.909 slat (usec): min=6, max=28483, avg=68.92, stdev=1258.22 00:19:33.909 clat (usec): min=131, max=242, avg=153.97, stdev=11.44 00:19:33.909 lat (usec): min=138, max=28665, avg=222.89, stdev=1259.54 00:19:33.909 clat percentiles (usec): 00:19:33.909 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 145], 00:19:33.909 | 30.00th=[ 149], 40.00th=[ 151], 50.00th=[ 153], 60.00th=[ 155], 00:19:33.909 | 70.00th=[ 159], 80.00th=[ 161], 90.00th=[ 167], 95.00th=[ 172], 00:19:33.909 | 99.00th=[ 186], 99.50th=[ 206], 99.90th=[ 243], 99.95th=[ 243], 00:19:33.909 | 99.99th=[ 243] 00:19:33.910 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.910 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.910 lat (usec) : 250=95.88% 00:19:33.910 lat (msec) : 50=4.12% 00:19:33.910 cpu : usr=0.39%, sys=0.59%, ctx=537, majf=0, minf=1 00:19:33.910 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.910 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.910 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.910 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.910 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.910 00:19:33.910 Run status group 0 (all jobs): 00:19:33.910 READ: bw=86.5KiB/s (88.6kB/s), 86.5KiB/s-86.5KiB/s (88.6kB/s-88.6kB/s), io=88.0KiB (90.1kB), run=1017-1017msec 00:19:33.910 WRITE: bw=2014KiB/s (2062kB/s), 2014KiB/s-2014KiB/s (2062kB/s-2062kB/s), io=2048KiB (2097kB), run=1017-1017msec 00:19:33.910 00:19:33.910 Disk stats (read/write): 00:19:33.910 nvme0n1: ios=45/512, merge=0/0, ticks=1764/74, in_queue=1838, util=98.70% 00:19:33.910 17:12:30 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:33.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:33.910 17:12:30 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:33.910 17:12:30 -- common/autotest_common.sh@1208 -- # local i=0 00:19:33.910 17:12:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:33.910 17:12:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:33.910 17:12:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:33.910 17:12:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:33.910 17:12:30 -- common/autotest_common.sh@1220 -- # return 0 00:19:33.910 17:12:30 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:33.910 17:12:30 -- target/nmic.sh@53 -- # nvmftestfini 00:19:33.910 17:12:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:33.910 17:12:30 -- nvmf/common.sh@116 -- # sync 00:19:33.910 17:12:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:33.910 17:12:30 -- nvmf/common.sh@119 -- # set +e 00:19:33.910 17:12:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:33.910 17:12:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:33.910 rmmod nvme_tcp 00:19:33.910 rmmod nvme_fabrics 00:19:33.910 rmmod nvme_keyring 00:19:33.910 17:12:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:33.910 17:12:30 -- nvmf/common.sh@123 -- # set -e 00:19:33.910 17:12:30 -- nvmf/common.sh@124 -- # return 0 00:19:33.910 17:12:30 -- nvmf/common.sh@477 -- # '[' -n 1756010 ']' 00:19:33.910 17:12:30 -- nvmf/common.sh@478 -- # killprocess 1756010 00:19:33.910 17:12:30 -- common/autotest_common.sh@936 -- # '[' -z 1756010 ']' 00:19:33.910 17:12:30 -- common/autotest_common.sh@940 -- # kill -0 1756010 00:19:33.910 17:12:30 -- common/autotest_common.sh@941 -- # uname 00:19:33.910 17:12:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:33.910 17:12:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1756010 00:19:33.910 17:12:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:33.910 17:12:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:33.910 17:12:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1756010' 00:19:33.910 killing process with pid 1756010 00:19:33.910 17:12:30 -- common/autotest_common.sh@955 -- # kill 1756010 00:19:33.910 17:12:30 -- common/autotest_common.sh@960 -- # wait 1756010 00:19:34.169 17:12:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:34.169 17:12:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:34.169 17:12:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:34.169 17:12:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:34.169 17:12:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:34.169 17:12:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:34.169 17:12:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:34.169 17:12:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.174 17:12:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:36.174 00:19:36.174 real 0m10.756s 00:19:36.174 user 0m25.880s 00:19:36.174 sys 0m2.404s 00:19:36.174 17:12:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:36.174 17:12:32 -- common/autotest_common.sh@10 -- # set +x 00:19:36.174 ************************************ 00:19:36.174 END TEST nvmf_nmic 00:19:36.174 ************************************ 00:19:36.174 17:12:32 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:36.174 17:12:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:36.174 17:12:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:36.174 17:12:32 -- common/autotest_common.sh@10 -- # set +x 00:19:36.174 ************************************ 00:19:36.174 START TEST nvmf_fio_target 00:19:36.174 ************************************ 00:19:36.174 17:12:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:36.174 * Looking for test storage... 00:19:36.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:36.174 17:12:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:36.174 17:12:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:36.174 17:12:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:36.174 17:12:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:36.174 17:12:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:36.174 17:12:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:36.174 17:12:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:36.174 17:12:33 -- scripts/common.sh@335 -- # IFS=.-: 00:19:36.174 17:12:33 -- scripts/common.sh@335 -- # read -ra ver1 00:19:36.174 17:12:33 -- scripts/common.sh@336 -- # IFS=.-: 00:19:36.174 17:12:33 -- scripts/common.sh@336 -- # read -ra ver2 00:19:36.174 17:12:33 -- scripts/common.sh@337 -- # local 'op=<' 00:19:36.174 17:12:33 -- scripts/common.sh@339 -- # ver1_l=2 00:19:36.174 17:12:33 -- scripts/common.sh@340 -- # ver2_l=1 00:19:36.174 17:12:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:36.174 17:12:33 -- scripts/common.sh@343 -- # case "$op" in 00:19:36.174 17:12:33 -- scripts/common.sh@344 -- # : 1 00:19:36.174 17:12:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:36.174 17:12:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:36.174 17:12:33 -- scripts/common.sh@364 -- # decimal 1 00:19:36.174 17:12:33 -- scripts/common.sh@352 -- # local d=1 00:19:36.174 17:12:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:36.174 17:12:33 -- scripts/common.sh@354 -- # echo 1 00:19:36.174 17:12:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:36.174 17:12:33 -- scripts/common.sh@365 -- # decimal 2 00:19:36.174 17:12:33 -- scripts/common.sh@352 -- # local d=2 00:19:36.174 17:12:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:36.174 17:12:33 -- scripts/common.sh@354 -- # echo 2 00:19:36.174 17:12:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:36.174 17:12:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:36.174 17:12:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:36.174 17:12:33 -- scripts/common.sh@367 -- # return 0 00:19:36.174 17:12:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:36.174 17:12:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:36.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.174 --rc genhtml_branch_coverage=1 00:19:36.174 --rc genhtml_function_coverage=1 00:19:36.174 --rc genhtml_legend=1 00:19:36.174 --rc geninfo_all_blocks=1 00:19:36.174 --rc geninfo_unexecuted_blocks=1 00:19:36.174 00:19:36.174 ' 00:19:36.174 17:12:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:36.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.174 --rc genhtml_branch_coverage=1 00:19:36.174 --rc genhtml_function_coverage=1 00:19:36.174 --rc genhtml_legend=1 00:19:36.174 --rc geninfo_all_blocks=1 00:19:36.174 --rc geninfo_unexecuted_blocks=1 00:19:36.174 00:19:36.174 ' 00:19:36.174 17:12:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:36.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.175 --rc genhtml_branch_coverage=1 00:19:36.175 --rc genhtml_function_coverage=1 00:19:36.175 --rc genhtml_legend=1 00:19:36.175 --rc geninfo_all_blocks=1 00:19:36.175 --rc geninfo_unexecuted_blocks=1 00:19:36.175 00:19:36.175 ' 00:19:36.175 17:12:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:36.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.175 --rc genhtml_branch_coverage=1 00:19:36.175 --rc genhtml_function_coverage=1 00:19:36.175 --rc genhtml_legend=1 00:19:36.175 --rc geninfo_all_blocks=1 00:19:36.175 --rc geninfo_unexecuted_blocks=1 00:19:36.175 00:19:36.175 ' 00:19:36.175 17:12:33 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:36.175 17:12:33 -- nvmf/common.sh@7 -- # uname -s 00:19:36.175 17:12:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:36.175 17:12:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:36.175 17:12:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:36.175 17:12:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:36.175 17:12:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:36.175 17:12:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:36.175 17:12:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:36.175 17:12:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:36.175 17:12:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:36.175 17:12:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:36.433 17:12:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.433 17:12:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.433 17:12:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:36.433 17:12:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:36.433 17:12:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:36.433 17:12:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:36.433 17:12:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:36.433 17:12:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:36.433 17:12:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:36.433 17:12:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.433 17:12:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.433 17:12:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.433 17:12:33 -- paths/export.sh@5 -- # export PATH 00:19:36.433 17:12:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.433 17:12:33 -- nvmf/common.sh@46 -- # : 0 00:19:36.433 17:12:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:36.433 17:12:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:36.433 17:12:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:36.433 17:12:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:36.433 17:12:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:36.433 17:12:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:36.433 17:12:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:36.433 17:12:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:36.433 17:12:33 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:36.433 17:12:33 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:36.433 17:12:33 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:36.433 17:12:33 -- target/fio.sh@16 -- # nvmftestinit 00:19:36.433 17:12:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:36.433 17:12:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:36.433 17:12:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:36.433 17:12:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:36.433 17:12:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:36.433 17:12:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.433 17:12:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.433 17:12:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.433 17:12:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:36.433 17:12:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:36.433 17:12:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:36.433 17:12:33 -- common/autotest_common.sh@10 -- # set +x 00:19:38.334 17:12:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:38.334 17:12:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:38.334 17:12:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:38.334 17:12:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:38.334 17:12:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:38.334 17:12:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:38.334 17:12:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:38.334 17:12:35 -- nvmf/common.sh@294 -- # net_devs=() 00:19:38.334 17:12:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:38.334 17:12:35 -- nvmf/common.sh@295 -- # e810=() 00:19:38.334 17:12:35 -- nvmf/common.sh@295 -- # local -ga e810 00:19:38.334 17:12:35 -- nvmf/common.sh@296 -- # x722=() 00:19:38.334 17:12:35 -- nvmf/common.sh@296 -- # local -ga x722 00:19:38.334 17:12:35 -- nvmf/common.sh@297 -- # mlx=() 00:19:38.334 17:12:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:38.334 17:12:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:38.334 17:12:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:38.334 17:12:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:38.334 17:12:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.334 17:12:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:38.334 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:38.334 17:12:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.334 17:12:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:38.334 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:38.334 17:12:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.334 17:12:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.334 17:12:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.334 17:12:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:38.334 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:38.334 17:12:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.334 17:12:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.334 17:12:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.334 17:12:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.334 17:12:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:38.334 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:38.334 17:12:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.334 17:12:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:38.334 17:12:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:38.334 17:12:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:38.334 17:12:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:38.334 17:12:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:38.334 17:12:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:38.334 17:12:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:38.334 17:12:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:38.334 17:12:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:38.334 17:12:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:38.334 17:12:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:38.334 17:12:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:38.334 17:12:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:38.334 17:12:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:38.334 17:12:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:38.334 17:12:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:38.593 17:12:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:38.593 17:12:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:38.593 17:12:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:38.593 17:12:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:38.593 17:12:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:38.593 17:12:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:38.593 17:12:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:38.593 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:38.593 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:19:38.593 00:19:38.593 --- 10.0.0.2 ping statistics --- 00:19:38.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.593 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:19:38.593 17:12:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:38.593 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:38.593 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:19:38.593 00:19:38.593 --- 10.0.0.1 ping statistics --- 00:19:38.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.593 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:19:38.593 17:12:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:38.593 17:12:35 -- nvmf/common.sh@410 -- # return 0 00:19:38.593 17:12:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:38.593 17:12:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:38.593 17:12:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:38.593 17:12:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:38.593 17:12:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:38.593 17:12:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:38.593 17:12:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:38.593 17:12:35 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:38.593 17:12:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:38.593 17:12:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:38.593 17:12:35 -- common/autotest_common.sh@10 -- # set +x 00:19:38.593 17:12:35 -- nvmf/common.sh@469 -- # nvmfpid=1758897 00:19:38.593 17:12:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:38.593 17:12:35 -- nvmf/common.sh@470 -- # waitforlisten 1758897 00:19:38.593 17:12:35 -- common/autotest_common.sh@829 -- # '[' -z 1758897 ']' 00:19:38.593 17:12:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:38.593 17:12:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:38.593 17:12:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:38.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:38.593 17:12:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:38.593 17:12:35 -- common/autotest_common.sh@10 -- # set +x 00:19:38.593 [2024-11-27 17:12:35.491213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:38.593 [2024-11-27 17:12:35.491283] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:38.593 EAL: No free 2048 kB hugepages reported on node 1 00:19:38.851 [2024-11-27 17:12:35.555781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:38.851 [2024-11-27 17:12:35.639743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:38.851 [2024-11-27 17:12:35.639900] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:38.851 [2024-11-27 17:12:35.639917] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:38.851 [2024-11-27 17:12:35.639929] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:38.851 [2024-11-27 17:12:35.639980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:38.851 [2024-11-27 17:12:35.640043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:38.851 [2024-11-27 17:12:35.640108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:38.851 [2024-11-27 17:12:35.640111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:39.786 17:12:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:39.786 17:12:36 -- common/autotest_common.sh@862 -- # return 0 00:19:39.786 17:12:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:39.786 17:12:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:39.786 17:12:36 -- common/autotest_common.sh@10 -- # set +x 00:19:39.786 17:12:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:39.786 17:12:36 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:40.045 [2024-11-27 17:12:36.803302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:40.045 17:12:36 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:40.303 17:12:37 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:40.303 17:12:37 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:40.561 17:12:37 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:40.561 17:12:37 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:40.819 17:12:37 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:40.819 17:12:37 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:41.076 17:12:37 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:41.076 17:12:37 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:41.334 17:12:38 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:41.592 17:12:38 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:41.592 17:12:38 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:41.850 17:12:38 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:41.850 17:12:38 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:42.108 17:12:38 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:42.108 17:12:38 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:42.365 17:12:39 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:42.622 17:12:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:42.622 17:12:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:42.879 17:12:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:42.879 17:12:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:43.137 17:12:39 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:43.394 [2024-11-27 17:12:40.178335] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:43.394 17:12:40 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:43.652 17:12:40 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:43.909 17:12:40 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:44.475 17:12:41 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:44.475 17:12:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:44.475 17:12:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:44.475 17:12:41 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:44.475 17:12:41 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:44.475 17:12:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.374 17:12:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.374 17:12:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.374 17:12:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:46.374 17:12:43 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:46.374 17:12:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.374 17:12:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.374 17:12:43 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:46.374 [global] 00:19:46.374 thread=1 00:19:46.374 invalidate=1 00:19:46.374 rw=write 00:19:46.374 time_based=1 00:19:46.374 runtime=1 00:19:46.374 ioengine=libaio 00:19:46.374 direct=1 00:19:46.374 bs=4096 00:19:46.374 iodepth=1 00:19:46.374 norandommap=0 00:19:46.374 numjobs=1 00:19:46.374 00:19:46.374 verify_dump=1 00:19:46.374 verify_backlog=512 00:19:46.374 verify_state_save=0 00:19:46.374 do_verify=1 00:19:46.374 verify=crc32c-intel 00:19:46.374 [job0] 00:19:46.374 filename=/dev/nvme0n1 00:19:46.374 [job1] 00:19:46.374 filename=/dev/nvme0n2 00:19:46.633 [job2] 00:19:46.633 filename=/dev/nvme0n3 00:19:46.633 [job3] 00:19:46.633 filename=/dev/nvme0n4 00:19:46.633 Could not set queue depth (nvme0n1) 00:19:46.633 Could not set queue depth (nvme0n2) 00:19:46.633 Could not set queue depth (nvme0n3) 00:19:46.633 Could not set queue depth (nvme0n4) 00:19:46.633 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:46.633 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:46.633 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:46.633 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:46.633 fio-3.35 00:19:46.633 Starting 4 threads 00:19:48.007 00:19:48.007 job0: (groupid=0, jobs=1): err= 0: pid=1760004: Wed Nov 27 17:12:44 2024 00:19:48.007 read: IOPS=31, BW=126KiB/s (129kB/s)(128KiB/1013msec) 00:19:48.007 slat (nsec): min=8862, max=35079, avg=18995.84, stdev=8948.75 00:19:48.007 clat (usec): min=233, max=41881, avg=27973.40, stdev=19062.22 00:19:48.007 lat (usec): min=248, max=41915, avg=27992.39, stdev=19067.71 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[ 235], 5.00th=[ 262], 10.00th=[ 281], 20.00th=[ 289], 00:19:48.007 | 30.00th=[ 330], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:48.007 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:19:48.007 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:19:48.007 | 99.99th=[41681] 00:19:48.007 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:19:48.007 slat (nsec): min=8265, max=54324, avg=20325.86, stdev=5777.63 00:19:48.007 clat (usec): min=150, max=816, avg=202.78, stdev=43.45 00:19:48.007 lat (usec): min=158, max=855, avg=223.11, stdev=44.75 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[ 161], 5.00th=[ 174], 10.00th=[ 180], 20.00th=[ 186], 00:19:48.007 | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:19:48.007 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 221], 95.00th=[ 233], 00:19:48.007 | 99.00th=[ 359], 99.50th=[ 570], 99.90th=[ 816], 99.95th=[ 816], 00:19:48.007 | 99.99th=[ 816] 00:19:48.007 bw ( KiB/s): min= 4096, max= 4096, per=34.60%, avg=4096.00, stdev= 0.00, samples=1 00:19:48.007 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:48.007 lat (usec) : 250=91.91%, 500=3.49%, 750=0.37%, 1000=0.18% 00:19:48.007 lat (msec) : 50=4.04% 00:19:48.007 cpu : usr=0.30%, sys=1.78%, ctx=546, majf=0, minf=1 00:19:48.007 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:48.007 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 issued rwts: total=32,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.007 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:48.007 job1: (groupid=0, jobs=1): err= 0: pid=1760005: Wed Nov 27 17:12:44 2024 00:19:48.007 read: IOPS=21, BW=85.2KiB/s (87.2kB/s)(88.0KiB/1033msec) 00:19:48.007 slat (nsec): min=13929, max=34591, avg=21275.05, stdev=8162.46 00:19:48.007 clat (usec): min=40910, max=42012, avg=41458.32, stdev=511.20 00:19:48.007 lat (usec): min=40927, max=42028, avg=41479.59, stdev=509.04 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:48.007 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[42206], 00:19:48.007 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:48.007 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:48.007 | 99.99th=[42206] 00:19:48.007 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:19:48.007 slat (nsec): min=6392, max=46982, avg=16195.73, stdev=5170.54 00:19:48.007 clat (usec): min=170, max=538, avg=214.35, stdev=28.46 00:19:48.007 lat (usec): min=187, max=554, avg=230.54, stdev=28.90 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[ 180], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 198], 00:19:48.007 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 210], 60.00th=[ 215], 00:19:48.007 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 239], 95.00th=[ 253], 00:19:48.007 | 99.00th=[ 334], 99.50th=[ 388], 99.90th=[ 537], 99.95th=[ 537], 00:19:48.007 | 99.99th=[ 537] 00:19:48.007 bw ( KiB/s): min= 4096, max= 4096, per=34.60%, avg=4096.00, stdev= 0.00, samples=1 00:19:48.007 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:48.007 lat (usec) : 250=90.64%, 500=5.06%, 750=0.19% 00:19:48.007 lat (msec) : 50=4.12% 00:19:48.007 cpu : usr=0.29%, sys=0.87%, ctx=535, majf=0, minf=1 00:19:48.007 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:48.007 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.007 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:48.007 job2: (groupid=0, jobs=1): err= 0: pid=1760006: Wed Nov 27 17:12:44 2024 00:19:48.007 read: IOPS=21, BW=84.8KiB/s (86.8kB/s)(88.0KiB/1038msec) 00:19:48.007 slat (nsec): min=14088, max=33178, avg=21198.91, stdev=8242.14 00:19:48.007 clat (usec): min=40868, max=41994, avg=41414.36, stdev=500.73 00:19:48.007 lat (usec): min=40884, max=42010, avg=41435.56, stdev=501.66 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:48.007 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:48.007 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:48.007 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:48.007 | 99.99th=[42206] 00:19:48.007 write: IOPS=493, BW=1973KiB/s (2020kB/s)(2048KiB/1038msec); 0 zone resets 00:19:48.007 slat (nsec): min=6282, max=55717, avg=16840.36, stdev=6700.48 00:19:48.007 clat (usec): min=147, max=448, avg=225.47, stdev=39.31 00:19:48.007 lat (usec): min=162, max=466, avg=242.31, stdev=40.39 00:19:48.007 clat percentiles (usec): 00:19:48.007 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 180], 20.00th=[ 200], 00:19:48.007 | 30.00th=[ 208], 40.00th=[ 217], 50.00th=[ 223], 60.00th=[ 231], 00:19:48.007 | 70.00th=[ 239], 80.00th=[ 249], 90.00th=[ 269], 95.00th=[ 289], 00:19:48.007 | 99.00th=[ 375], 99.50th=[ 379], 99.90th=[ 449], 99.95th=[ 449], 00:19:48.007 | 99.99th=[ 449] 00:19:48.007 bw ( KiB/s): min= 4096, max= 4096, per=34.60%, avg=4096.00, stdev= 0.00, samples=1 00:19:48.007 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:48.007 lat (usec) : 250=76.78%, 500=19.10% 00:19:48.007 lat (msec) : 50=4.12% 00:19:48.007 cpu : usr=0.39%, sys=0.77%, ctx=534, majf=0, minf=1 00:19:48.007 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:48.007 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.007 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.007 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:48.007 job3: (groupid=0, jobs=1): err= 0: pid=1760007: Wed Nov 27 17:12:44 2024 00:19:48.007 read: IOPS=1408, BW=5634KiB/s (5770kB/s)(5640KiB/1001msec) 00:19:48.007 slat (nsec): min=7133, max=65236, avg=10431.05, stdev=4970.67 00:19:48.007 clat (usec): min=194, max=42004, avg=466.48, stdev=3094.88 00:19:48.008 lat (usec): min=202, max=42039, avg=476.91, stdev=3096.03 00:19:48.008 clat percentiles (usec): 00:19:48.008 | 1.00th=[ 206], 5.00th=[ 210], 10.00th=[ 212], 20.00th=[ 219], 00:19:48.008 | 30.00th=[ 223], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 233], 00:19:48.008 | 70.00th=[ 241], 80.00th=[ 247], 90.00th=[ 258], 95.00th=[ 269], 00:19:48.008 | 99.00th=[ 314], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:48.008 | 99.99th=[42206] 00:19:48.008 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:19:48.008 slat (nsec): min=6652, max=47053, avg=16485.86, stdev=6201.45 00:19:48.008 clat (usec): min=143, max=310, avg=189.95, stdev=19.56 00:19:48.008 lat (usec): min=153, max=328, avg=206.43, stdev=21.11 00:19:48.008 clat percentiles (usec): 00:19:48.008 | 1.00th=[ 151], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 178], 00:19:48.008 | 30.00th=[ 184], 40.00th=[ 188], 50.00th=[ 190], 60.00th=[ 194], 00:19:48.008 | 70.00th=[ 198], 80.00th=[ 202], 90.00th=[ 208], 95.00th=[ 215], 00:19:48.008 | 99.00th=[ 273], 99.50th=[ 297], 99.90th=[ 310], 99.95th=[ 310], 00:19:48.008 | 99.99th=[ 310] 00:19:48.008 bw ( KiB/s): min= 4096, max= 4096, per=34.60%, avg=4096.00, stdev= 0.00, samples=1 00:19:48.008 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:48.008 lat (usec) : 250=91.45%, 500=8.28% 00:19:48.008 lat (msec) : 50=0.27% 00:19:48.008 cpu : usr=2.00%, sys=5.80%, ctx=2948, majf=0, minf=1 00:19:48.008 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:48.008 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.008 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.008 issued rwts: total=1410,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.008 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:48.008 00:19:48.008 Run status group 0 (all jobs): 00:19:48.008 READ: bw=5726KiB/s (5864kB/s), 84.8KiB/s-5634KiB/s (86.8kB/s-5770kB/s), io=5944KiB (6087kB), run=1001-1038msec 00:19:48.008 WRITE: bw=11.6MiB/s (12.1MB/s), 1973KiB/s-6138KiB/s (2020kB/s-6285kB/s), io=12.0MiB (12.6MB), run=1001-1038msec 00:19:48.008 00:19:48.008 Disk stats (read/write): 00:19:48.008 nvme0n1: ios=77/512, merge=0/0, ticks=816/96, in_queue=912, util=85.87% 00:19:48.008 nvme0n2: ios=72/512, merge=0/0, ticks=979/112, in_queue=1091, util=91.26% 00:19:48.008 nvme0n3: ios=74/512, merge=0/0, ticks=776/111, in_queue=887, util=95.00% 00:19:48.008 nvme0n4: ios=1047/1255, merge=0/0, ticks=1468/220, in_queue=1688, util=94.33% 00:19:48.008 17:12:44 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:48.008 [global] 00:19:48.008 thread=1 00:19:48.008 invalidate=1 00:19:48.008 rw=randwrite 00:19:48.008 time_based=1 00:19:48.008 runtime=1 00:19:48.008 ioengine=libaio 00:19:48.008 direct=1 00:19:48.008 bs=4096 00:19:48.008 iodepth=1 00:19:48.008 norandommap=0 00:19:48.008 numjobs=1 00:19:48.008 00:19:48.008 verify_dump=1 00:19:48.008 verify_backlog=512 00:19:48.008 verify_state_save=0 00:19:48.008 do_verify=1 00:19:48.008 verify=crc32c-intel 00:19:48.008 [job0] 00:19:48.008 filename=/dev/nvme0n1 00:19:48.008 [job1] 00:19:48.008 filename=/dev/nvme0n2 00:19:48.008 [job2] 00:19:48.008 filename=/dev/nvme0n3 00:19:48.008 [job3] 00:19:48.008 filename=/dev/nvme0n4 00:19:48.008 Could not set queue depth (nvme0n1) 00:19:48.008 Could not set queue depth (nvme0n2) 00:19:48.008 Could not set queue depth (nvme0n3) 00:19:48.008 Could not set queue depth (nvme0n4) 00:19:48.266 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:48.266 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:48.266 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:48.266 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:48.266 fio-3.35 00:19:48.266 Starting 4 threads 00:19:49.640 00:19:49.640 job0: (groupid=0, jobs=1): err= 0: pid=1760235: Wed Nov 27 17:12:46 2024 00:19:49.640 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(88.0KiB/1039msec) 00:19:49.640 slat (nsec): min=6791, max=34357, avg=25718.77, stdev=9559.11 00:19:49.640 clat (usec): min=40943, max=41996, avg=41489.32, stdev=488.62 00:19:49.640 lat (usec): min=40977, max=42014, avg=41515.04, stdev=489.89 00:19:49.640 clat percentiles (usec): 00:19:49.640 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:49.640 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[42206], 00:19:49.640 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:49.640 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:49.640 | 99.99th=[42206] 00:19:49.640 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:19:49.640 slat (nsec): min=6544, max=35212, avg=11427.21, stdev=4104.53 00:19:49.640 clat (usec): min=154, max=1008, avg=230.66, stdev=56.13 00:19:49.640 lat (usec): min=165, max=1016, avg=242.08, stdev=56.21 00:19:49.640 clat percentiles (usec): 00:19:49.640 | 1.00th=[ 165], 5.00th=[ 180], 10.00th=[ 192], 20.00th=[ 206], 00:19:49.640 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 225], 60.00th=[ 231], 00:19:49.640 | 70.00th=[ 239], 80.00th=[ 247], 90.00th=[ 265], 95.00th=[ 293], 00:19:49.640 | 99.00th=[ 375], 99.50th=[ 635], 99.90th=[ 1012], 99.95th=[ 1012], 00:19:49.640 | 99.99th=[ 1012] 00:19:49.640 bw ( KiB/s): min= 4096, max= 4096, per=19.87%, avg=4096.00, stdev= 0.00, samples=1 00:19:49.640 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:49.640 lat (usec) : 250=81.84%, 500=13.48%, 750=0.37% 00:19:49.640 lat (msec) : 2=0.19%, 50=4.12% 00:19:49.640 cpu : usr=0.29%, sys=0.58%, ctx=535, majf=0, minf=1 00:19:49.640 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:49.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.640 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.640 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:49.640 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:49.640 job1: (groupid=0, jobs=1): err= 0: pid=1760236: Wed Nov 27 17:12:46 2024 00:19:49.640 read: IOPS=639, BW=2557KiB/s (2619kB/s)(2560KiB/1001msec) 00:19:49.640 slat (nsec): min=6076, max=48391, avg=16242.36, stdev=5675.43 00:19:49.640 clat (usec): min=186, max=42008, avg=1173.60, stdev=6017.57 00:19:49.640 lat (usec): min=192, max=42023, avg=1189.84, stdev=6019.50 00:19:49.640 clat percentiles (usec): 00:19:49.640 | 1.00th=[ 196], 5.00th=[ 206], 10.00th=[ 217], 20.00th=[ 235], 00:19:49.640 | 30.00th=[ 247], 40.00th=[ 258], 50.00th=[ 265], 60.00th=[ 277], 00:19:49.640 | 70.00th=[ 289], 80.00th=[ 310], 90.00th=[ 330], 95.00th=[ 461], 00:19:49.640 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:49.640 | 99.99th=[42206] 00:19:49.640 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:19:49.640 slat (usec): min=6, max=14582, avg=29.52, stdev=455.29 00:19:49.640 clat (usec): min=132, max=501, avg=197.01, stdev=37.14 00:19:49.640 lat (usec): min=143, max=14762, avg=226.54, stdev=456.20 00:19:49.640 clat percentiles (usec): 00:19:49.641 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 161], 20.00th=[ 172], 00:19:49.641 | 30.00th=[ 180], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 194], 00:19:49.641 | 70.00th=[ 202], 80.00th=[ 227], 90.00th=[ 245], 95.00th=[ 255], 00:19:49.641 | 99.00th=[ 322], 99.50th=[ 375], 99.90th=[ 482], 99.95th=[ 502], 00:19:49.641 | 99.99th=[ 502] 00:19:49.641 bw ( KiB/s): min= 8192, max= 8192, per=39.74%, avg=8192.00, stdev= 0.00, samples=1 00:19:49.641 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:49.641 lat (usec) : 250=70.67%, 500=28.00%, 750=0.48% 00:19:49.641 lat (msec) : 50=0.84% 00:19:49.641 cpu : usr=1.50%, sys=3.70%, ctx=1667, majf=0, minf=1 00:19:49.641 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:49.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 issued rwts: total=640,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:49.641 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:49.641 job2: (groupid=0, jobs=1): err= 0: pid=1760237: Wed Nov 27 17:12:46 2024 00:19:49.641 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:49.641 slat (nsec): min=6969, max=42250, avg=14757.11, stdev=5669.78 00:19:49.641 clat (usec): min=204, max=42026, avg=362.50, stdev=1832.40 00:19:49.641 lat (usec): min=212, max=42063, avg=377.26, stdev=1833.19 00:19:49.641 clat percentiles (usec): 00:19:49.641 | 1.00th=[ 215], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 233], 00:19:49.641 | 30.00th=[ 243], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 269], 00:19:49.641 | 70.00th=[ 281], 80.00th=[ 310], 90.00th=[ 359], 95.00th=[ 449], 00:19:49.641 | 99.00th=[ 553], 99.50th=[ 586], 99.90th=[41681], 99.95th=[42206], 00:19:49.641 | 99.99th=[42206] 00:19:49.641 write: IOPS=1769, BW=7077KiB/s (7247kB/s)(7084KiB/1001msec); 0 zone resets 00:19:49.641 slat (usec): min=8, max=15689, avg=26.49, stdev=372.46 00:19:49.641 clat (usec): min=145, max=745, avg=202.39, stdev=37.47 00:19:49.641 lat (usec): min=156, max=16144, avg=228.88, stdev=380.15 00:19:49.641 clat percentiles (usec): 00:19:49.641 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 182], 00:19:49.641 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 200], 00:19:49.641 | 70.00th=[ 208], 80.00th=[ 225], 90.00th=[ 245], 95.00th=[ 273], 00:19:49.641 | 99.00th=[ 310], 99.50th=[ 322], 99.90th=[ 685], 99.95th=[ 750], 00:19:49.641 | 99.99th=[ 750] 00:19:49.641 bw ( KiB/s): min= 5448, max= 5448, per=26.43%, avg=5448.00, stdev= 0.00, samples=1 00:19:49.641 iops : min= 1362, max= 1362, avg=1362.00, stdev= 0.00, samples=1 00:19:49.641 lat (usec) : 250=65.71%, 500=32.96%, 750=1.18%, 1000=0.03% 00:19:49.641 lat (msec) : 2=0.03%, 50=0.09% 00:19:49.641 cpu : usr=2.90%, sys=8.30%, ctx=3309, majf=0, minf=1 00:19:49.641 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:49.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 issued rwts: total=1536,1771,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:49.641 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:49.641 job3: (groupid=0, jobs=1): err= 0: pid=1760238: Wed Nov 27 17:12:46 2024 00:19:49.641 read: IOPS=1822, BW=7289KiB/s (7464kB/s)(7296KiB/1001msec) 00:19:49.641 slat (nsec): min=6207, max=59800, avg=15174.94, stdev=5469.58 00:19:49.641 clat (usec): min=209, max=1030, avg=290.03, stdev=71.36 00:19:49.641 lat (usec): min=216, max=1038, avg=305.21, stdev=72.26 00:19:49.641 clat percentiles (usec): 00:19:49.641 | 1.00th=[ 221], 5.00th=[ 239], 10.00th=[ 243], 20.00th=[ 249], 00:19:49.641 | 30.00th=[ 253], 40.00th=[ 258], 50.00th=[ 265], 60.00th=[ 269], 00:19:49.641 | 70.00th=[ 285], 80.00th=[ 314], 90.00th=[ 416], 95.00th=[ 449], 00:19:49.641 | 99.00th=[ 523], 99.50th=[ 562], 99.90th=[ 857], 99.95th=[ 1029], 00:19:49.641 | 99.99th=[ 1029] 00:19:49.641 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:49.641 slat (nsec): min=5821, max=54056, avg=15312.84, stdev=6602.19 00:19:49.641 clat (usec): min=145, max=1157, avg=192.66, stdev=38.44 00:19:49.641 lat (usec): min=154, max=1167, avg=207.97, stdev=39.78 00:19:49.641 clat percentiles (usec): 00:19:49.641 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 165], 00:19:49.641 | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 194], 00:19:49.641 | 70.00th=[ 200], 80.00th=[ 210], 90.00th=[ 235], 95.00th=[ 249], 00:19:49.641 | 99.00th=[ 306], 99.50th=[ 326], 99.90th=[ 400], 99.95th=[ 433], 00:19:49.641 | 99.99th=[ 1156] 00:19:49.641 bw ( KiB/s): min= 8192, max= 8192, per=39.74%, avg=8192.00, stdev= 0.00, samples=1 00:19:49.641 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:49.641 lat (usec) : 250=61.34%, 500=37.78%, 750=0.77%, 1000=0.05% 00:19:49.641 lat (msec) : 2=0.05% 00:19:49.641 cpu : usr=4.40%, sys=8.10%, ctx=3872, majf=0, minf=2 00:19:49.641 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:49.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:49.641 issued rwts: total=1824,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:49.641 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:49.641 00:19:49.641 Run status group 0 (all jobs): 00:19:49.641 READ: bw=15.1MiB/s (15.9MB/s), 84.7KiB/s-7289KiB/s (86.7kB/s-7464kB/s), io=15.7MiB (16.5MB), run=1001-1039msec 00:19:49.641 WRITE: bw=20.1MiB/s (21.1MB/s), 1971KiB/s-8184KiB/s (2018kB/s-8380kB/s), io=20.9MiB (21.9MB), run=1001-1039msec 00:19:49.641 00:19:49.641 Disk stats (read/write): 00:19:49.641 nvme0n1: ios=57/512, merge=0/0, ticks=1297/116, in_queue=1413, util=97.70% 00:19:49.641 nvme0n2: ios=679/1024, merge=0/0, ticks=877/187, in_queue=1064, util=100.00% 00:19:49.641 nvme0n3: ios=1170/1536, merge=0/0, ticks=1325/299, in_queue=1624, util=97.82% 00:19:49.641 nvme0n4: ios=1593/1644, merge=0/0, ticks=503/318, in_queue=821, util=91.11% 00:19:49.641 17:12:46 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:49.641 [global] 00:19:49.641 thread=1 00:19:49.641 invalidate=1 00:19:49.641 rw=write 00:19:49.641 time_based=1 00:19:49.641 runtime=1 00:19:49.641 ioengine=libaio 00:19:49.641 direct=1 00:19:49.641 bs=4096 00:19:49.641 iodepth=128 00:19:49.641 norandommap=0 00:19:49.641 numjobs=1 00:19:49.641 00:19:49.641 verify_dump=1 00:19:49.641 verify_backlog=512 00:19:49.641 verify_state_save=0 00:19:49.641 do_verify=1 00:19:49.641 verify=crc32c-intel 00:19:49.641 [job0] 00:19:49.641 filename=/dev/nvme0n1 00:19:49.641 [job1] 00:19:49.641 filename=/dev/nvme0n2 00:19:49.641 [job2] 00:19:49.641 filename=/dev/nvme0n3 00:19:49.641 [job3] 00:19:49.641 filename=/dev/nvme0n4 00:19:49.641 Could not set queue depth (nvme0n1) 00:19:49.641 Could not set queue depth (nvme0n2) 00:19:49.641 Could not set queue depth (nvme0n3) 00:19:49.641 Could not set queue depth (nvme0n4) 00:19:49.641 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:49.641 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:49.641 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:49.641 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:49.641 fio-3.35 00:19:49.641 Starting 4 threads 00:19:51.016 00:19:51.016 job0: (groupid=0, jobs=1): err= 0: pid=1760593: Wed Nov 27 17:12:47 2024 00:19:51.016 read: IOPS=2515, BW=9.83MiB/s (10.3MB/s)(9.86MiB/1003msec) 00:19:51.016 slat (usec): min=2, max=28280, avg=223.32, stdev=1506.71 00:19:51.016 clat (usec): min=868, max=91343, avg=27620.21, stdev=17960.05 00:19:51.016 lat (usec): min=2763, max=91360, avg=27843.54, stdev=18098.35 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 3785], 5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[12256], 00:19:51.016 | 30.00th=[17433], 40.00th=[21365], 50.00th=[22414], 60.00th=[26346], 00:19:51.016 | 70.00th=[29754], 80.00th=[38536], 90.00th=[63177], 95.00th=[69731], 00:19:51.016 | 99.00th=[78119], 99.50th=[78119], 99.90th=[84411], 99.95th=[89654], 00:19:51.016 | 99.99th=[91751] 00:19:51.016 write: IOPS=2552, BW=9.97MiB/s (10.5MB/s)(10.0MiB/1003msec); 0 zone resets 00:19:51.016 slat (usec): min=3, max=13924, avg=162.40, stdev=877.41 00:19:51.016 clat (usec): min=5897, max=67655, avg=21707.69, stdev=12203.75 00:19:51.016 lat (usec): min=5912, max=67686, avg=21870.09, stdev=12270.46 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 8291], 5.00th=[10028], 10.00th=[10552], 20.00th=[11338], 00:19:51.016 | 30.00th=[13173], 40.00th=[14877], 50.00th=[17433], 60.00th=[21890], 00:19:51.016 | 70.00th=[23725], 80.00th=[31589], 90.00th=[41157], 95.00th=[50070], 00:19:51.016 | 99.00th=[56361], 99.50th=[56886], 99.90th=[56886], 99.95th=[64750], 00:19:51.016 | 99.99th=[67634] 00:19:51.016 bw ( KiB/s): min= 9344, max=11136, per=16.29%, avg=10240.00, stdev=1267.14, samples=2 00:19:51.016 iops : min= 2336, max= 2784, avg=2560.00, stdev=316.78, samples=2 00:19:51.016 lat (usec) : 1000=0.02% 00:19:51.016 lat (msec) : 4=0.61%, 10=9.58%, 20=34.27%, 50=46.55%, 100=8.97% 00:19:51.016 cpu : usr=3.39%, sys=3.39%, ctx=234, majf=0, minf=1 00:19:51.016 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:51.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:51.016 issued rwts: total=2523,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:51.016 job1: (groupid=0, jobs=1): err= 0: pid=1760596: Wed Nov 27 17:12:47 2024 00:19:51.016 read: IOPS=4557, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1011msec) 00:19:51.016 slat (usec): min=2, max=11763, avg=93.99, stdev=609.58 00:19:51.016 clat (usec): min=1086, max=27161, avg=12623.92, stdev=4067.90 00:19:51.016 lat (usec): min=1102, max=27193, avg=12717.91, stdev=4107.81 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 2245], 5.00th=[ 5669], 10.00th=[ 8848], 20.00th=[10290], 00:19:51.016 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11731], 60.00th=[12518], 00:19:51.016 | 70.00th=[14353], 80.00th=[16450], 90.00th=[18744], 95.00th=[20317], 00:19:51.016 | 99.00th=[21103], 99.50th=[21365], 99.90th=[25297], 99.95th=[25560], 00:19:51.016 | 99.99th=[27132] 00:19:51.016 write: IOPS=5049, BW=19.7MiB/s (20.7MB/s)(19.9MiB/1011msec); 0 zone resets 00:19:51.016 slat (usec): min=3, max=10620, avg=98.80, stdev=599.64 00:19:51.016 clat (usec): min=230, max=43363, avg=13627.34, stdev=6748.76 00:19:51.016 lat (usec): min=637, max=43375, avg=13726.14, stdev=6799.91 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 3359], 5.00th=[ 7046], 10.00th=[ 8455], 20.00th=[ 9241], 00:19:51.016 | 30.00th=[10421], 40.00th=[11207], 50.00th=[11731], 60.00th=[12387], 00:19:51.016 | 70.00th=[13960], 80.00th=[16581], 90.00th=[20579], 95.00th=[30016], 00:19:51.016 | 99.00th=[39060], 99.50th=[41681], 99.90th=[43254], 99.95th=[43254], 00:19:51.016 | 99.99th=[43254] 00:19:51.016 bw ( KiB/s): min=19456, max=20368, per=31.68%, avg=19912.00, stdev=644.88, samples=2 00:19:51.016 iops : min= 4864, max= 5092, avg=4978.00, stdev=161.22, samples=2 00:19:51.016 lat (usec) : 250=0.01%, 750=0.11%, 1000=0.16% 00:19:51.016 lat (msec) : 2=0.47%, 4=1.72%, 10=20.28%, 20=66.83%, 50=10.41% 00:19:51.016 cpu : usr=6.63%, sys=9.41%, ctx=351, majf=0, minf=2 00:19:51.016 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:51.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:51.016 issued rwts: total=4608,5105,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:51.016 job2: (groupid=0, jobs=1): err= 0: pid=1760602: Wed Nov 27 17:12:47 2024 00:19:51.016 read: IOPS=3937, BW=15.4MiB/s (16.1MB/s)(15.5MiB/1005msec) 00:19:51.016 slat (usec): min=2, max=15830, avg=133.67, stdev=820.88 00:19:51.016 clat (usec): min=1651, max=40729, avg=16743.77, stdev=7116.29 00:19:51.016 lat (usec): min=4608, max=40738, avg=16877.44, stdev=7157.71 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 5473], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[10814], 00:19:51.016 | 30.00th=[12518], 40.00th=[13960], 50.00th=[14222], 60.00th=[15795], 00:19:51.016 | 70.00th=[18744], 80.00th=[22152], 90.00th=[28443], 95.00th=[31589], 00:19:51.016 | 99.00th=[40633], 99.50th=[40633], 99.90th=[40633], 99.95th=[40633], 00:19:51.016 | 99.99th=[40633] 00:19:51.016 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:19:51.016 slat (usec): min=3, max=11081, avg=104.72, stdev=614.71 00:19:51.016 clat (usec): min=609, max=42962, avg=14841.96, stdev=6178.71 00:19:51.016 lat (usec): min=625, max=42977, avg=14946.68, stdev=6212.21 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 963], 5.00th=[ 5604], 10.00th=[ 8586], 20.00th=[10945], 00:19:51.016 | 30.00th=[11731], 40.00th=[12649], 50.00th=[13698], 60.00th=[14746], 00:19:51.016 | 70.00th=[15926], 80.00th=[19792], 90.00th=[22938], 95.00th=[25297], 00:19:51.016 | 99.00th=[37487], 99.50th=[38536], 99.90th=[39584], 99.95th=[40109], 00:19:51.016 | 99.99th=[42730] 00:19:51.016 bw ( KiB/s): min=15150, max=17648, per=26.09%, avg=16399.00, stdev=1766.35, samples=2 00:19:51.016 iops : min= 3787, max= 4412, avg=4099.50, stdev=441.94, samples=2 00:19:51.016 lat (usec) : 750=0.12%, 1000=0.58% 00:19:51.016 lat (msec) : 2=0.16%, 4=1.03%, 10=8.00%, 20=68.15%, 50=21.95% 00:19:51.016 cpu : usr=2.99%, sys=6.27%, ctx=401, majf=0, minf=1 00:19:51.016 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:51.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:51.016 issued rwts: total=3957,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:51.016 job3: (groupid=0, jobs=1): err= 0: pid=1760603: Wed Nov 27 17:12:47 2024 00:19:51.016 read: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec) 00:19:51.016 slat (usec): min=2, max=32606, avg=122.60, stdev=812.45 00:19:51.016 clat (usec): min=5823, max=44401, avg=16333.34, stdev=7187.97 00:19:51.016 lat (usec): min=5832, max=44420, avg=16455.94, stdev=7221.36 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 6194], 5.00th=[ 9765], 10.00th=[10814], 20.00th=[11600], 00:19:51.016 | 30.00th=[11994], 40.00th=[12649], 50.00th=[13435], 60.00th=[14615], 00:19:51.016 | 70.00th=[16319], 80.00th=[21627], 90.00th=[26870], 95.00th=[31589], 00:19:51.016 | 99.00th=[40633], 99.50th=[41681], 99.90th=[42730], 99.95th=[42730], 00:19:51.016 | 99.99th=[44303] 00:19:51.016 write: IOPS=4114, BW=16.1MiB/s (16.9MB/s)(16.1MiB/1002msec); 0 zone resets 00:19:51.016 slat (usec): min=3, max=12250, avg=110.99, stdev=614.31 00:19:51.016 clat (usec): min=359, max=41746, avg=14480.13, stdev=4185.74 00:19:51.016 lat (usec): min=2106, max=41751, avg=14591.12, stdev=4182.15 00:19:51.016 clat percentiles (usec): 00:19:51.016 | 1.00th=[ 3097], 5.00th=[ 9372], 10.00th=[10552], 20.00th=[11863], 00:19:51.016 | 30.00th=[12518], 40.00th=[13566], 50.00th=[13829], 60.00th=[14222], 00:19:51.016 | 70.00th=[15270], 80.00th=[16909], 90.00th=[19792], 95.00th=[22414], 00:19:51.016 | 99.00th=[24249], 99.50th=[33817], 99.90th=[41681], 99.95th=[41681], 00:19:51.016 | 99.99th=[41681] 00:19:51.016 bw ( KiB/s): min=16384, max=16384, per=26.07%, avg=16384.00, stdev= 0.00, samples=2 00:19:51.016 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:19:51.016 lat (usec) : 500=0.01% 00:19:51.016 lat (msec) : 4=0.58%, 10=6.48%, 20=76.71%, 50=16.21% 00:19:51.016 cpu : usr=4.30%, sys=8.69%, ctx=391, majf=0, minf=1 00:19:51.016 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:51.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:51.016 issued rwts: total=4096,4123,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:51.016 00:19:51.016 Run status group 0 (all jobs): 00:19:51.016 READ: bw=58.7MiB/s (61.5MB/s), 9.83MiB/s-17.8MiB/s (10.3MB/s-18.7MB/s), io=59.3MiB (62.2MB), run=1002-1011msec 00:19:51.016 WRITE: bw=61.4MiB/s (64.4MB/s), 9.97MiB/s-19.7MiB/s (10.5MB/s-20.7MB/s), io=62.0MiB (65.1MB), run=1002-1011msec 00:19:51.016 00:19:51.016 Disk stats (read/write): 00:19:51.016 nvme0n1: ios=1847/2048, merge=0/0, ticks=15449/12341, in_queue=27790, util=86.77% 00:19:51.016 nvme0n2: ios=4140/4513, merge=0/0, ticks=27941/28109, in_queue=56050, util=96.75% 00:19:51.016 nvme0n3: ios=3124/3567, merge=0/0, ticks=31543/33571, in_queue=65114, util=96.87% 00:19:51.016 nvme0n4: ios=3221/3584, merge=0/0, ticks=16803/16090, in_queue=32893, util=89.18% 00:19:51.016 17:12:47 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:51.016 [global] 00:19:51.016 thread=1 00:19:51.016 invalidate=1 00:19:51.016 rw=randwrite 00:19:51.016 time_based=1 00:19:51.016 runtime=1 00:19:51.016 ioengine=libaio 00:19:51.016 direct=1 00:19:51.016 bs=4096 00:19:51.016 iodepth=128 00:19:51.016 norandommap=0 00:19:51.016 numjobs=1 00:19:51.016 00:19:51.016 verify_dump=1 00:19:51.016 verify_backlog=512 00:19:51.016 verify_state_save=0 00:19:51.016 do_verify=1 00:19:51.016 verify=crc32c-intel 00:19:51.016 [job0] 00:19:51.017 filename=/dev/nvme0n1 00:19:51.017 [job1] 00:19:51.017 filename=/dev/nvme0n2 00:19:51.017 [job2] 00:19:51.017 filename=/dev/nvme0n3 00:19:51.017 [job3] 00:19:51.017 filename=/dev/nvme0n4 00:19:51.017 Could not set queue depth (nvme0n1) 00:19:51.017 Could not set queue depth (nvme0n2) 00:19:51.017 Could not set queue depth (nvme0n3) 00:19:51.017 Could not set queue depth (nvme0n4) 00:19:51.017 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:51.017 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:51.017 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:51.017 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:51.017 fio-3.35 00:19:51.017 Starting 4 threads 00:19:52.405 00:19:52.405 job0: (groupid=0, jobs=1): err= 0: pid=1760831: Wed Nov 27 17:12:49 2024 00:19:52.405 read: IOPS=3386, BW=13.2MiB/s (13.9MB/s)(13.3MiB/1002msec) 00:19:52.405 slat (usec): min=3, max=18985, avg=163.13, stdev=1130.81 00:19:52.405 clat (usec): min=767, max=67755, avg=20916.32, stdev=16649.37 00:19:52.405 lat (usec): min=2561, max=67773, avg=21079.45, stdev=16748.23 00:19:52.405 clat percentiles (usec): 00:19:52.405 | 1.00th=[ 5473], 5.00th=[ 9110], 10.00th=[10290], 20.00th=[10683], 00:19:52.405 | 30.00th=[10814], 40.00th=[10945], 50.00th=[11076], 60.00th=[11338], 00:19:52.405 | 70.00th=[20055], 80.00th=[38011], 90.00th=[49021], 95.00th=[52691], 00:19:52.405 | 99.00th=[66847], 99.50th=[67634], 99.90th=[67634], 99.95th=[67634], 00:19:52.405 | 99.99th=[67634] 00:19:52.405 write: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec); 0 zone resets 00:19:52.405 slat (usec): min=4, max=38351, avg=111.83, stdev=852.26 00:19:52.405 clat (usec): min=5513, max=51484, avg=15492.82, stdev=8574.81 00:19:52.405 lat (usec): min=5520, max=51522, avg=15604.65, stdev=8604.75 00:19:52.405 clat percentiles (usec): 00:19:52.405 | 1.00th=[ 8848], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[10028], 00:19:52.406 | 30.00th=[10945], 40.00th=[11338], 50.00th=[11731], 60.00th=[14353], 00:19:52.406 | 70.00th=[16319], 80.00th=[18744], 90.00th=[23200], 95.00th=[39060], 00:19:52.406 | 99.00th=[48497], 99.50th=[50070], 99.90th=[50594], 99.95th=[50594], 00:19:52.406 | 99.99th=[51643] 00:19:52.406 bw ( KiB/s): min= 8200, max=20472, per=22.13%, avg=14336.00, stdev=8677.61, samples=2 00:19:52.406 iops : min= 2050, max= 5118, avg=3584.00, stdev=2169.40, samples=2 00:19:52.406 lat (usec) : 1000=0.01% 00:19:52.406 lat (msec) : 4=0.46%, 10=13.17%, 20=61.99%, 50=19.42%, 100=4.94% 00:19:52.406 cpu : usr=5.29%, sys=8.99%, ctx=268, majf=0, minf=2 00:19:52.406 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:52.406 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.406 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:52.406 issued rwts: total=3393,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.406 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:52.406 job1: (groupid=0, jobs=1): err= 0: pid=1760832: Wed Nov 27 17:12:49 2024 00:19:52.406 read: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec) 00:19:52.406 slat (usec): min=3, max=12187, avg=127.43, stdev=741.53 00:19:52.406 clat (usec): min=5903, max=46151, avg=15810.45, stdev=8380.78 00:19:52.406 lat (usec): min=6339, max=46172, avg=15937.88, stdev=8443.89 00:19:52.406 clat percentiles (usec): 00:19:52.406 | 1.00th=[ 6915], 5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[ 9765], 00:19:52.406 | 30.00th=[10290], 40.00th=[11076], 50.00th=[13304], 60.00th=[13829], 00:19:52.406 | 70.00th=[14746], 80.00th=[21103], 90.00th=[29754], 95.00th=[32637], 00:19:52.406 | 99.00th=[44303], 99.50th=[44303], 99.90th=[45876], 99.95th=[46400], 00:19:52.406 | 99.99th=[46400] 00:19:52.406 write: IOPS=3779, BW=14.8MiB/s (15.5MB/s)(14.8MiB/1002msec); 0 zone resets 00:19:52.406 slat (usec): min=4, max=11752, avg=130.92, stdev=764.34 00:19:52.406 clat (usec): min=1117, max=101121, avg=18319.18, stdev=16360.99 00:19:52.406 lat (usec): min=1134, max=101143, avg=18450.11, stdev=16451.31 00:19:52.406 clat percentiles (msec): 00:19:52.407 | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], 00:19:52.407 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 14], 00:19:52.407 | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 38], 95.00th=[ 57], 00:19:52.407 | 99.00th=[ 91], 99.50th=[ 102], 99.90th=[ 102], 99.95th=[ 102], 00:19:52.407 | 99.99th=[ 102] 00:19:52.407 bw ( KiB/s): min=14072, max=15208, per=22.60%, avg=14640.00, stdev=803.27, samples=2 00:19:52.407 iops : min= 3518, max= 3802, avg=3660.00, stdev=200.82, samples=2 00:19:52.407 lat (msec) : 2=0.20%, 10=21.63%, 20=55.03%, 50=19.97%, 100=2.92% 00:19:52.407 lat (msec) : 250=0.26% 00:19:52.407 cpu : usr=5.89%, sys=8.99%, ctx=370, majf=0, minf=1 00:19:52.407 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:52.407 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.407 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:52.407 issued rwts: total=3584,3787,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.407 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:52.407 job2: (groupid=0, jobs=1): err= 0: pid=1760833: Wed Nov 27 17:12:49 2024 00:19:52.407 read: IOPS=3214, BW=12.6MiB/s (13.2MB/s)(12.6MiB/1005msec) 00:19:52.407 slat (usec): min=3, max=11361, avg=133.65, stdev=710.83 00:19:52.407 clat (usec): min=469, max=43133, avg=16394.50, stdev=4632.33 00:19:52.407 lat (usec): min=5484, max=43150, avg=16528.14, stdev=4679.11 00:19:52.407 clat percentiles (usec): 00:19:52.407 | 1.00th=[ 6128], 5.00th=[10814], 10.00th=[11600], 20.00th=[12649], 00:19:52.407 | 30.00th=[14091], 40.00th=[15008], 50.00th=[16057], 60.00th=[16712], 00:19:52.407 | 70.00th=[17957], 80.00th=[19530], 90.00th=[21365], 95.00th=[23200], 00:19:52.407 | 99.00th=[32375], 99.50th=[37487], 99.90th=[43254], 99.95th=[43254], 00:19:52.407 | 99.99th=[43254] 00:19:52.407 write: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec); 0 zone resets 00:19:52.407 slat (usec): min=4, max=9901, avg=146.21, stdev=753.11 00:19:52.407 clat (usec): min=1285, max=57839, avg=20681.49, stdev=9754.07 00:19:52.407 lat (usec): min=1294, max=57847, avg=20827.71, stdev=9825.62 00:19:52.407 clat percentiles (usec): 00:19:52.407 | 1.00th=[ 6456], 5.00th=[ 9241], 10.00th=[11469], 20.00th=[13566], 00:19:52.407 | 30.00th=[15008], 40.00th=[15926], 50.00th=[17433], 60.00th=[19268], 00:19:52.407 | 70.00th=[23200], 80.00th=[30016], 90.00th=[34341], 95.00th=[40109], 00:19:52.407 | 99.00th=[52691], 99.50th=[53740], 99.90th=[57934], 99.95th=[57934], 00:19:52.407 | 99.99th=[57934] 00:19:52.407 bw ( KiB/s): min=12720, max=15944, per=22.12%, avg=14332.00, stdev=2279.71, samples=2 00:19:52.408 iops : min= 3180, max= 3986, avg=3583.00, stdev=569.93, samples=2 00:19:52.408 lat (usec) : 500=0.01% 00:19:52.408 lat (msec) : 2=0.16%, 10=5.34%, 20=66.72%, 50=26.98%, 100=0.78% 00:19:52.408 cpu : usr=5.88%, sys=9.06%, ctx=330, majf=0, minf=1 00:19:52.408 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:52.408 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.408 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:52.408 issued rwts: total=3231,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.408 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:52.408 job3: (groupid=0, jobs=1): err= 0: pid=1760834: Wed Nov 27 17:12:49 2024 00:19:52.408 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:19:52.408 slat (usec): min=2, max=6509, avg=90.12, stdev=518.85 00:19:52.408 clat (usec): min=6806, max=20835, avg=11816.89, stdev=1681.09 00:19:52.408 lat (usec): min=6815, max=20849, avg=11907.01, stdev=1709.64 00:19:52.408 clat percentiles (usec): 00:19:52.408 | 1.00th=[ 8094], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10814], 00:19:52.408 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11600], 60.00th=[11863], 00:19:52.408 | 70.00th=[12256], 80.00th=[12649], 90.00th=[13829], 95.00th=[15401], 00:19:52.408 | 99.00th=[17433], 99.50th=[17695], 99.90th=[20055], 99.95th=[20317], 00:19:52.408 | 99.99th=[20841] 00:19:52.408 write: IOPS=5300, BW=20.7MiB/s (21.7MB/s)(20.8MiB/1004msec); 0 zone resets 00:19:52.408 slat (usec): min=3, max=10125, avg=90.29, stdev=516.49 00:19:52.408 clat (usec): min=382, max=23063, avg=12373.26, stdev=2422.65 00:19:52.408 lat (usec): min=5246, max=23083, avg=12463.55, stdev=2429.27 00:19:52.408 clat percentiles (usec): 00:19:52.408 | 1.00th=[ 5932], 5.00th=[ 8356], 10.00th=[10290], 20.00th=[10683], 00:19:52.408 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12125], 60.00th=[12518], 00:19:52.408 | 70.00th=[13173], 80.00th=[13829], 90.00th=[14877], 95.00th=[17171], 00:19:52.408 | 99.00th=[20055], 99.50th=[22152], 99.90th=[22938], 99.95th=[22938], 00:19:52.408 | 99.99th=[22938] 00:19:52.408 bw ( KiB/s): min=20248, max=21304, per=32.07%, avg=20776.00, stdev=746.70, samples=2 00:19:52.408 iops : min= 5062, max= 5326, avg=5194.00, stdev=186.68, samples=2 00:19:52.409 lat (usec) : 500=0.01% 00:19:52.409 lat (msec) : 10=9.59%, 20=89.76%, 50=0.64% 00:19:52.409 cpu : usr=8.77%, sys=9.97%, ctx=405, majf=0, minf=1 00:19:52.409 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:52.409 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.409 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:52.409 issued rwts: total=5120,5322,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.409 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:52.409 00:19:52.409 Run status group 0 (all jobs): 00:19:52.409 READ: bw=59.6MiB/s (62.5MB/s), 12.6MiB/s-19.9MiB/s (13.2MB/s-20.9MB/s), io=59.9MiB (62.8MB), run=1002-1005msec 00:19:52.409 WRITE: bw=63.3MiB/s (66.3MB/s), 13.9MiB/s-20.7MiB/s (14.6MB/s-21.7MB/s), io=63.6MiB (66.7MB), run=1002-1005msec 00:19:52.409 00:19:52.409 Disk stats (read/write): 00:19:52.409 nvme0n1: ios=3011/3072, merge=0/0, ticks=16642/10287, in_queue=26929, util=98.10% 00:19:52.409 nvme0n2: ios=2978/3072, merge=0/0, ticks=18883/27256, in_queue=46139, util=97.66% 00:19:52.409 nvme0n3: ios=2858/3072, merge=0/0, ticks=31418/45932, in_queue=77350, util=99.48% 00:19:52.410 nvme0n4: ios=4402/4608, merge=0/0, ticks=23756/22988, in_queue=46744, util=99.37% 00:19:52.410 17:12:49 -- target/fio.sh@55 -- # sync 00:19:52.410 17:12:49 -- target/fio.sh@59 -- # fio_pid=1760972 00:19:52.410 17:12:49 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:52.410 17:12:49 -- target/fio.sh@61 -- # sleep 3 00:19:52.410 [global] 00:19:52.410 thread=1 00:19:52.410 invalidate=1 00:19:52.410 rw=read 00:19:52.410 time_based=1 00:19:52.410 runtime=10 00:19:52.410 ioengine=libaio 00:19:52.410 direct=1 00:19:52.410 bs=4096 00:19:52.410 iodepth=1 00:19:52.410 norandommap=1 00:19:52.410 numjobs=1 00:19:52.410 00:19:52.410 [job0] 00:19:52.410 filename=/dev/nvme0n1 00:19:52.410 [job1] 00:19:52.410 filename=/dev/nvme0n2 00:19:52.410 [job2] 00:19:52.410 filename=/dev/nvme0n3 00:19:52.410 [job3] 00:19:52.410 filename=/dev/nvme0n4 00:19:52.410 Could not set queue depth (nvme0n1) 00:19:52.410 Could not set queue depth (nvme0n2) 00:19:52.410 Could not set queue depth (nvme0n3) 00:19:52.410 Could not set queue depth (nvme0n4) 00:19:52.410 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:52.410 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:52.410 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:52.410 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:52.410 fio-3.35 00:19:52.410 Starting 4 threads 00:19:55.701 17:12:52 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:55.701 17:12:52 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:55.701 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=598016, buflen=4096 00:19:55.701 fio: pid=1761067, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:55.701 17:12:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:55.701 17:12:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:55.701 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=462848, buflen=4096 00:19:55.701 fio: pid=1761066, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:55.959 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=16818176, buflen=4096 00:19:55.959 fio: pid=1761064, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:55.959 17:12:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:55.959 17:12:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:56.217 17:12:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:56.217 17:12:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:56.476 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=479232, buflen=4096 00:19:56.476 fio: pid=1761065, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:56.476 00:19:56.476 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1761064: Wed Nov 27 17:12:53 2024 00:19:56.476 read: IOPS=1198, BW=4791KiB/s (4906kB/s)(16.0MiB/3428msec) 00:19:56.476 slat (usec): min=5, max=11689, avg=17.66, stdev=297.13 00:19:56.476 clat (usec): min=182, max=42049, avg=808.87, stdev=4804.13 00:19:56.476 lat (usec): min=188, max=42077, avg=826.53, stdev=4814.52 00:19:56.476 clat percentiles (usec): 00:19:56.476 | 1.00th=[ 194], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:19:56.476 | 30.00th=[ 215], 40.00th=[ 221], 50.00th=[ 229], 60.00th=[ 237], 00:19:56.476 | 70.00th=[ 247], 80.00th=[ 260], 90.00th=[ 273], 95.00th=[ 289], 00:19:56.476 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:19:56.476 | 99.99th=[42206] 00:19:56.476 bw ( KiB/s): min= 136, max=16368, per=71.33%, avg=3446.67, stdev=6400.84, samples=6 00:19:56.476 iops : min= 34, max= 4092, avg=861.67, stdev=1600.21, samples=6 00:19:56.476 lat (usec) : 250=71.80%, 500=26.66%, 750=0.05%, 1000=0.02% 00:19:56.476 lat (msec) : 2=0.02%, 50=1.41% 00:19:56.476 cpu : usr=0.64%, sys=1.63%, ctx=4113, majf=0, minf=2 00:19:56.476 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:56.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 issued rwts: total=4107,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.476 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:56.476 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1761065: Wed Nov 27 17:12:53 2024 00:19:56.476 read: IOPS=31, BW=126KiB/s (129kB/s)(468KiB/3711msec) 00:19:56.476 slat (usec): min=12, max=18885, avg=318.90, stdev=2251.99 00:19:56.476 clat (usec): min=335, max=42446, avg=31186.72, stdev=17742.75 00:19:56.476 lat (usec): min=367, max=56894, avg=31346.93, stdev=17873.26 00:19:56.476 clat percentiles (usec): 00:19:56.476 | 1.00th=[ 343], 5.00th=[ 355], 10.00th=[ 379], 20.00th=[ 474], 00:19:56.476 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:56.476 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:56.476 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:56.476 | 99.99th=[42206] 00:19:56.476 bw ( KiB/s): min= 88, max= 168, per=2.65%, avg=128.71, stdev=33.00, samples=7 00:19:56.476 iops : min= 22, max= 42, avg=32.14, stdev= 8.30, samples=7 00:19:56.476 lat (usec) : 500=24.58% 00:19:56.476 lat (msec) : 50=74.58% 00:19:56.476 cpu : usr=0.16%, sys=0.00%, ctx=122, majf=0, minf=2 00:19:56.476 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:56.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 complete : 0=0.8%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 issued rwts: total=118,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.476 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:56.476 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1761066: Wed Nov 27 17:12:53 2024 00:19:56.476 read: IOPS=36, BW=143KiB/s (146kB/s)(452KiB/3164msec) 00:19:56.476 slat (nsec): min=7370, max=39867, avg=22386.90, stdev=9695.20 00:19:56.476 clat (usec): min=257, max=42169, avg=27771.39, stdev=19260.78 00:19:56.476 lat (usec): min=272, max=42198, avg=27793.85, stdev=19262.69 00:19:56.476 clat percentiles (usec): 00:19:56.476 | 1.00th=[ 297], 5.00th=[ 326], 10.00th=[ 347], 20.00th=[ 379], 00:19:56.476 | 30.00th=[ 832], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:56.476 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:56.476 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:56.476 | 99.99th=[42206] 00:19:56.476 bw ( KiB/s): min= 96, max= 344, per=2.98%, avg=144.00, stdev=98.76, samples=6 00:19:56.476 iops : min= 24, max= 86, avg=36.00, stdev=24.69, samples=6 00:19:56.476 lat (usec) : 500=27.19%, 750=1.75%, 1000=1.75% 00:19:56.476 lat (msec) : 2=1.75%, 50=66.67% 00:19:56.476 cpu : usr=0.13%, sys=0.00%, ctx=117, majf=0, minf=1 00:19:56.476 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:56.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 complete : 0=0.9%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.476 issued rwts: total=114,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.476 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:56.476 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1761067: Wed Nov 27 17:12:53 2024 00:19:56.476 read: IOPS=50, BW=201KiB/s (206kB/s)(584KiB/2910msec) 00:19:56.476 slat (nsec): min=7160, max=67161, avg=24632.08, stdev=10461.34 00:19:56.476 clat (usec): min=296, max=42509, avg=19744.82, stdev=20488.28 00:19:56.476 lat (usec): min=329, max=42541, avg=19769.52, stdev=20488.20 00:19:56.476 clat percentiles (usec): 00:19:56.476 | 1.00th=[ 314], 5.00th=[ 330], 10.00th=[ 355], 20.00th=[ 375], 00:19:56.476 | 30.00th=[ 416], 40.00th=[ 474], 50.00th=[ 515], 60.00th=[40633], 00:19:56.476 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:56.476 | 99.00th=[42206], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:56.476 | 99.99th=[42730] 00:19:56.477 bw ( KiB/s): min= 144, max= 344, per=4.49%, avg=217.60, stdev=75.34, samples=5 00:19:56.477 iops : min= 36, max= 86, avg=54.40, stdev=18.84, samples=5 00:19:56.477 lat (usec) : 500=45.58%, 750=5.44%, 1000=1.36% 00:19:56.477 lat (msec) : 50=46.94% 00:19:56.477 cpu : usr=0.00%, sys=0.24%, ctx=148, majf=0, minf=1 00:19:56.477 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:56.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.477 complete : 0=0.7%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.477 issued rwts: total=147,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.477 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:56.477 00:19:56.477 Run status group 0 (all jobs): 00:19:56.477 READ: bw=4831KiB/s (4947kB/s), 126KiB/s-4791KiB/s (129kB/s-4906kB/s), io=17.5MiB (18.4MB), run=2910-3711msec 00:19:56.477 00:19:56.477 Disk stats (read/write): 00:19:56.477 nvme0n1: ios=3895/0, merge=0/0, ticks=3225/0, in_queue=3225, util=95.05% 00:19:56.477 nvme0n2: ios=115/0, merge=0/0, ticks=3571/0, in_queue=3571, util=96.22% 00:19:56.477 nvme0n3: ios=158/0, merge=0/0, ticks=3958/0, in_queue=3958, util=99.28% 00:19:56.477 nvme0n4: ios=192/0, merge=0/0, ticks=3988/0, in_queue=3988, util=99.22% 00:19:56.735 17:12:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:56.735 17:12:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:56.992 17:12:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:56.992 17:12:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:57.250 17:12:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:57.250 17:12:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:57.508 17:12:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:57.508 17:12:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:57.766 17:12:54 -- target/fio.sh@69 -- # fio_status=0 00:19:57.766 17:12:54 -- target/fio.sh@70 -- # wait 1760972 00:19:57.766 17:12:54 -- target/fio.sh@70 -- # fio_status=4 00:19:57.766 17:12:54 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:57.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:57.766 17:12:54 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:57.766 17:12:54 -- common/autotest_common.sh@1208 -- # local i=0 00:19:57.766 17:12:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:57.766 17:12:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:57.766 17:12:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:57.766 17:12:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:57.766 17:12:54 -- common/autotest_common.sh@1220 -- # return 0 00:19:57.766 17:12:54 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:57.766 17:12:54 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:57.766 nvmf hotplug test: fio failed as expected 00:19:57.766 17:12:54 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:58.024 17:12:54 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:58.024 17:12:54 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:58.024 17:12:54 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:58.024 17:12:54 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:58.024 17:12:54 -- target/fio.sh@91 -- # nvmftestfini 00:19:58.024 17:12:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:58.024 17:12:54 -- nvmf/common.sh@116 -- # sync 00:19:58.024 17:12:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:58.024 17:12:54 -- nvmf/common.sh@119 -- # set +e 00:19:58.024 17:12:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:58.024 17:12:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:58.024 rmmod nvme_tcp 00:19:58.024 rmmod nvme_fabrics 00:19:58.024 rmmod nvme_keyring 00:19:58.024 17:12:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:58.024 17:12:54 -- nvmf/common.sh@123 -- # set -e 00:19:58.024 17:12:54 -- nvmf/common.sh@124 -- # return 0 00:19:58.024 17:12:54 -- nvmf/common.sh@477 -- # '[' -n 1758897 ']' 00:19:58.024 17:12:54 -- nvmf/common.sh@478 -- # killprocess 1758897 00:19:58.024 17:12:54 -- common/autotest_common.sh@936 -- # '[' -z 1758897 ']' 00:19:58.024 17:12:54 -- common/autotest_common.sh@940 -- # kill -0 1758897 00:19:58.024 17:12:54 -- common/autotest_common.sh@941 -- # uname 00:19:58.024 17:12:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:58.024 17:12:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1758897 00:19:58.283 17:12:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:58.283 17:12:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:58.283 17:12:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1758897' 00:19:58.283 killing process with pid 1758897 00:19:58.283 17:12:54 -- common/autotest_common.sh@955 -- # kill 1758897 00:19:58.283 17:12:54 -- common/autotest_common.sh@960 -- # wait 1758897 00:19:58.283 17:12:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:58.283 17:12:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:58.283 17:12:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:58.283 17:12:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:58.283 17:12:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:58.283 17:12:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:58.283 17:12:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:58.283 17:12:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:00.821 17:12:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:00.821 00:20:00.821 real 0m24.304s 00:20:00.821 user 1m25.804s 00:20:00.821 sys 0m6.279s 00:20:00.821 17:12:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:00.821 17:12:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.821 ************************************ 00:20:00.821 END TEST nvmf_fio_target 00:20:00.821 ************************************ 00:20:00.821 17:12:57 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:00.821 17:12:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:00.821 17:12:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.821 ************************************ 00:20:00.821 START TEST nvmf_bdevio 00:20:00.821 ************************************ 00:20:00.821 17:12:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:00.821 * Looking for test storage... 00:20:00.821 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:00.821 17:12:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:00.821 17:12:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:00.821 17:12:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:00.821 17:12:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:00.821 17:12:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:00.821 17:12:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:00.821 17:12:57 -- scripts/common.sh@335 -- # IFS=.-: 00:20:00.821 17:12:57 -- scripts/common.sh@335 -- # read -ra ver1 00:20:00.821 17:12:57 -- scripts/common.sh@336 -- # IFS=.-: 00:20:00.821 17:12:57 -- scripts/common.sh@336 -- # read -ra ver2 00:20:00.821 17:12:57 -- scripts/common.sh@337 -- # local 'op=<' 00:20:00.821 17:12:57 -- scripts/common.sh@339 -- # ver1_l=2 00:20:00.821 17:12:57 -- scripts/common.sh@340 -- # ver2_l=1 00:20:00.821 17:12:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:00.821 17:12:57 -- scripts/common.sh@343 -- # case "$op" in 00:20:00.821 17:12:57 -- scripts/common.sh@344 -- # : 1 00:20:00.821 17:12:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:00.821 17:12:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:00.821 17:12:57 -- scripts/common.sh@364 -- # decimal 1 00:20:00.821 17:12:57 -- scripts/common.sh@352 -- # local d=1 00:20:00.821 17:12:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:00.821 17:12:57 -- scripts/common.sh@354 -- # echo 1 00:20:00.821 17:12:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:00.821 17:12:57 -- scripts/common.sh@365 -- # decimal 2 00:20:00.821 17:12:57 -- scripts/common.sh@352 -- # local d=2 00:20:00.821 17:12:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:00.821 17:12:57 -- scripts/common.sh@354 -- # echo 2 00:20:00.821 17:12:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:00.821 17:12:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:00.821 17:12:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:00.821 17:12:57 -- scripts/common.sh@367 -- # return 0 00:20:00.821 17:12:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:00.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.821 --rc genhtml_branch_coverage=1 00:20:00.821 --rc genhtml_function_coverage=1 00:20:00.821 --rc genhtml_legend=1 00:20:00.821 --rc geninfo_all_blocks=1 00:20:00.821 --rc geninfo_unexecuted_blocks=1 00:20:00.821 00:20:00.821 ' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:00.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.821 --rc genhtml_branch_coverage=1 00:20:00.821 --rc genhtml_function_coverage=1 00:20:00.821 --rc genhtml_legend=1 00:20:00.821 --rc geninfo_all_blocks=1 00:20:00.821 --rc geninfo_unexecuted_blocks=1 00:20:00.821 00:20:00.821 ' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:00.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.821 --rc genhtml_branch_coverage=1 00:20:00.821 --rc genhtml_function_coverage=1 00:20:00.821 --rc genhtml_legend=1 00:20:00.821 --rc geninfo_all_blocks=1 00:20:00.821 --rc geninfo_unexecuted_blocks=1 00:20:00.821 00:20:00.821 ' 00:20:00.821 17:12:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:00.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.821 --rc genhtml_branch_coverage=1 00:20:00.821 --rc genhtml_function_coverage=1 00:20:00.821 --rc genhtml_legend=1 00:20:00.821 --rc geninfo_all_blocks=1 00:20:00.821 --rc geninfo_unexecuted_blocks=1 00:20:00.821 00:20:00.821 ' 00:20:00.821 17:12:57 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:00.821 17:12:57 -- nvmf/common.sh@7 -- # uname -s 00:20:00.821 17:12:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:00.821 17:12:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:00.821 17:12:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:00.821 17:12:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:00.821 17:12:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:00.821 17:12:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:00.821 17:12:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:00.821 17:12:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:00.821 17:12:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:00.821 17:12:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:00.821 17:12:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:00.821 17:12:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:00.821 17:12:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:00.821 17:12:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:00.821 17:12:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:00.821 17:12:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:00.821 17:12:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:00.821 17:12:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:00.821 17:12:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:00.821 17:12:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.821 17:12:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.821 17:12:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.821 17:12:57 -- paths/export.sh@5 -- # export PATH 00:20:00.821 17:12:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.821 17:12:57 -- nvmf/common.sh@46 -- # : 0 00:20:00.821 17:12:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:00.821 17:12:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:00.821 17:12:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:00.821 17:12:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:00.821 17:12:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:00.821 17:12:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:00.821 17:12:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:00.821 17:12:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:00.821 17:12:57 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:00.821 17:12:57 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:00.821 17:12:57 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:00.821 17:12:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:00.821 17:12:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:00.821 17:12:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:00.821 17:12:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:00.821 17:12:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:00.821 17:12:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:00.821 17:12:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:00.821 17:12:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:00.821 17:12:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:00.821 17:12:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:00.821 17:12:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:00.821 17:12:57 -- common/autotest_common.sh@10 -- # set +x 00:20:02.748 17:12:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:02.748 17:12:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:02.748 17:12:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:02.748 17:12:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:02.748 17:12:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:02.748 17:12:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:02.748 17:12:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:02.748 17:12:59 -- nvmf/common.sh@294 -- # net_devs=() 00:20:02.748 17:12:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:02.748 17:12:59 -- nvmf/common.sh@295 -- # e810=() 00:20:02.748 17:12:59 -- nvmf/common.sh@295 -- # local -ga e810 00:20:02.748 17:12:59 -- nvmf/common.sh@296 -- # x722=() 00:20:02.748 17:12:59 -- nvmf/common.sh@296 -- # local -ga x722 00:20:02.748 17:12:59 -- nvmf/common.sh@297 -- # mlx=() 00:20:02.748 17:12:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:02.748 17:12:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:02.748 17:12:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:02.748 17:12:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:02.748 17:12:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.748 17:12:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:02.748 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:02.748 17:12:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.748 17:12:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:02.748 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:02.748 17:12:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.748 17:12:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.748 17:12:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.748 17:12:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:02.748 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:02.748 17:12:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.748 17:12:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.748 17:12:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.748 17:12:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.748 17:12:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:02.748 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:02.748 17:12:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.748 17:12:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:02.748 17:12:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:02.748 17:12:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:02.748 17:12:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:02.748 17:12:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:02.748 17:12:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:02.748 17:12:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:02.748 17:12:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:02.748 17:12:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:02.748 17:12:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:02.748 17:12:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:02.748 17:12:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:02.748 17:12:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:02.748 17:12:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:02.748 17:12:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:02.748 17:12:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:02.748 17:12:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:02.748 17:12:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:02.748 17:12:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:02.748 17:12:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:02.748 17:12:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:02.748 17:12:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:02.748 17:12:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:02.748 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:02.748 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:20:02.749 00:20:02.749 --- 10.0.0.2 ping statistics --- 00:20:02.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.749 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:20:02.749 17:12:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:02.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:02.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:20:02.749 00:20:02.749 --- 10.0.0.1 ping statistics --- 00:20:02.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.749 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:20:02.749 17:12:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:02.749 17:12:59 -- nvmf/common.sh@410 -- # return 0 00:20:02.749 17:12:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:02.749 17:12:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:02.749 17:12:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:02.749 17:12:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:02.749 17:12:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:02.749 17:12:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:02.749 17:12:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:02.749 17:12:59 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:02.749 17:12:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:02.749 17:12:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:02.749 17:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:02.749 17:12:59 -- nvmf/common.sh@469 -- # nvmfpid=1763725 00:20:02.749 17:12:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:20:02.749 17:12:59 -- nvmf/common.sh@470 -- # waitforlisten 1763725 00:20:02.749 17:12:59 -- common/autotest_common.sh@829 -- # '[' -z 1763725 ']' 00:20:02.749 17:12:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:02.749 17:12:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:02.749 17:12:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:02.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:02.749 17:12:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:02.749 17:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:03.007 [2024-11-27 17:12:59.716335] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:03.007 [2024-11-27 17:12:59.716430] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:03.007 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.007 [2024-11-27 17:12:59.795171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:03.007 [2024-11-27 17:12:59.895193] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:03.007 [2024-11-27 17:12:59.895369] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:03.007 [2024-11-27 17:12:59.895391] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:03.007 [2024-11-27 17:12:59.895406] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:03.007 [2024-11-27 17:12:59.895656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:03.007 [2024-11-27 17:12:59.895712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:03.007 [2024-11-27 17:12:59.895763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:03.007 [2024-11-27 17:12:59.895766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:03.941 17:13:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:03.941 17:13:00 -- common/autotest_common.sh@862 -- # return 0 00:20:03.941 17:13:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:03.941 17:13:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 17:13:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:03.941 17:13:00 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:03.941 17:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 [2024-11-27 17:13:00.766237] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:03.941 17:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:03.941 17:13:00 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:03.941 17:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 Malloc0 00:20:03.941 17:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:03.941 17:13:00 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:03.941 17:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 17:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:03.941 17:13:00 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:03.941 17:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 17:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:03.941 17:13:00 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:03.941 17:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:03.941 17:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:03.941 [2024-11-27 17:13:00.819580] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:03.941 17:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:03.941 17:13:00 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:03.941 17:13:00 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:03.941 17:13:00 -- nvmf/common.sh@520 -- # config=() 00:20:03.941 17:13:00 -- nvmf/common.sh@520 -- # local subsystem config 00:20:03.941 17:13:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:03.941 17:13:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:03.941 { 00:20:03.941 "params": { 00:20:03.941 "name": "Nvme$subsystem", 00:20:03.941 "trtype": "$TEST_TRANSPORT", 00:20:03.941 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:03.941 "adrfam": "ipv4", 00:20:03.941 "trsvcid": "$NVMF_PORT", 00:20:03.941 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:03.941 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:03.941 "hdgst": ${hdgst:-false}, 00:20:03.941 "ddgst": ${ddgst:-false} 00:20:03.941 }, 00:20:03.941 "method": "bdev_nvme_attach_controller" 00:20:03.941 } 00:20:03.941 EOF 00:20:03.941 )") 00:20:03.941 17:13:00 -- nvmf/common.sh@542 -- # cat 00:20:03.941 17:13:00 -- nvmf/common.sh@544 -- # jq . 00:20:03.941 17:13:00 -- nvmf/common.sh@545 -- # IFS=, 00:20:03.941 17:13:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:03.941 "params": { 00:20:03.941 "name": "Nvme1", 00:20:03.941 "trtype": "tcp", 00:20:03.941 "traddr": "10.0.0.2", 00:20:03.941 "adrfam": "ipv4", 00:20:03.941 "trsvcid": "4420", 00:20:03.941 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:03.941 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:03.941 "hdgst": false, 00:20:03.941 "ddgst": false 00:20:03.941 }, 00:20:03.941 "method": "bdev_nvme_attach_controller" 00:20:03.941 }' 00:20:03.941 [2024-11-27 17:13:00.863039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:03.941 [2024-11-27 17:13:00.863102] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1763888 ] 00:20:03.941 EAL: No free 2048 kB hugepages reported on node 1 00:20:04.222 [2024-11-27 17:13:00.923204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:04.222 [2024-11-27 17:13:01.013836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:04.222 [2024-11-27 17:13:01.013892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:04.222 [2024-11-27 17:13:01.013895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:04.490 [2024-11-27 17:13:01.302521] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:04.490 [2024-11-27 17:13:01.302593] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:04.490 I/O targets: 00:20:04.490 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:04.490 00:20:04.490 00:20:04.490 CUnit - A unit testing framework for C - Version 2.1-3 00:20:04.490 http://cunit.sourceforge.net/ 00:20:04.490 00:20:04.490 00:20:04.490 Suite: bdevio tests on: Nvme1n1 00:20:04.491 Test: blockdev write read block ...passed 00:20:04.491 Test: blockdev write zeroes read block ...passed 00:20:04.491 Test: blockdev write zeroes read no split ...passed 00:20:04.748 Test: blockdev write zeroes read split ...passed 00:20:04.748 Test: blockdev write zeroes read split partial ...passed 00:20:04.748 Test: blockdev reset ...[2024-11-27 17:13:01.497380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:04.748 [2024-11-27 17:13:01.497493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x760e40 (9): Bad file descriptor 00:20:04.748 [2024-11-27 17:13:01.511595] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:04.748 passed 00:20:04.748 Test: blockdev write read 8 blocks ...passed 00:20:04.748 Test: blockdev write read size > 128k ...passed 00:20:04.748 Test: blockdev write read invalid size ...passed 00:20:04.748 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:04.748 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:04.748 Test: blockdev write read max offset ...passed 00:20:04.748 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:04.748 Test: blockdev writev readv 8 blocks ...passed 00:20:04.748 Test: blockdev writev readv 30 x 1block ...passed 00:20:04.748 Test: blockdev writev readv block ...passed 00:20:04.748 Test: blockdev writev readv size > 128k ...passed 00:20:04.748 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:04.748 Test: blockdev comparev and writev ...[2024-11-27 17:13:01.685797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.685833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.685857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.685874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.686193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.686218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.686240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.686256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.686578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.686603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.686625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.686641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.686959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.686983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:04.748 [2024-11-27 17:13:01.687004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:04.748 [2024-11-27 17:13:01.687020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:05.005 passed 00:20:05.005 Test: blockdev nvme passthru rw ...passed 00:20:05.005 Test: blockdev nvme passthru vendor specific ...[2024-11-27 17:13:01.769778] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:05.005 [2024-11-27 17:13:01.769804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:05.005 [2024-11-27 17:13:01.769966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:05.005 [2024-11-27 17:13:01.769989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:05.005 [2024-11-27 17:13:01.770149] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:05.005 [2024-11-27 17:13:01.770172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:05.005 [2024-11-27 17:13:01.770325] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:05.005 [2024-11-27 17:13:01.770348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:05.005 passed 00:20:05.005 Test: blockdev nvme admin passthru ...passed 00:20:05.005 Test: blockdev copy ...passed 00:20:05.005 00:20:05.005 Run Summary: Type Total Ran Passed Failed Inactive 00:20:05.005 suites 1 1 n/a 0 0 00:20:05.005 tests 23 23 23 0 0 00:20:05.005 asserts 152 152 152 0 n/a 00:20:05.005 00:20:05.005 Elapsed time = 1.054 seconds 00:20:05.263 17:13:02 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:05.263 17:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:05.263 17:13:02 -- common/autotest_common.sh@10 -- # set +x 00:20:05.263 17:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:05.263 17:13:02 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:05.263 17:13:02 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:05.263 17:13:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:05.263 17:13:02 -- nvmf/common.sh@116 -- # sync 00:20:05.263 17:13:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:05.263 17:13:02 -- nvmf/common.sh@119 -- # set +e 00:20:05.263 17:13:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:05.263 17:13:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:05.263 rmmod nvme_tcp 00:20:05.263 rmmod nvme_fabrics 00:20:05.263 rmmod nvme_keyring 00:20:05.263 17:13:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:05.263 17:13:02 -- nvmf/common.sh@123 -- # set -e 00:20:05.263 17:13:02 -- nvmf/common.sh@124 -- # return 0 00:20:05.263 17:13:02 -- nvmf/common.sh@477 -- # '[' -n 1763725 ']' 00:20:05.263 17:13:02 -- nvmf/common.sh@478 -- # killprocess 1763725 00:20:05.263 17:13:02 -- common/autotest_common.sh@936 -- # '[' -z 1763725 ']' 00:20:05.263 17:13:02 -- common/autotest_common.sh@940 -- # kill -0 1763725 00:20:05.263 17:13:02 -- common/autotest_common.sh@941 -- # uname 00:20:05.263 17:13:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:05.263 17:13:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1763725 00:20:05.263 17:13:02 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:05.263 17:13:02 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:05.263 17:13:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1763725' 00:20:05.263 killing process with pid 1763725 00:20:05.263 17:13:02 -- common/autotest_common.sh@955 -- # kill 1763725 00:20:05.263 17:13:02 -- common/autotest_common.sh@960 -- # wait 1763725 00:20:05.522 17:13:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:05.522 17:13:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:05.522 17:13:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:05.522 17:13:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:05.522 17:13:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:05.522 17:13:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:05.522 17:13:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:05.522 17:13:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:08.058 17:13:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:08.058 00:20:08.058 real 0m7.080s 00:20:08.058 user 0m13.024s 00:20:08.058 sys 0m2.165s 00:20:08.058 17:13:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:08.058 17:13:04 -- common/autotest_common.sh@10 -- # set +x 00:20:08.058 ************************************ 00:20:08.058 END TEST nvmf_bdevio 00:20:08.058 ************************************ 00:20:08.058 17:13:04 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:08.058 17:13:04 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:08.058 17:13:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:20:08.058 17:13:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:08.058 17:13:04 -- common/autotest_common.sh@10 -- # set +x 00:20:08.058 ************************************ 00:20:08.058 START TEST nvmf_bdevio_no_huge 00:20:08.058 ************************************ 00:20:08.058 17:13:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:08.058 * Looking for test storage... 00:20:08.058 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:08.058 17:13:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:08.058 17:13:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:08.058 17:13:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:08.058 17:13:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:08.058 17:13:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:08.059 17:13:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:08.059 17:13:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:08.059 17:13:04 -- scripts/common.sh@335 -- # IFS=.-: 00:20:08.059 17:13:04 -- scripts/common.sh@335 -- # read -ra ver1 00:20:08.059 17:13:04 -- scripts/common.sh@336 -- # IFS=.-: 00:20:08.059 17:13:04 -- scripts/common.sh@336 -- # read -ra ver2 00:20:08.059 17:13:04 -- scripts/common.sh@337 -- # local 'op=<' 00:20:08.059 17:13:04 -- scripts/common.sh@339 -- # ver1_l=2 00:20:08.059 17:13:04 -- scripts/common.sh@340 -- # ver2_l=1 00:20:08.059 17:13:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:08.059 17:13:04 -- scripts/common.sh@343 -- # case "$op" in 00:20:08.059 17:13:04 -- scripts/common.sh@344 -- # : 1 00:20:08.059 17:13:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:08.059 17:13:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:08.059 17:13:04 -- scripts/common.sh@364 -- # decimal 1 00:20:08.059 17:13:04 -- scripts/common.sh@352 -- # local d=1 00:20:08.059 17:13:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:08.059 17:13:04 -- scripts/common.sh@354 -- # echo 1 00:20:08.059 17:13:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:08.059 17:13:04 -- scripts/common.sh@365 -- # decimal 2 00:20:08.059 17:13:04 -- scripts/common.sh@352 -- # local d=2 00:20:08.059 17:13:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:08.059 17:13:04 -- scripts/common.sh@354 -- # echo 2 00:20:08.059 17:13:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:08.059 17:13:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:08.059 17:13:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:08.059 17:13:04 -- scripts/common.sh@367 -- # return 0 00:20:08.059 17:13:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:08.059 17:13:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:08.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:08.059 --rc genhtml_branch_coverage=1 00:20:08.059 --rc genhtml_function_coverage=1 00:20:08.059 --rc genhtml_legend=1 00:20:08.059 --rc geninfo_all_blocks=1 00:20:08.059 --rc geninfo_unexecuted_blocks=1 00:20:08.059 00:20:08.059 ' 00:20:08.059 17:13:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:08.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:08.059 --rc genhtml_branch_coverage=1 00:20:08.059 --rc genhtml_function_coverage=1 00:20:08.059 --rc genhtml_legend=1 00:20:08.059 --rc geninfo_all_blocks=1 00:20:08.059 --rc geninfo_unexecuted_blocks=1 00:20:08.059 00:20:08.059 ' 00:20:08.059 17:13:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:08.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:08.059 --rc genhtml_branch_coverage=1 00:20:08.059 --rc genhtml_function_coverage=1 00:20:08.059 --rc genhtml_legend=1 00:20:08.059 --rc geninfo_all_blocks=1 00:20:08.059 --rc geninfo_unexecuted_blocks=1 00:20:08.059 00:20:08.059 ' 00:20:08.059 17:13:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:08.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:08.059 --rc genhtml_branch_coverage=1 00:20:08.059 --rc genhtml_function_coverage=1 00:20:08.059 --rc genhtml_legend=1 00:20:08.059 --rc geninfo_all_blocks=1 00:20:08.059 --rc geninfo_unexecuted_blocks=1 00:20:08.059 00:20:08.059 ' 00:20:08.059 17:13:04 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:08.059 17:13:04 -- nvmf/common.sh@7 -- # uname -s 00:20:08.059 17:13:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:08.059 17:13:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:08.059 17:13:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:08.059 17:13:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:08.059 17:13:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:08.059 17:13:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:08.059 17:13:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:08.059 17:13:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:08.059 17:13:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:08.059 17:13:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:08.059 17:13:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:08.059 17:13:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:08.059 17:13:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:08.059 17:13:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:08.059 17:13:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:08.059 17:13:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:08.059 17:13:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:08.059 17:13:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:08.059 17:13:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:08.059 17:13:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:08.059 17:13:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:08.059 17:13:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:08.059 17:13:04 -- paths/export.sh@5 -- # export PATH 00:20:08.059 17:13:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:08.059 17:13:04 -- nvmf/common.sh@46 -- # : 0 00:20:08.059 17:13:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:08.059 17:13:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:08.059 17:13:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:08.059 17:13:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:08.059 17:13:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:08.059 17:13:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:08.059 17:13:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:08.059 17:13:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:08.059 17:13:04 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:08.059 17:13:04 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:08.059 17:13:04 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:08.059 17:13:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:08.059 17:13:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:08.059 17:13:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:08.059 17:13:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:08.059 17:13:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:08.059 17:13:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:08.059 17:13:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:08.059 17:13:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:08.059 17:13:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:08.059 17:13:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:08.059 17:13:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:08.059 17:13:04 -- common/autotest_common.sh@10 -- # set +x 00:20:09.962 17:13:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:09.962 17:13:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:09.962 17:13:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:09.962 17:13:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:09.962 17:13:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:09.962 17:13:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:09.962 17:13:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:09.962 17:13:06 -- nvmf/common.sh@294 -- # net_devs=() 00:20:09.962 17:13:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:09.962 17:13:06 -- nvmf/common.sh@295 -- # e810=() 00:20:09.962 17:13:06 -- nvmf/common.sh@295 -- # local -ga e810 00:20:09.962 17:13:06 -- nvmf/common.sh@296 -- # x722=() 00:20:09.962 17:13:06 -- nvmf/common.sh@296 -- # local -ga x722 00:20:09.962 17:13:06 -- nvmf/common.sh@297 -- # mlx=() 00:20:09.962 17:13:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:09.962 17:13:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:09.962 17:13:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:09.962 17:13:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:09.962 17:13:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:09.962 17:13:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:09.962 17:13:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:09.962 17:13:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:09.962 17:13:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:09.962 17:13:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:09.963 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:09.963 17:13:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:09.963 17:13:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:09.963 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:09.963 17:13:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:09.963 17:13:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:09.963 17:13:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:09.963 17:13:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:09.963 17:13:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:09.963 17:13:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:09.963 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:09.963 17:13:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:09.963 17:13:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:09.963 17:13:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:09.963 17:13:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:09.963 17:13:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:09.963 17:13:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:09.963 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:09.963 17:13:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:09.963 17:13:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:09.963 17:13:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:09.963 17:13:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:09.963 17:13:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:09.963 17:13:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:09.963 17:13:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:09.963 17:13:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:09.963 17:13:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:09.963 17:13:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:09.963 17:13:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:09.963 17:13:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:09.963 17:13:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:09.963 17:13:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:09.963 17:13:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:09.963 17:13:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:09.963 17:13:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:09.963 17:13:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:09.963 17:13:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:09.963 17:13:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:09.963 17:13:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:09.963 17:13:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:09.963 17:13:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:09.963 17:13:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:09.963 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:09.963 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:20:09.963 00:20:09.963 --- 10.0.0.2 ping statistics --- 00:20:09.963 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:09.963 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:20:09.963 17:13:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:09.963 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:09.963 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:20:09.963 00:20:09.963 --- 10.0.0.1 ping statistics --- 00:20:09.963 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:09.963 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:20:09.963 17:13:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:09.963 17:13:06 -- nvmf/common.sh@410 -- # return 0 00:20:09.963 17:13:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:09.963 17:13:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:09.963 17:13:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:09.963 17:13:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:09.963 17:13:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:09.963 17:13:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:09.963 17:13:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:09.963 17:13:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:09.963 17:13:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:09.963 17:13:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.963 17:13:06 -- nvmf/common.sh@469 -- # nvmfpid=1765976 00:20:09.963 17:13:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:09.963 17:13:06 -- nvmf/common.sh@470 -- # waitforlisten 1765976 00:20:09.963 17:13:06 -- common/autotest_common.sh@829 -- # '[' -z 1765976 ']' 00:20:09.963 17:13:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:09.963 17:13:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:09.963 17:13:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:09.963 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:09.963 17:13:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:09.963 17:13:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.963 [2024-11-27 17:13:06.669747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:09.963 [2024-11-27 17:13:06.669834] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:09.963 [2024-11-27 17:13:06.739404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:09.963 [2024-11-27 17:13:06.821593] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:09.963 [2024-11-27 17:13:06.821771] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:09.963 [2024-11-27 17:13:06.821790] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:09.963 [2024-11-27 17:13:06.821802] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:09.963 [2024-11-27 17:13:06.821902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:09.963 [2024-11-27 17:13:06.821967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:09.963 [2024-11-27 17:13:06.822034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:09.963 [2024-11-27 17:13:06.822037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:10.898 17:13:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:10.898 17:13:07 -- common/autotest_common.sh@862 -- # return 0 00:20:10.898 17:13:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:10.898 17:13:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 17:13:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:10.898 17:13:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:10.898 17:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 [2024-11-27 17:13:07.728051] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:10.898 17:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.898 17:13:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:10.898 17:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 Malloc0 00:20:10.898 17:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.898 17:13:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:10.898 17:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 17:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.898 17:13:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:10.898 17:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 17:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.898 17:13:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:10.898 17:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.898 17:13:07 -- common/autotest_common.sh@10 -- # set +x 00:20:10.898 [2024-11-27 17:13:07.766180] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:10.898 17:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.898 17:13:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:10.898 17:13:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:10.898 17:13:07 -- nvmf/common.sh@520 -- # config=() 00:20:10.898 17:13:07 -- nvmf/common.sh@520 -- # local subsystem config 00:20:10.898 17:13:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:10.898 17:13:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:10.898 { 00:20:10.898 "params": { 00:20:10.898 "name": "Nvme$subsystem", 00:20:10.898 "trtype": "$TEST_TRANSPORT", 00:20:10.898 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:10.898 "adrfam": "ipv4", 00:20:10.898 "trsvcid": "$NVMF_PORT", 00:20:10.898 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:10.898 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:10.898 "hdgst": ${hdgst:-false}, 00:20:10.898 "ddgst": ${ddgst:-false} 00:20:10.898 }, 00:20:10.898 "method": "bdev_nvme_attach_controller" 00:20:10.898 } 00:20:10.898 EOF 00:20:10.898 )") 00:20:10.898 17:13:07 -- nvmf/common.sh@542 -- # cat 00:20:10.898 17:13:07 -- nvmf/common.sh@544 -- # jq . 00:20:10.898 17:13:07 -- nvmf/common.sh@545 -- # IFS=, 00:20:10.898 17:13:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:10.898 "params": { 00:20:10.898 "name": "Nvme1", 00:20:10.898 "trtype": "tcp", 00:20:10.898 "traddr": "10.0.0.2", 00:20:10.898 "adrfam": "ipv4", 00:20:10.898 "trsvcid": "4420", 00:20:10.898 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:10.898 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:10.898 "hdgst": false, 00:20:10.898 "ddgst": false 00:20:10.898 }, 00:20:10.898 "method": "bdev_nvme_attach_controller" 00:20:10.898 }' 00:20:10.898 [2024-11-27 17:13:07.811287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:10.898 [2024-11-27 17:13:07.811360] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1766139 ] 00:20:11.157 [2024-11-27 17:13:07.875658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:11.157 [2024-11-27 17:13:07.963849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:11.157 [2024-11-27 17:13:07.963903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:11.157 [2024-11-27 17:13:07.963907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:11.415 [2024-11-27 17:13:08.160333] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:11.415 [2024-11-27 17:13:08.160382] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:11.415 I/O targets: 00:20:11.415 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:11.415 00:20:11.415 00:20:11.415 CUnit - A unit testing framework for C - Version 2.1-3 00:20:11.415 http://cunit.sourceforge.net/ 00:20:11.415 00:20:11.415 00:20:11.415 Suite: bdevio tests on: Nvme1n1 00:20:11.415 Test: blockdev write read block ...passed 00:20:11.415 Test: blockdev write zeroes read block ...passed 00:20:11.415 Test: blockdev write zeroes read no split ...passed 00:20:11.415 Test: blockdev write zeroes read split ...passed 00:20:11.415 Test: blockdev write zeroes read split partial ...passed 00:20:11.415 Test: blockdev reset ...[2024-11-27 17:13:08.282365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:11.415 [2024-11-27 17:13:08.282468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15567c0 (9): Bad file descriptor 00:20:11.415 [2024-11-27 17:13:08.300184] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:11.415 passed 00:20:11.415 Test: blockdev write read 8 blocks ...passed 00:20:11.415 Test: blockdev write read size > 128k ...passed 00:20:11.415 Test: blockdev write read invalid size ...passed 00:20:11.673 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:11.673 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:11.673 Test: blockdev write read max offset ...passed 00:20:11.673 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:11.673 Test: blockdev writev readv 8 blocks ...passed 00:20:11.673 Test: blockdev writev readv 30 x 1block ...passed 00:20:11.673 Test: blockdev writev readv block ...passed 00:20:11.673 Test: blockdev writev readv size > 128k ...passed 00:20:11.673 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:11.673 Test: blockdev comparev and writev ...[2024-11-27 17:13:08.554689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.554726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.554751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.554768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:11.673 [2024-11-27 17:13:08.555884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:11.673 [2024-11-27 17:13:08.555899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:11.673 passed 00:20:11.932 Test: blockdev nvme passthru rw ...passed 00:20:11.932 Test: blockdev nvme passthru vendor specific ...[2024-11-27 17:13:08.639773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:11.932 [2024-11-27 17:13:08.639800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:11.932 [2024-11-27 17:13:08.639949] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:11.932 [2024-11-27 17:13:08.639972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:11.932 [2024-11-27 17:13:08.640125] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:11.932 [2024-11-27 17:13:08.640147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:11.932 [2024-11-27 17:13:08.640294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:11.932 [2024-11-27 17:13:08.640317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:11.932 passed 00:20:11.932 Test: blockdev nvme admin passthru ...passed 00:20:11.932 Test: blockdev copy ...passed 00:20:11.932 00:20:11.932 Run Summary: Type Total Ran Passed Failed Inactive 00:20:11.932 suites 1 1 n/a 0 0 00:20:11.932 tests 23 23 23 0 0 00:20:11.932 asserts 152 152 152 0 n/a 00:20:11.932 00:20:11.932 Elapsed time = 1.065 seconds 00:20:12.192 17:13:09 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:12.192 17:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:12.192 17:13:09 -- common/autotest_common.sh@10 -- # set +x 00:20:12.192 17:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:12.192 17:13:09 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:12.192 17:13:09 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:12.192 17:13:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:12.192 17:13:09 -- nvmf/common.sh@116 -- # sync 00:20:12.192 17:13:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:12.192 17:13:09 -- nvmf/common.sh@119 -- # set +e 00:20:12.192 17:13:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:12.192 17:13:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:12.192 rmmod nvme_tcp 00:20:12.192 rmmod nvme_fabrics 00:20:12.192 rmmod nvme_keyring 00:20:12.192 17:13:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:12.192 17:13:09 -- nvmf/common.sh@123 -- # set -e 00:20:12.192 17:13:09 -- nvmf/common.sh@124 -- # return 0 00:20:12.192 17:13:09 -- nvmf/common.sh@477 -- # '[' -n 1765976 ']' 00:20:12.192 17:13:09 -- nvmf/common.sh@478 -- # killprocess 1765976 00:20:12.192 17:13:09 -- common/autotest_common.sh@936 -- # '[' -z 1765976 ']' 00:20:12.192 17:13:09 -- common/autotest_common.sh@940 -- # kill -0 1765976 00:20:12.192 17:13:09 -- common/autotest_common.sh@941 -- # uname 00:20:12.192 17:13:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:12.192 17:13:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1765976 00:20:12.192 17:13:09 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:12.193 17:13:09 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:12.193 17:13:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1765976' 00:20:12.193 killing process with pid 1765976 00:20:12.193 17:13:09 -- common/autotest_common.sh@955 -- # kill 1765976 00:20:12.193 17:13:09 -- common/autotest_common.sh@960 -- # wait 1765976 00:20:12.777 17:13:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:12.777 17:13:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:12.777 17:13:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:12.777 17:13:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:12.777 17:13:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:12.777 17:13:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:12.777 17:13:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:12.777 17:13:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:14.684 17:13:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:14.684 00:20:14.684 real 0m7.146s 00:20:14.684 user 0m13.419s 00:20:14.684 sys 0m2.538s 00:20:14.684 17:13:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:14.684 17:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:14.684 ************************************ 00:20:14.684 END TEST nvmf_bdevio_no_huge 00:20:14.684 ************************************ 00:20:14.684 17:13:11 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:14.684 17:13:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:14.684 17:13:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:14.684 17:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:14.684 ************************************ 00:20:14.684 START TEST nvmf_tls 00:20:14.684 ************************************ 00:20:14.684 17:13:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:14.684 * Looking for test storage... 00:20:14.944 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:14.944 17:13:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:14.944 17:13:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:14.944 17:13:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:14.944 17:13:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:14.944 17:13:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:14.944 17:13:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:14.944 17:13:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:14.944 17:13:11 -- scripts/common.sh@335 -- # IFS=.-: 00:20:14.944 17:13:11 -- scripts/common.sh@335 -- # read -ra ver1 00:20:14.944 17:13:11 -- scripts/common.sh@336 -- # IFS=.-: 00:20:14.944 17:13:11 -- scripts/common.sh@336 -- # read -ra ver2 00:20:14.944 17:13:11 -- scripts/common.sh@337 -- # local 'op=<' 00:20:14.944 17:13:11 -- scripts/common.sh@339 -- # ver1_l=2 00:20:14.944 17:13:11 -- scripts/common.sh@340 -- # ver2_l=1 00:20:14.944 17:13:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:14.944 17:13:11 -- scripts/common.sh@343 -- # case "$op" in 00:20:14.944 17:13:11 -- scripts/common.sh@344 -- # : 1 00:20:14.944 17:13:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:14.944 17:13:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:14.944 17:13:11 -- scripts/common.sh@364 -- # decimal 1 00:20:14.944 17:13:11 -- scripts/common.sh@352 -- # local d=1 00:20:14.944 17:13:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:14.944 17:13:11 -- scripts/common.sh@354 -- # echo 1 00:20:14.944 17:13:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:14.944 17:13:11 -- scripts/common.sh@365 -- # decimal 2 00:20:14.944 17:13:11 -- scripts/common.sh@352 -- # local d=2 00:20:14.944 17:13:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:14.944 17:13:11 -- scripts/common.sh@354 -- # echo 2 00:20:14.944 17:13:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:14.944 17:13:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:14.944 17:13:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:14.944 17:13:11 -- scripts/common.sh@367 -- # return 0 00:20:14.944 17:13:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:14.944 17:13:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:14.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:14.944 --rc genhtml_branch_coverage=1 00:20:14.944 --rc genhtml_function_coverage=1 00:20:14.944 --rc genhtml_legend=1 00:20:14.944 --rc geninfo_all_blocks=1 00:20:14.944 --rc geninfo_unexecuted_blocks=1 00:20:14.944 00:20:14.944 ' 00:20:14.944 17:13:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:14.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:14.944 --rc genhtml_branch_coverage=1 00:20:14.944 --rc genhtml_function_coverage=1 00:20:14.944 --rc genhtml_legend=1 00:20:14.944 --rc geninfo_all_blocks=1 00:20:14.944 --rc geninfo_unexecuted_blocks=1 00:20:14.944 00:20:14.944 ' 00:20:14.944 17:13:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:14.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:14.944 --rc genhtml_branch_coverage=1 00:20:14.944 --rc genhtml_function_coverage=1 00:20:14.944 --rc genhtml_legend=1 00:20:14.944 --rc geninfo_all_blocks=1 00:20:14.944 --rc geninfo_unexecuted_blocks=1 00:20:14.944 00:20:14.944 ' 00:20:14.944 17:13:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:14.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:14.944 --rc genhtml_branch_coverage=1 00:20:14.944 --rc genhtml_function_coverage=1 00:20:14.944 --rc genhtml_legend=1 00:20:14.944 --rc geninfo_all_blocks=1 00:20:14.944 --rc geninfo_unexecuted_blocks=1 00:20:14.944 00:20:14.944 ' 00:20:14.944 17:13:11 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:14.944 17:13:11 -- nvmf/common.sh@7 -- # uname -s 00:20:14.944 17:13:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:14.944 17:13:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:14.944 17:13:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:14.944 17:13:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:14.944 17:13:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:14.944 17:13:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:14.944 17:13:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:14.944 17:13:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:14.944 17:13:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:14.944 17:13:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:14.944 17:13:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:14.944 17:13:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:14.944 17:13:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:14.944 17:13:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:14.944 17:13:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:14.944 17:13:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:14.944 17:13:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:14.944 17:13:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:14.944 17:13:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:14.945 17:13:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.945 17:13:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.945 17:13:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.945 17:13:11 -- paths/export.sh@5 -- # export PATH 00:20:14.945 17:13:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.945 17:13:11 -- nvmf/common.sh@46 -- # : 0 00:20:14.945 17:13:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:14.945 17:13:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:14.945 17:13:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:14.945 17:13:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:14.945 17:13:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:14.945 17:13:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:14.945 17:13:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:14.945 17:13:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:14.945 17:13:11 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:14.945 17:13:11 -- target/tls.sh@71 -- # nvmftestinit 00:20:14.945 17:13:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:14.945 17:13:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:14.945 17:13:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:14.945 17:13:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:14.945 17:13:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:14.945 17:13:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:14.945 17:13:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:14.945 17:13:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:14.945 17:13:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:14.945 17:13:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:14.945 17:13:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:14.945 17:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:17.477 17:13:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:17.477 17:13:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:17.477 17:13:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:17.477 17:13:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:17.477 17:13:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:17.477 17:13:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:17.477 17:13:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:17.477 17:13:13 -- nvmf/common.sh@294 -- # net_devs=() 00:20:17.477 17:13:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:17.477 17:13:13 -- nvmf/common.sh@295 -- # e810=() 00:20:17.477 17:13:13 -- nvmf/common.sh@295 -- # local -ga e810 00:20:17.477 17:13:13 -- nvmf/common.sh@296 -- # x722=() 00:20:17.477 17:13:13 -- nvmf/common.sh@296 -- # local -ga x722 00:20:17.477 17:13:13 -- nvmf/common.sh@297 -- # mlx=() 00:20:17.477 17:13:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:17.477 17:13:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:17.477 17:13:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:17.477 17:13:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:17.477 17:13:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:17.477 17:13:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:17.477 17:13:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:17.477 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:17.477 17:13:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:17.477 17:13:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:17.477 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:17.477 17:13:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:17.477 17:13:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:17.477 17:13:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:17.477 17:13:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:17.477 17:13:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:17.477 17:13:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:17.477 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:17.477 17:13:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:17.477 17:13:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:17.477 17:13:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:17.477 17:13:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:17.477 17:13:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:17.477 17:13:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:17.477 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:17.477 17:13:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:17.477 17:13:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:17.477 17:13:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:17.477 17:13:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:17.477 17:13:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:17.477 17:13:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:17.477 17:13:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:17.477 17:13:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:17.478 17:13:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:17.478 17:13:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:17.478 17:13:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:17.478 17:13:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:17.478 17:13:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:17.478 17:13:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:17.478 17:13:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:17.478 17:13:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:17.478 17:13:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:17.478 17:13:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:17.478 17:13:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:17.478 17:13:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:17.478 17:13:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:17.478 17:13:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:17.478 17:13:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:17.478 17:13:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:17.478 17:13:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:17.478 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:17.478 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.386 ms 00:20:17.478 00:20:17.478 --- 10.0.0.2 ping statistics --- 00:20:17.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:17.478 rtt min/avg/max/mdev = 0.386/0.386/0.386/0.000 ms 00:20:17.478 17:13:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:17.478 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:17.478 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:20:17.478 00:20:17.478 --- 10.0.0.1 ping statistics --- 00:20:17.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:17.478 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:20:17.478 17:13:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:17.478 17:13:14 -- nvmf/common.sh@410 -- # return 0 00:20:17.478 17:13:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:17.478 17:13:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:17.478 17:13:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:17.478 17:13:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:17.478 17:13:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:17.478 17:13:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:17.478 17:13:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:17.478 17:13:14 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:17.478 17:13:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:17.478 17:13:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:17.478 17:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:17.478 17:13:14 -- nvmf/common.sh@469 -- # nvmfpid=1768356 00:20:17.478 17:13:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:17.478 17:13:14 -- nvmf/common.sh@470 -- # waitforlisten 1768356 00:20:17.478 17:13:14 -- common/autotest_common.sh@829 -- # '[' -z 1768356 ']' 00:20:17.478 17:13:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:17.478 17:13:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:17.478 17:13:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:17.478 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:17.478 17:13:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:17.478 17:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:17.478 [2024-11-27 17:13:14.158910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:17.478 [2024-11-27 17:13:14.159001] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:17.478 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.478 [2024-11-27 17:13:14.228334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.478 [2024-11-27 17:13:14.315842] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:17.478 [2024-11-27 17:13:14.316010] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:17.478 [2024-11-27 17:13:14.316026] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:17.478 [2024-11-27 17:13:14.316039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:17.478 [2024-11-27 17:13:14.316077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:17.478 17:13:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:17.478 17:13:14 -- common/autotest_common.sh@862 -- # return 0 00:20:17.478 17:13:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:17.478 17:13:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:17.478 17:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:17.478 17:13:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:17.478 17:13:14 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:17.478 17:13:14 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:17.736 true 00:20:17.736 17:13:14 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:17.736 17:13:14 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:17.994 17:13:14 -- target/tls.sh@82 -- # version=0 00:20:17.994 17:13:14 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:17.994 17:13:14 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:18.252 17:13:15 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:18.252 17:13:15 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:18.528 17:13:15 -- target/tls.sh@90 -- # version=13 00:20:18.528 17:13:15 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:18.528 17:13:15 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:18.785 17:13:15 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:18.786 17:13:15 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:19.043 17:13:15 -- target/tls.sh@98 -- # version=7 00:20:19.043 17:13:15 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:19.043 17:13:15 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:19.043 17:13:15 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:19.301 17:13:16 -- target/tls.sh@105 -- # ktls=false 00:20:19.302 17:13:16 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:19.302 17:13:16 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:19.867 17:13:16 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:19.867 17:13:16 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:19.868 17:13:16 -- target/tls.sh@113 -- # ktls=true 00:20:19.868 17:13:16 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:19.868 17:13:16 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:20.125 17:13:17 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:20.125 17:13:17 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:20.383 17:13:17 -- target/tls.sh@121 -- # ktls=false 00:20:20.383 17:13:17 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:20.383 17:13:17 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:20.383 17:13:17 -- target/tls.sh@49 -- # local key hash crc 00:20:20.383 17:13:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:20.383 17:13:17 -- target/tls.sh@51 -- # hash=01 00:20:20.383 17:13:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # tail -c8 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # gzip -1 -c 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # head -c 4 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # crc='p$H�' 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:20.641 17:13:17 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:20.641 17:13:17 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:20.641 17:13:17 -- target/tls.sh@49 -- # local key hash crc 00:20:20.641 17:13:17 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:20.641 17:13:17 -- target/tls.sh@51 -- # hash=01 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # gzip -1 -c 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # tail -c8 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # head -c 4 00:20:20.641 17:13:17 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:20.641 17:13:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:20.641 17:13:17 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:20.641 17:13:17 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:20.641 17:13:17 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:20.641 17:13:17 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:20.641 17:13:17 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:20.641 17:13:17 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:20.641 17:13:17 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:20.641 17:13:17 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:20.900 17:13:17 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:21.158 17:13:17 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:21.158 17:13:17 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:21.158 17:13:17 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:21.416 [2024-11-27 17:13:18.189712] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:21.416 17:13:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:21.674 17:13:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:21.932 [2024-11-27 17:13:18.691051] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:21.932 [2024-11-27 17:13:18.691291] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:21.933 17:13:18 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:22.190 malloc0 00:20:22.190 17:13:18 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:22.447 17:13:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.705 17:13:19 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.705 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.678 Initializing NVMe Controllers 00:20:32.678 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:32.678 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:32.678 Initialization complete. Launching workers. 00:20:32.678 ======================================================== 00:20:32.678 Latency(us) 00:20:32.678 Device Information : IOPS MiB/s Average min max 00:20:32.678 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7824.95 30.57 8181.56 1092.23 9363.00 00:20:32.678 ======================================================== 00:20:32.678 Total : 7824.95 30.57 8181.56 1092.23 9363.00 00:20:32.678 00:20:32.678 17:13:29 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:32.678 17:13:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:32.678 17:13:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:32.678 17:13:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:32.678 17:13:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:32.678 17:13:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:32.678 17:13:29 -- target/tls.sh@28 -- # bdevperf_pid=1770325 00:20:32.678 17:13:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:32.678 17:13:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:32.678 17:13:29 -- target/tls.sh@31 -- # waitforlisten 1770325 /var/tmp/bdevperf.sock 00:20:32.678 17:13:29 -- common/autotest_common.sh@829 -- # '[' -z 1770325 ']' 00:20:32.678 17:13:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:32.678 17:13:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:32.678 17:13:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:32.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:32.678 17:13:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:32.678 17:13:29 -- common/autotest_common.sh@10 -- # set +x 00:20:32.678 [2024-11-27 17:13:29.603491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:32.678 [2024-11-27 17:13:29.603597] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1770325 ] 00:20:32.936 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.936 [2024-11-27 17:13:29.661074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.936 [2024-11-27 17:13:29.742887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:32.936 17:13:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.936 17:13:29 -- common/autotest_common.sh@862 -- # return 0 00:20:32.936 17:13:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.194 [2024-11-27 17:13:30.100487] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:33.454 TLSTESTn1 00:20:33.454 17:13:30 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:33.454 Running I/O for 10 seconds... 00:20:43.421 00:20:43.421 Latency(us) 00:20:43.421 [2024-11-27T16:13:40.372Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:43.421 [2024-11-27T16:13:40.372Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:43.421 Verification LBA range: start 0x0 length 0x2000 00:20:43.421 TLSTESTn1 : 10.03 4059.64 15.86 0.00 0.00 31476.34 4538.97 81167.55 00:20:43.421 [2024-11-27T16:13:40.372Z] =================================================================================================================== 00:20:43.421 [2024-11-27T16:13:40.372Z] Total : 4059.64 15.86 0.00 0.00 31476.34 4538.97 81167.55 00:20:43.421 0 00:20:43.421 17:13:40 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:43.421 17:13:40 -- target/tls.sh@45 -- # killprocess 1770325 00:20:43.421 17:13:40 -- common/autotest_common.sh@936 -- # '[' -z 1770325 ']' 00:20:43.421 17:13:40 -- common/autotest_common.sh@940 -- # kill -0 1770325 00:20:43.421 17:13:40 -- common/autotest_common.sh@941 -- # uname 00:20:43.680 17:13:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:43.680 17:13:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1770325 00:20:43.680 17:13:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:43.680 17:13:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:43.680 17:13:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1770325' 00:20:43.680 killing process with pid 1770325 00:20:43.680 17:13:40 -- common/autotest_common.sh@955 -- # kill 1770325 00:20:43.680 Received shutdown signal, test time was about 10.000000 seconds 00:20:43.680 00:20:43.680 Latency(us) 00:20:43.680 [2024-11-27T16:13:40.631Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:43.680 [2024-11-27T16:13:40.631Z] =================================================================================================================== 00:20:43.680 [2024-11-27T16:13:40.631Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:43.680 17:13:40 -- common/autotest_common.sh@960 -- # wait 1770325 00:20:43.940 17:13:40 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:43.940 17:13:40 -- common/autotest_common.sh@650 -- # local es=0 00:20:43.940 17:13:40 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:43.940 17:13:40 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:43.940 17:13:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:43.940 17:13:40 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:43.940 17:13:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:43.940 17:13:40 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:43.940 17:13:40 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:43.940 17:13:40 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:43.940 17:13:40 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:43.940 17:13:40 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:43.940 17:13:40 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:43.940 17:13:40 -- target/tls.sh@28 -- # bdevperf_pid=1771566 00:20:43.940 17:13:40 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:43.940 17:13:40 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:43.940 17:13:40 -- target/tls.sh@31 -- # waitforlisten 1771566 /var/tmp/bdevperf.sock 00:20:43.940 17:13:40 -- common/autotest_common.sh@829 -- # '[' -z 1771566 ']' 00:20:43.940 17:13:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:43.940 17:13:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:43.940 17:13:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:43.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:43.940 17:13:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:43.940 17:13:40 -- common/autotest_common.sh@10 -- # set +x 00:20:43.940 [2024-11-27 17:13:40.686732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:43.940 [2024-11-27 17:13:40.686823] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1771566 ] 00:20:43.941 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.941 [2024-11-27 17:13:40.754822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.941 [2024-11-27 17:13:40.842397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:44.937 17:13:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:44.937 17:13:41 -- common/autotest_common.sh@862 -- # return 0 00:20:44.937 17:13:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:44.937 [2024-11-27 17:13:41.887600] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:45.195 [2024-11-27 17:13:41.896412] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:45.195 [2024-11-27 17:13:41.896715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c7840 (107): Transport endpoint is not connected 00:20:45.195 [2024-11-27 17:13:41.897705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c7840 (9): Bad file descriptor 00:20:45.195 [2024-11-27 17:13:41.898705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:45.195 [2024-11-27 17:13:41.898730] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:45.195 [2024-11-27 17:13:41.898745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:45.195 request: 00:20:45.195 { 00:20:45.195 "name": "TLSTEST", 00:20:45.195 "trtype": "tcp", 00:20:45.195 "traddr": "10.0.0.2", 00:20:45.195 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:45.195 "adrfam": "ipv4", 00:20:45.195 "trsvcid": "4420", 00:20:45.195 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:45.195 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:45.195 "method": "bdev_nvme_attach_controller", 00:20:45.195 "req_id": 1 00:20:45.195 } 00:20:45.195 Got JSON-RPC error response 00:20:45.195 response: 00:20:45.195 { 00:20:45.195 "code": -32602, 00:20:45.195 "message": "Invalid parameters" 00:20:45.195 } 00:20:45.195 17:13:41 -- target/tls.sh@36 -- # killprocess 1771566 00:20:45.195 17:13:41 -- common/autotest_common.sh@936 -- # '[' -z 1771566 ']' 00:20:45.195 17:13:41 -- common/autotest_common.sh@940 -- # kill -0 1771566 00:20:45.195 17:13:41 -- common/autotest_common.sh@941 -- # uname 00:20:45.195 17:13:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:45.195 17:13:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1771566 00:20:45.195 17:13:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:45.195 17:13:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:45.195 17:13:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1771566' 00:20:45.195 killing process with pid 1771566 00:20:45.195 17:13:41 -- common/autotest_common.sh@955 -- # kill 1771566 00:20:45.195 Received shutdown signal, test time was about 10.000000 seconds 00:20:45.195 00:20:45.195 Latency(us) 00:20:45.195 [2024-11-27T16:13:42.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:45.195 [2024-11-27T16:13:42.146Z] =================================================================================================================== 00:20:45.195 [2024-11-27T16:13:42.146Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:45.195 17:13:41 -- common/autotest_common.sh@960 -- # wait 1771566 00:20:45.454 17:13:42 -- target/tls.sh@37 -- # return 1 00:20:45.454 17:13:42 -- common/autotest_common.sh@653 -- # es=1 00:20:45.454 17:13:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:45.454 17:13:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:45.454 17:13:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:45.454 17:13:42 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:45.454 17:13:42 -- common/autotest_common.sh@650 -- # local es=0 00:20:45.454 17:13:42 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:45.454 17:13:42 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:45.454 17:13:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.454 17:13:42 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:45.454 17:13:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.454 17:13:42 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:45.454 17:13:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:45.454 17:13:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:45.454 17:13:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:45.454 17:13:42 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:45.454 17:13:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:45.454 17:13:42 -- target/tls.sh@28 -- # bdevperf_pid=1771834 00:20:45.454 17:13:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:45.454 17:13:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:45.454 17:13:42 -- target/tls.sh@31 -- # waitforlisten 1771834 /var/tmp/bdevperf.sock 00:20:45.454 17:13:42 -- common/autotest_common.sh@829 -- # '[' -z 1771834 ']' 00:20:45.454 17:13:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:45.454 17:13:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.454 17:13:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:45.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:45.454 17:13:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.454 17:13:42 -- common/autotest_common.sh@10 -- # set +x 00:20:45.454 [2024-11-27 17:13:42.213217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:45.454 [2024-11-27 17:13:42.213295] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1771834 ] 00:20:45.454 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.454 [2024-11-27 17:13:42.270405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:45.454 [2024-11-27 17:13:42.350404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.388 17:13:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:46.388 17:13:43 -- common/autotest_common.sh@862 -- # return 0 00:20:46.388 17:13:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:46.646 [2024-11-27 17:13:43.421881] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:46.646 [2024-11-27 17:13:43.430215] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:46.646 [2024-11-27 17:13:43.430245] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:46.646 [2024-11-27 17:13:43.430300] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:46.646 [2024-11-27 17:13:43.430710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b14840 (107): Transport endpoint is not connected 00:20:46.646 [2024-11-27 17:13:43.431698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b14840 (9): Bad file descriptor 00:20:46.646 [2024-11-27 17:13:43.432696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:46.646 [2024-11-27 17:13:43.432718] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:46.646 [2024-11-27 17:13:43.432733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:46.646 request: 00:20:46.646 { 00:20:46.646 "name": "TLSTEST", 00:20:46.646 "trtype": "tcp", 00:20:46.646 "traddr": "10.0.0.2", 00:20:46.646 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:46.646 "adrfam": "ipv4", 00:20:46.646 "trsvcid": "4420", 00:20:46.646 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:46.646 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:46.646 "method": "bdev_nvme_attach_controller", 00:20:46.646 "req_id": 1 00:20:46.646 } 00:20:46.646 Got JSON-RPC error response 00:20:46.646 response: 00:20:46.646 { 00:20:46.646 "code": -32602, 00:20:46.646 "message": "Invalid parameters" 00:20:46.646 } 00:20:46.646 17:13:43 -- target/tls.sh@36 -- # killprocess 1771834 00:20:46.646 17:13:43 -- common/autotest_common.sh@936 -- # '[' -z 1771834 ']' 00:20:46.646 17:13:43 -- common/autotest_common.sh@940 -- # kill -0 1771834 00:20:46.646 17:13:43 -- common/autotest_common.sh@941 -- # uname 00:20:46.646 17:13:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.646 17:13:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1771834 00:20:46.646 17:13:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:46.646 17:13:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:46.646 17:13:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1771834' 00:20:46.646 killing process with pid 1771834 00:20:46.646 17:13:43 -- common/autotest_common.sh@955 -- # kill 1771834 00:20:46.646 Received shutdown signal, test time was about 10.000000 seconds 00:20:46.646 00:20:46.646 Latency(us) 00:20:46.646 [2024-11-27T16:13:43.597Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:46.646 [2024-11-27T16:13:43.597Z] =================================================================================================================== 00:20:46.646 [2024-11-27T16:13:43.597Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:46.646 17:13:43 -- common/autotest_common.sh@960 -- # wait 1771834 00:20:46.905 17:13:43 -- target/tls.sh@37 -- # return 1 00:20:46.905 17:13:43 -- common/autotest_common.sh@653 -- # es=1 00:20:46.905 17:13:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:46.905 17:13:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:46.905 17:13:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:46.905 17:13:43 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:46.905 17:13:43 -- common/autotest_common.sh@650 -- # local es=0 00:20:46.905 17:13:43 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:46.905 17:13:43 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:46.905 17:13:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:46.905 17:13:43 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:46.905 17:13:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:46.905 17:13:43 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:46.905 17:13:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:46.905 17:13:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:46.905 17:13:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:46.905 17:13:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:46.905 17:13:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:46.905 17:13:43 -- target/tls.sh@28 -- # bdevperf_pid=1771992 00:20:46.905 17:13:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:46.905 17:13:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:46.905 17:13:43 -- target/tls.sh@31 -- # waitforlisten 1771992 /var/tmp/bdevperf.sock 00:20:46.905 17:13:43 -- common/autotest_common.sh@829 -- # '[' -z 1771992 ']' 00:20:46.905 17:13:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:46.905 17:13:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:46.905 17:13:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:46.905 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:46.905 17:13:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:46.905 17:13:43 -- common/autotest_common.sh@10 -- # set +x 00:20:46.905 [2024-11-27 17:13:43.747937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:46.905 [2024-11-27 17:13:43.748021] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1771992 ] 00:20:46.905 EAL: No free 2048 kB hugepages reported on node 1 00:20:46.905 [2024-11-27 17:13:43.805596] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:47.164 [2024-11-27 17:13:43.886304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:48.097 17:13:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:48.097 17:13:44 -- common/autotest_common.sh@862 -- # return 0 00:20:48.097 17:13:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:48.097 [2024-11-27 17:13:44.957781] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:48.097 [2024-11-27 17:13:44.964269] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:48.097 [2024-11-27 17:13:44.964298] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:48.097 [2024-11-27 17:13:44.964353] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:48.097 [2024-11-27 17:13:44.964623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19e3840 (107): Transport endpoint is not connected 00:20:48.097 [2024-11-27 17:13:44.965614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19e3840 (9): Bad file descriptor 00:20:48.097 [2024-11-27 17:13:44.966613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:48.097 [2024-11-27 17:13:44.966634] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:48.097 [2024-11-27 17:13:44.966649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:48.097 request: 00:20:48.097 { 00:20:48.097 "name": "TLSTEST", 00:20:48.097 "trtype": "tcp", 00:20:48.097 "traddr": "10.0.0.2", 00:20:48.097 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:48.097 "adrfam": "ipv4", 00:20:48.097 "trsvcid": "4420", 00:20:48.097 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:48.097 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:48.097 "method": "bdev_nvme_attach_controller", 00:20:48.097 "req_id": 1 00:20:48.097 } 00:20:48.097 Got JSON-RPC error response 00:20:48.097 response: 00:20:48.097 { 00:20:48.097 "code": -32602, 00:20:48.097 "message": "Invalid parameters" 00:20:48.097 } 00:20:48.097 17:13:44 -- target/tls.sh@36 -- # killprocess 1771992 00:20:48.097 17:13:44 -- common/autotest_common.sh@936 -- # '[' -z 1771992 ']' 00:20:48.097 17:13:44 -- common/autotest_common.sh@940 -- # kill -0 1771992 00:20:48.097 17:13:44 -- common/autotest_common.sh@941 -- # uname 00:20:48.097 17:13:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:48.097 17:13:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1771992 00:20:48.097 17:13:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:48.097 17:13:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:48.097 17:13:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1771992' 00:20:48.097 killing process with pid 1771992 00:20:48.097 17:13:45 -- common/autotest_common.sh@955 -- # kill 1771992 00:20:48.097 Received shutdown signal, test time was about 10.000000 seconds 00:20:48.097 00:20:48.097 Latency(us) 00:20:48.097 [2024-11-27T16:13:45.048Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:48.097 [2024-11-27T16:13:45.048Z] =================================================================================================================== 00:20:48.097 [2024-11-27T16:13:45.048Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:48.097 17:13:45 -- common/autotest_common.sh@960 -- # wait 1771992 00:20:48.355 17:13:45 -- target/tls.sh@37 -- # return 1 00:20:48.355 17:13:45 -- common/autotest_common.sh@653 -- # es=1 00:20:48.355 17:13:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:48.355 17:13:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:48.355 17:13:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:48.355 17:13:45 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:48.355 17:13:45 -- common/autotest_common.sh@650 -- # local es=0 00:20:48.355 17:13:45 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:48.355 17:13:45 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:48.355 17:13:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:48.355 17:13:45 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:48.355 17:13:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:48.355 17:13:45 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:48.355 17:13:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:48.355 17:13:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:48.355 17:13:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:48.355 17:13:45 -- target/tls.sh@23 -- # psk= 00:20:48.355 17:13:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:48.355 17:13:45 -- target/tls.sh@28 -- # bdevperf_pid=1772146 00:20:48.355 17:13:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:48.355 17:13:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:48.355 17:13:45 -- target/tls.sh@31 -- # waitforlisten 1772146 /var/tmp/bdevperf.sock 00:20:48.355 17:13:45 -- common/autotest_common.sh@829 -- # '[' -z 1772146 ']' 00:20:48.355 17:13:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:48.355 17:13:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:48.355 17:13:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:48.355 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:48.355 17:13:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:48.355 17:13:45 -- common/autotest_common.sh@10 -- # set +x 00:20:48.355 [2024-11-27 17:13:45.291049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:48.355 [2024-11-27 17:13:45.291132] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1772146 ] 00:20:48.613 EAL: No free 2048 kB hugepages reported on node 1 00:20:48.613 [2024-11-27 17:13:45.351755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:48.613 [2024-11-27 17:13:45.435152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:49.545 17:13:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:49.545 17:13:46 -- common/autotest_common.sh@862 -- # return 0 00:20:49.545 17:13:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:49.803 [2024-11-27 17:13:46.578414] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:49.803 [2024-11-27 17:13:46.580239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2edd0 (9): Bad file descriptor 00:20:49.803 [2024-11-27 17:13:46.581236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:49.803 [2024-11-27 17:13:46.581259] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:49.803 [2024-11-27 17:13:46.581273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:49.803 request: 00:20:49.803 { 00:20:49.803 "name": "TLSTEST", 00:20:49.803 "trtype": "tcp", 00:20:49.803 "traddr": "10.0.0.2", 00:20:49.803 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:49.803 "adrfam": "ipv4", 00:20:49.803 "trsvcid": "4420", 00:20:49.803 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:49.803 "method": "bdev_nvme_attach_controller", 00:20:49.803 "req_id": 1 00:20:49.803 } 00:20:49.803 Got JSON-RPC error response 00:20:49.803 response: 00:20:49.803 { 00:20:49.803 "code": -32602, 00:20:49.803 "message": "Invalid parameters" 00:20:49.803 } 00:20:49.803 17:13:46 -- target/tls.sh@36 -- # killprocess 1772146 00:20:49.803 17:13:46 -- common/autotest_common.sh@936 -- # '[' -z 1772146 ']' 00:20:49.803 17:13:46 -- common/autotest_common.sh@940 -- # kill -0 1772146 00:20:49.803 17:13:46 -- common/autotest_common.sh@941 -- # uname 00:20:49.803 17:13:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:49.803 17:13:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1772146 00:20:49.803 17:13:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:49.803 17:13:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:49.803 17:13:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1772146' 00:20:49.803 killing process with pid 1772146 00:20:49.803 17:13:46 -- common/autotest_common.sh@955 -- # kill 1772146 00:20:49.803 Received shutdown signal, test time was about 10.000000 seconds 00:20:49.804 00:20:49.804 Latency(us) 00:20:49.804 [2024-11-27T16:13:46.755Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.804 [2024-11-27T16:13:46.755Z] =================================================================================================================== 00:20:49.804 [2024-11-27T16:13:46.755Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:49.804 17:13:46 -- common/autotest_common.sh@960 -- # wait 1772146 00:20:50.061 17:13:46 -- target/tls.sh@37 -- # return 1 00:20:50.061 17:13:46 -- common/autotest_common.sh@653 -- # es=1 00:20:50.061 17:13:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:50.061 17:13:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:50.061 17:13:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:50.061 17:13:46 -- target/tls.sh@167 -- # killprocess 1768356 00:20:50.061 17:13:46 -- common/autotest_common.sh@936 -- # '[' -z 1768356 ']' 00:20:50.061 17:13:46 -- common/autotest_common.sh@940 -- # kill -0 1768356 00:20:50.061 17:13:46 -- common/autotest_common.sh@941 -- # uname 00:20:50.061 17:13:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.061 17:13:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1768356 00:20:50.061 17:13:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:50.061 17:13:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:50.061 17:13:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1768356' 00:20:50.061 killing process with pid 1768356 00:20:50.061 17:13:46 -- common/autotest_common.sh@955 -- # kill 1768356 00:20:50.061 17:13:46 -- common/autotest_common.sh@960 -- # wait 1768356 00:20:50.320 17:13:47 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:50.320 17:13:47 -- target/tls.sh@49 -- # local key hash crc 00:20:50.320 17:13:47 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:50.320 17:13:47 -- target/tls.sh@51 -- # hash=02 00:20:50.320 17:13:47 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:50.320 17:13:47 -- target/tls.sh@52 -- # gzip -1 -c 00:20:50.320 17:13:47 -- target/tls.sh@52 -- # tail -c8 00:20:50.320 17:13:47 -- target/tls.sh@52 -- # head -c 4 00:20:50.320 17:13:47 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:50.320 17:13:47 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:50.320 17:13:47 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:50.320 17:13:47 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:50.320 17:13:47 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:50.320 17:13:47 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.320 17:13:47 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:50.320 17:13:47 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.320 17:13:47 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:50.320 17:13:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:50.320 17:13:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:50.320 17:13:47 -- common/autotest_common.sh@10 -- # set +x 00:20:50.320 17:13:47 -- nvmf/common.sh@469 -- # nvmfpid=1772433 00:20:50.320 17:13:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:50.320 17:13:47 -- nvmf/common.sh@470 -- # waitforlisten 1772433 00:20:50.320 17:13:47 -- common/autotest_common.sh@829 -- # '[' -z 1772433 ']' 00:20:50.320 17:13:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:50.320 17:13:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:50.320 17:13:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:50.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:50.320 17:13:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:50.320 17:13:47 -- common/autotest_common.sh@10 -- # set +x 00:20:50.320 [2024-11-27 17:13:47.219314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:50.320 [2024-11-27 17:13:47.219405] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:50.320 EAL: No free 2048 kB hugepages reported on node 1 00:20:50.578 [2024-11-27 17:13:47.286998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:50.578 [2024-11-27 17:13:47.374436] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:50.578 [2024-11-27 17:13:47.374625] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:50.578 [2024-11-27 17:13:47.374648] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:50.578 [2024-11-27 17:13:47.374663] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:50.578 [2024-11-27 17:13:47.374694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:51.510 17:13:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:51.510 17:13:48 -- common/autotest_common.sh@862 -- # return 0 00:20:51.510 17:13:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:51.510 17:13:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:51.510 17:13:48 -- common/autotest_common.sh@10 -- # set +x 00:20:51.510 17:13:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:51.510 17:13:48 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:51.510 17:13:48 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:51.510 17:13:48 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:51.510 [2024-11-27 17:13:48.435086] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:51.510 17:13:48 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:51.768 17:13:48 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:52.025 [2024-11-27 17:13:48.932445] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:52.025 [2024-11-27 17:13:48.932725] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:52.025 17:13:48 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:52.283 malloc0 00:20:52.283 17:13:49 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:52.540 17:13:49 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.798 17:13:49 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.798 17:13:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:52.798 17:13:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:52.798 17:13:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:52.799 17:13:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:52.799 17:13:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:52.799 17:13:49 -- target/tls.sh@28 -- # bdevperf_pid=1772737 00:20:52.799 17:13:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:52.799 17:13:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:52.799 17:13:49 -- target/tls.sh@31 -- # waitforlisten 1772737 /var/tmp/bdevperf.sock 00:20:52.799 17:13:49 -- common/autotest_common.sh@829 -- # '[' -z 1772737 ']' 00:20:52.799 17:13:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:52.799 17:13:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:52.799 17:13:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:52.799 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:52.799 17:13:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:52.799 17:13:49 -- common/autotest_common.sh@10 -- # set +x 00:20:52.799 [2024-11-27 17:13:49.743892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:52.799 [2024-11-27 17:13:49.743982] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1772737 ] 00:20:53.057 EAL: No free 2048 kB hugepages reported on node 1 00:20:53.057 [2024-11-27 17:13:49.803727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.057 [2024-11-27 17:13:49.890748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:53.989 17:13:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:53.989 17:13:50 -- common/autotest_common.sh@862 -- # return 0 00:20:53.990 17:13:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.247 [2024-11-27 17:13:50.947719] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:54.247 TLSTESTn1 00:20:54.247 17:13:51 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:54.247 Running I/O for 10 seconds... 00:21:06.443 00:21:06.443 Latency(us) 00:21:06.443 [2024-11-27T16:14:03.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:06.443 [2024-11-27T16:14:03.394Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:06.443 Verification LBA range: start 0x0 length 0x2000 00:21:06.443 TLSTESTn1 : 10.04 2978.18 11.63 0.00 0.00 42920.96 7621.59 82721.00 00:21:06.443 [2024-11-27T16:14:03.394Z] =================================================================================================================== 00:21:06.443 [2024-11-27T16:14:03.394Z] Total : 2978.18 11.63 0.00 0.00 42920.96 7621.59 82721.00 00:21:06.443 0 00:21:06.443 17:14:01 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:06.443 17:14:01 -- target/tls.sh@45 -- # killprocess 1772737 00:21:06.443 17:14:01 -- common/autotest_common.sh@936 -- # '[' -z 1772737 ']' 00:21:06.443 17:14:01 -- common/autotest_common.sh@940 -- # kill -0 1772737 00:21:06.443 17:14:01 -- common/autotest_common.sh@941 -- # uname 00:21:06.443 17:14:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.443 17:14:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1772737 00:21:06.443 17:14:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:06.443 17:14:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:06.443 17:14:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1772737' 00:21:06.443 killing process with pid 1772737 00:21:06.443 17:14:01 -- common/autotest_common.sh@955 -- # kill 1772737 00:21:06.443 Received shutdown signal, test time was about 10.000000 seconds 00:21:06.443 00:21:06.443 Latency(us) 00:21:06.443 [2024-11-27T16:14:03.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:06.443 [2024-11-27T16:14:03.394Z] =================================================================================================================== 00:21:06.443 [2024-11-27T16:14:03.394Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:06.443 17:14:01 -- common/autotest_common.sh@960 -- # wait 1772737 00:21:06.443 17:14:01 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:06.443 17:14:01 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:06.443 17:14:01 -- common/autotest_common.sh@650 -- # local es=0 00:21:06.443 17:14:01 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:06.443 17:14:01 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:06.443 17:14:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:06.443 17:14:01 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:06.443 17:14:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:06.443 17:14:01 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:06.443 17:14:01 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:06.443 17:14:01 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:06.443 17:14:01 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:06.443 17:14:01 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:06.443 17:14:01 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:06.443 17:14:01 -- target/tls.sh@28 -- # bdevperf_pid=1774224 00:21:06.443 17:14:01 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:06.443 17:14:01 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:06.443 17:14:01 -- target/tls.sh@31 -- # waitforlisten 1774224 /var/tmp/bdevperf.sock 00:21:06.443 17:14:01 -- common/autotest_common.sh@829 -- # '[' -z 1774224 ']' 00:21:06.443 17:14:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:06.443 17:14:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:06.443 17:14:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:06.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:06.443 17:14:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:06.443 17:14:01 -- common/autotest_common.sh@10 -- # set +x 00:21:06.443 [2024-11-27 17:14:01.554403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:06.443 [2024-11-27 17:14:01.554499] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1774224 ] 00:21:06.443 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.443 [2024-11-27 17:14:01.611793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:06.443 [2024-11-27 17:14:01.691916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:06.443 17:14:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:06.443 17:14:02 -- common/autotest_common.sh@862 -- # return 0 00:21:06.443 17:14:02 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:06.443 [2024-11-27 17:14:02.774459] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:06.443 [2024-11-27 17:14:02.774553] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:06.443 request: 00:21:06.444 { 00:21:06.444 "name": "TLSTEST", 00:21:06.444 "trtype": "tcp", 00:21:06.444 "traddr": "10.0.0.2", 00:21:06.444 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:06.444 "adrfam": "ipv4", 00:21:06.444 "trsvcid": "4420", 00:21:06.444 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:06.444 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:06.444 "method": "bdev_nvme_attach_controller", 00:21:06.444 "req_id": 1 00:21:06.444 } 00:21:06.444 Got JSON-RPC error response 00:21:06.444 response: 00:21:06.444 { 00:21:06.444 "code": -22, 00:21:06.444 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:06.444 } 00:21:06.444 17:14:02 -- target/tls.sh@36 -- # killprocess 1774224 00:21:06.444 17:14:02 -- common/autotest_common.sh@936 -- # '[' -z 1774224 ']' 00:21:06.444 17:14:02 -- common/autotest_common.sh@940 -- # kill -0 1774224 00:21:06.444 17:14:02 -- common/autotest_common.sh@941 -- # uname 00:21:06.444 17:14:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.444 17:14:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1774224 00:21:06.444 17:14:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:06.444 17:14:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:06.444 17:14:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1774224' 00:21:06.444 killing process with pid 1774224 00:21:06.444 17:14:02 -- common/autotest_common.sh@955 -- # kill 1774224 00:21:06.444 Received shutdown signal, test time was about 10.000000 seconds 00:21:06.444 00:21:06.444 Latency(us) 00:21:06.444 [2024-11-27T16:14:03.395Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:06.444 [2024-11-27T16:14:03.395Z] =================================================================================================================== 00:21:06.444 [2024-11-27T16:14:03.395Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:06.444 17:14:02 -- common/autotest_common.sh@960 -- # wait 1774224 00:21:06.444 17:14:03 -- target/tls.sh@37 -- # return 1 00:21:06.444 17:14:03 -- common/autotest_common.sh@653 -- # es=1 00:21:06.444 17:14:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:06.444 17:14:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:06.444 17:14:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:06.444 17:14:03 -- target/tls.sh@183 -- # killprocess 1772433 00:21:06.444 17:14:03 -- common/autotest_common.sh@936 -- # '[' -z 1772433 ']' 00:21:06.444 17:14:03 -- common/autotest_common.sh@940 -- # kill -0 1772433 00:21:06.444 17:14:03 -- common/autotest_common.sh@941 -- # uname 00:21:06.444 17:14:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.444 17:14:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1772433 00:21:06.444 17:14:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:06.444 17:14:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:06.444 17:14:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1772433' 00:21:06.444 killing process with pid 1772433 00:21:06.444 17:14:03 -- common/autotest_common.sh@955 -- # kill 1772433 00:21:06.444 17:14:03 -- common/autotest_common.sh@960 -- # wait 1772433 00:21:06.444 17:14:03 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:06.444 17:14:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:06.444 17:14:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:06.444 17:14:03 -- common/autotest_common.sh@10 -- # set +x 00:21:06.444 17:14:03 -- nvmf/common.sh@469 -- # nvmfpid=1774384 00:21:06.444 17:14:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:06.444 17:14:03 -- nvmf/common.sh@470 -- # waitforlisten 1774384 00:21:06.444 17:14:03 -- common/autotest_common.sh@829 -- # '[' -z 1774384 ']' 00:21:06.444 17:14:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:06.444 17:14:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:06.444 17:14:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:06.444 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:06.444 17:14:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:06.444 17:14:03 -- common/autotest_common.sh@10 -- # set +x 00:21:06.444 [2024-11-27 17:14:03.387875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:06.444 [2024-11-27 17:14:03.387962] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:06.702 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.702 [2024-11-27 17:14:03.457357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:06.702 [2024-11-27 17:14:03.549505] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:06.702 [2024-11-27 17:14:03.549710] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:06.702 [2024-11-27 17:14:03.549731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:06.702 [2024-11-27 17:14:03.549747] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:06.702 [2024-11-27 17:14:03.549779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:07.636 17:14:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:07.636 17:14:04 -- common/autotest_common.sh@862 -- # return 0 00:21:07.636 17:14:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:07.636 17:14:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:07.636 17:14:04 -- common/autotest_common.sh@10 -- # set +x 00:21:07.636 17:14:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:07.636 17:14:04 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.636 17:14:04 -- common/autotest_common.sh@650 -- # local es=0 00:21:07.636 17:14:04 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.636 17:14:04 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:21:07.636 17:14:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:07.636 17:14:04 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:21:07.636 17:14:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:07.636 17:14:04 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.636 17:14:04 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.636 17:14:04 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:07.894 [2024-11-27 17:14:04.670362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:07.894 17:14:04 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:08.151 17:14:04 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:08.409 [2024-11-27 17:14:05.280014] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:08.409 [2024-11-27 17:14:05.280288] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:08.409 17:14:05 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:08.667 malloc0 00:21:08.667 17:14:05 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:08.925 17:14:05 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:09.183 [2024-11-27 17:14:06.086690] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:09.183 [2024-11-27 17:14:06.086734] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:09.183 [2024-11-27 17:14:06.086776] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:09.183 request: 00:21:09.183 { 00:21:09.183 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:09.183 "host": "nqn.2016-06.io.spdk:host1", 00:21:09.183 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:09.183 "method": "nvmf_subsystem_add_host", 00:21:09.183 "req_id": 1 00:21:09.183 } 00:21:09.183 Got JSON-RPC error response 00:21:09.183 response: 00:21:09.183 { 00:21:09.183 "code": -32603, 00:21:09.183 "message": "Internal error" 00:21:09.183 } 00:21:09.183 17:14:06 -- common/autotest_common.sh@653 -- # es=1 00:21:09.183 17:14:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:09.183 17:14:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:09.183 17:14:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:09.183 17:14:06 -- target/tls.sh@189 -- # killprocess 1774384 00:21:09.183 17:14:06 -- common/autotest_common.sh@936 -- # '[' -z 1774384 ']' 00:21:09.183 17:14:06 -- common/autotest_common.sh@940 -- # kill -0 1774384 00:21:09.183 17:14:06 -- common/autotest_common.sh@941 -- # uname 00:21:09.183 17:14:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:09.183 17:14:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1774384 00:21:09.441 17:14:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:09.441 17:14:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:09.441 17:14:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1774384' 00:21:09.441 killing process with pid 1774384 00:21:09.441 17:14:06 -- common/autotest_common.sh@955 -- # kill 1774384 00:21:09.441 17:14:06 -- common/autotest_common.sh@960 -- # wait 1774384 00:21:09.441 17:14:06 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:09.441 17:14:06 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:09.441 17:14:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:09.441 17:14:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:09.441 17:14:06 -- common/autotest_common.sh@10 -- # set +x 00:21:09.441 17:14:06 -- nvmf/common.sh@469 -- # nvmfpid=1774815 00:21:09.441 17:14:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:09.441 17:14:06 -- nvmf/common.sh@470 -- # waitforlisten 1774815 00:21:09.441 17:14:06 -- common/autotest_common.sh@829 -- # '[' -z 1774815 ']' 00:21:09.441 17:14:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:09.441 17:14:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:09.441 17:14:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:09.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:09.441 17:14:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:09.441 17:14:06 -- common/autotest_common.sh@10 -- # set +x 00:21:09.700 [2024-11-27 17:14:06.413482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:09.700 [2024-11-27 17:14:06.413610] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:09.700 EAL: No free 2048 kB hugepages reported on node 1 00:21:09.700 [2024-11-27 17:14:06.479210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:09.700 [2024-11-27 17:14:06.567993] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:09.700 [2024-11-27 17:14:06.568162] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:09.700 [2024-11-27 17:14:06.568179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:09.700 [2024-11-27 17:14:06.568191] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:09.700 [2024-11-27 17:14:06.568236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:10.635 17:14:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:10.635 17:14:07 -- common/autotest_common.sh@862 -- # return 0 00:21:10.635 17:14:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:10.635 17:14:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:10.635 17:14:07 -- common/autotest_common.sh@10 -- # set +x 00:21:10.635 17:14:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:10.635 17:14:07 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:10.635 17:14:07 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:10.635 17:14:07 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:10.893 [2024-11-27 17:14:07.703103] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:10.893 17:14:07 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:11.151 17:14:07 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:11.408 [2024-11-27 17:14:08.204451] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:11.408 [2024-11-27 17:14:08.204731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:11.408 17:14:08 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:11.666 malloc0 00:21:11.666 17:14:08 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:11.924 17:14:08 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:12.183 17:14:08 -- target/tls.sh@197 -- # bdevperf_pid=1775119 00:21:12.183 17:14:08 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:12.183 17:14:08 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:12.183 17:14:08 -- target/tls.sh@200 -- # waitforlisten 1775119 /var/tmp/bdevperf.sock 00:21:12.183 17:14:08 -- common/autotest_common.sh@829 -- # '[' -z 1775119 ']' 00:21:12.183 17:14:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:12.183 17:14:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:12.183 17:14:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:12.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:12.183 17:14:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:12.183 17:14:08 -- common/autotest_common.sh@10 -- # set +x 00:21:12.183 [2024-11-27 17:14:09.021351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:12.183 [2024-11-27 17:14:09.021443] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1775119 ] 00:21:12.183 EAL: No free 2048 kB hugepages reported on node 1 00:21:12.183 [2024-11-27 17:14:09.084128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:12.440 [2024-11-27 17:14:09.172071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:13.373 17:14:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:13.373 17:14:10 -- common/autotest_common.sh@862 -- # return 0 00:21:13.373 17:14:10 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:13.373 [2024-11-27 17:14:10.264807] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:13.631 TLSTESTn1 00:21:13.631 17:14:10 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:13.889 17:14:10 -- target/tls.sh@205 -- # tgtconf='{ 00:21:13.889 "subsystems": [ 00:21:13.889 { 00:21:13.889 "subsystem": "iobuf", 00:21:13.889 "config": [ 00:21:13.889 { 00:21:13.889 "method": "iobuf_set_options", 00:21:13.889 "params": { 00:21:13.889 "small_pool_count": 8192, 00:21:13.889 "large_pool_count": 1024, 00:21:13.889 "small_bufsize": 8192, 00:21:13.889 "large_bufsize": 135168 00:21:13.889 } 00:21:13.889 } 00:21:13.889 ] 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "subsystem": "sock", 00:21:13.889 "config": [ 00:21:13.889 { 00:21:13.889 "method": "sock_impl_set_options", 00:21:13.889 "params": { 00:21:13.889 "impl_name": "posix", 00:21:13.889 "recv_buf_size": 2097152, 00:21:13.889 "send_buf_size": 2097152, 00:21:13.889 "enable_recv_pipe": true, 00:21:13.889 "enable_quickack": false, 00:21:13.889 "enable_placement_id": 0, 00:21:13.889 "enable_zerocopy_send_server": true, 00:21:13.889 "enable_zerocopy_send_client": false, 00:21:13.889 "zerocopy_threshold": 0, 00:21:13.889 "tls_version": 0, 00:21:13.889 "enable_ktls": false 00:21:13.889 } 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "method": "sock_impl_set_options", 00:21:13.889 "params": { 00:21:13.889 "impl_name": "ssl", 00:21:13.889 "recv_buf_size": 4096, 00:21:13.889 "send_buf_size": 4096, 00:21:13.889 "enable_recv_pipe": true, 00:21:13.889 "enable_quickack": false, 00:21:13.889 "enable_placement_id": 0, 00:21:13.889 "enable_zerocopy_send_server": true, 00:21:13.889 "enable_zerocopy_send_client": false, 00:21:13.889 "zerocopy_threshold": 0, 00:21:13.889 "tls_version": 0, 00:21:13.889 "enable_ktls": false 00:21:13.889 } 00:21:13.889 } 00:21:13.889 ] 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "subsystem": "vmd", 00:21:13.889 "config": [] 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "subsystem": "accel", 00:21:13.889 "config": [ 00:21:13.889 { 00:21:13.889 "method": "accel_set_options", 00:21:13.889 "params": { 00:21:13.889 "small_cache_size": 128, 00:21:13.889 "large_cache_size": 16, 00:21:13.889 "task_count": 2048, 00:21:13.889 "sequence_count": 2048, 00:21:13.889 "buf_count": 2048 00:21:13.889 } 00:21:13.889 } 00:21:13.889 ] 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "subsystem": "bdev", 00:21:13.889 "config": [ 00:21:13.889 { 00:21:13.889 "method": "bdev_set_options", 00:21:13.889 "params": { 00:21:13.889 "bdev_io_pool_size": 65535, 00:21:13.889 "bdev_io_cache_size": 256, 00:21:13.889 "bdev_auto_examine": true, 00:21:13.889 "iobuf_small_cache_size": 128, 00:21:13.889 "iobuf_large_cache_size": 16 00:21:13.889 } 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "method": "bdev_raid_set_options", 00:21:13.889 "params": { 00:21:13.889 "process_window_size_kb": 1024 00:21:13.889 } 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "method": "bdev_iscsi_set_options", 00:21:13.889 "params": { 00:21:13.889 "timeout_sec": 30 00:21:13.889 } 00:21:13.889 }, 00:21:13.889 { 00:21:13.889 "method": "bdev_nvme_set_options", 00:21:13.889 "params": { 00:21:13.889 "action_on_timeout": "none", 00:21:13.889 "timeout_us": 0, 00:21:13.889 "timeout_admin_us": 0, 00:21:13.889 "keep_alive_timeout_ms": 10000, 00:21:13.889 "transport_retry_count": 4, 00:21:13.889 "arbitration_burst": 0, 00:21:13.889 "low_priority_weight": 0, 00:21:13.889 "medium_priority_weight": 0, 00:21:13.889 "high_priority_weight": 0, 00:21:13.889 "nvme_adminq_poll_period_us": 10000, 00:21:13.889 "nvme_ioq_poll_period_us": 0, 00:21:13.889 "io_queue_requests": 0, 00:21:13.889 "delay_cmd_submit": true, 00:21:13.889 "bdev_retry_count": 3, 00:21:13.889 "transport_ack_timeout": 0, 00:21:13.889 "ctrlr_loss_timeout_sec": 0, 00:21:13.889 "reconnect_delay_sec": 0, 00:21:13.889 "fast_io_fail_timeout_sec": 0, 00:21:13.889 "generate_uuids": false, 00:21:13.889 "transport_tos": 0, 00:21:13.889 "io_path_stat": false, 00:21:13.890 "allow_accel_sequence": false 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "bdev_nvme_set_hotplug", 00:21:13.890 "params": { 00:21:13.890 "period_us": 100000, 00:21:13.890 "enable": false 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "bdev_malloc_create", 00:21:13.890 "params": { 00:21:13.890 "name": "malloc0", 00:21:13.890 "num_blocks": 8192, 00:21:13.890 "block_size": 4096, 00:21:13.890 "physical_block_size": 4096, 00:21:13.890 "uuid": "a30075c3-3ab4-476a-9d65-473ff8653cf5", 00:21:13.890 "optimal_io_boundary": 0 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "bdev_wait_for_examine" 00:21:13.890 } 00:21:13.890 ] 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "subsystem": "nbd", 00:21:13.890 "config": [] 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "subsystem": "scheduler", 00:21:13.890 "config": [ 00:21:13.890 { 00:21:13.890 "method": "framework_set_scheduler", 00:21:13.890 "params": { 00:21:13.890 "name": "static" 00:21:13.890 } 00:21:13.890 } 00:21:13.890 ] 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "subsystem": "nvmf", 00:21:13.890 "config": [ 00:21:13.890 { 00:21:13.890 "method": "nvmf_set_config", 00:21:13.890 "params": { 00:21:13.890 "discovery_filter": "match_any", 00:21:13.890 "admin_cmd_passthru": { 00:21:13.890 "identify_ctrlr": false 00:21:13.890 } 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_set_max_subsystems", 00:21:13.890 "params": { 00:21:13.890 "max_subsystems": 1024 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_set_crdt", 00:21:13.890 "params": { 00:21:13.890 "crdt1": 0, 00:21:13.890 "crdt2": 0, 00:21:13.890 "crdt3": 0 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_create_transport", 00:21:13.890 "params": { 00:21:13.890 "trtype": "TCP", 00:21:13.890 "max_queue_depth": 128, 00:21:13.890 "max_io_qpairs_per_ctrlr": 127, 00:21:13.890 "in_capsule_data_size": 4096, 00:21:13.890 "max_io_size": 131072, 00:21:13.890 "io_unit_size": 131072, 00:21:13.890 "max_aq_depth": 128, 00:21:13.890 "num_shared_buffers": 511, 00:21:13.890 "buf_cache_size": 4294967295, 00:21:13.890 "dif_insert_or_strip": false, 00:21:13.890 "zcopy": false, 00:21:13.890 "c2h_success": false, 00:21:13.890 "sock_priority": 0, 00:21:13.890 "abort_timeout_sec": 1 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_create_subsystem", 00:21:13.890 "params": { 00:21:13.890 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:13.890 "allow_any_host": false, 00:21:13.890 "serial_number": "SPDK00000000000001", 00:21:13.890 "model_number": "SPDK bdev Controller", 00:21:13.890 "max_namespaces": 10, 00:21:13.890 "min_cntlid": 1, 00:21:13.890 "max_cntlid": 65519, 00:21:13.890 "ana_reporting": false 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_subsystem_add_host", 00:21:13.890 "params": { 00:21:13.890 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:13.890 "host": "nqn.2016-06.io.spdk:host1", 00:21:13.890 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_subsystem_add_ns", 00:21:13.890 "params": { 00:21:13.890 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:13.890 "namespace": { 00:21:13.890 "nsid": 1, 00:21:13.890 "bdev_name": "malloc0", 00:21:13.890 "nguid": "A30075C33AB4476A9D65473FF8653CF5", 00:21:13.890 "uuid": "a30075c3-3ab4-476a-9d65-473ff8653cf5" 00:21:13.890 } 00:21:13.890 } 00:21:13.890 }, 00:21:13.890 { 00:21:13.890 "method": "nvmf_subsystem_add_listener", 00:21:13.890 "params": { 00:21:13.890 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:13.890 "listen_address": { 00:21:13.890 "trtype": "TCP", 00:21:13.890 "adrfam": "IPv4", 00:21:13.890 "traddr": "10.0.0.2", 00:21:13.890 "trsvcid": "4420" 00:21:13.890 }, 00:21:13.890 "secure_channel": true 00:21:13.890 } 00:21:13.890 } 00:21:13.890 ] 00:21:13.890 } 00:21:13.890 ] 00:21:13.890 }' 00:21:13.890 17:14:10 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:14.148 17:14:11 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:14.148 "subsystems": [ 00:21:14.148 { 00:21:14.148 "subsystem": "iobuf", 00:21:14.148 "config": [ 00:21:14.148 { 00:21:14.148 "method": "iobuf_set_options", 00:21:14.148 "params": { 00:21:14.148 "small_pool_count": 8192, 00:21:14.148 "large_pool_count": 1024, 00:21:14.148 "small_bufsize": 8192, 00:21:14.148 "large_bufsize": 135168 00:21:14.148 } 00:21:14.148 } 00:21:14.148 ] 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "subsystem": "sock", 00:21:14.149 "config": [ 00:21:14.149 { 00:21:14.149 "method": "sock_impl_set_options", 00:21:14.149 "params": { 00:21:14.149 "impl_name": "posix", 00:21:14.149 "recv_buf_size": 2097152, 00:21:14.149 "send_buf_size": 2097152, 00:21:14.149 "enable_recv_pipe": true, 00:21:14.149 "enable_quickack": false, 00:21:14.149 "enable_placement_id": 0, 00:21:14.149 "enable_zerocopy_send_server": true, 00:21:14.149 "enable_zerocopy_send_client": false, 00:21:14.149 "zerocopy_threshold": 0, 00:21:14.149 "tls_version": 0, 00:21:14.149 "enable_ktls": false 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "sock_impl_set_options", 00:21:14.149 "params": { 00:21:14.149 "impl_name": "ssl", 00:21:14.149 "recv_buf_size": 4096, 00:21:14.149 "send_buf_size": 4096, 00:21:14.149 "enable_recv_pipe": true, 00:21:14.149 "enable_quickack": false, 00:21:14.149 "enable_placement_id": 0, 00:21:14.149 "enable_zerocopy_send_server": true, 00:21:14.149 "enable_zerocopy_send_client": false, 00:21:14.149 "zerocopy_threshold": 0, 00:21:14.149 "tls_version": 0, 00:21:14.149 "enable_ktls": false 00:21:14.149 } 00:21:14.149 } 00:21:14.149 ] 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "subsystem": "vmd", 00:21:14.149 "config": [] 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "subsystem": "accel", 00:21:14.149 "config": [ 00:21:14.149 { 00:21:14.149 "method": "accel_set_options", 00:21:14.149 "params": { 00:21:14.149 "small_cache_size": 128, 00:21:14.149 "large_cache_size": 16, 00:21:14.149 "task_count": 2048, 00:21:14.149 "sequence_count": 2048, 00:21:14.149 "buf_count": 2048 00:21:14.149 } 00:21:14.149 } 00:21:14.149 ] 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "subsystem": "bdev", 00:21:14.149 "config": [ 00:21:14.149 { 00:21:14.149 "method": "bdev_set_options", 00:21:14.149 "params": { 00:21:14.149 "bdev_io_pool_size": 65535, 00:21:14.149 "bdev_io_cache_size": 256, 00:21:14.149 "bdev_auto_examine": true, 00:21:14.149 "iobuf_small_cache_size": 128, 00:21:14.149 "iobuf_large_cache_size": 16 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_raid_set_options", 00:21:14.149 "params": { 00:21:14.149 "process_window_size_kb": 1024 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_iscsi_set_options", 00:21:14.149 "params": { 00:21:14.149 "timeout_sec": 30 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_nvme_set_options", 00:21:14.149 "params": { 00:21:14.149 "action_on_timeout": "none", 00:21:14.149 "timeout_us": 0, 00:21:14.149 "timeout_admin_us": 0, 00:21:14.149 "keep_alive_timeout_ms": 10000, 00:21:14.149 "transport_retry_count": 4, 00:21:14.149 "arbitration_burst": 0, 00:21:14.149 "low_priority_weight": 0, 00:21:14.149 "medium_priority_weight": 0, 00:21:14.149 "high_priority_weight": 0, 00:21:14.149 "nvme_adminq_poll_period_us": 10000, 00:21:14.149 "nvme_ioq_poll_period_us": 0, 00:21:14.149 "io_queue_requests": 512, 00:21:14.149 "delay_cmd_submit": true, 00:21:14.149 "bdev_retry_count": 3, 00:21:14.149 "transport_ack_timeout": 0, 00:21:14.149 "ctrlr_loss_timeout_sec": 0, 00:21:14.149 "reconnect_delay_sec": 0, 00:21:14.149 "fast_io_fail_timeout_sec": 0, 00:21:14.149 "generate_uuids": false, 00:21:14.149 "transport_tos": 0, 00:21:14.149 "io_path_stat": false, 00:21:14.149 "allow_accel_sequence": false 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_nvme_attach_controller", 00:21:14.149 "params": { 00:21:14.149 "name": "TLSTEST", 00:21:14.149 "trtype": "TCP", 00:21:14.149 "adrfam": "IPv4", 00:21:14.149 "traddr": "10.0.0.2", 00:21:14.149 "trsvcid": "4420", 00:21:14.149 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.149 "prchk_reftag": false, 00:21:14.149 "prchk_guard": false, 00:21:14.149 "ctrlr_loss_timeout_sec": 0, 00:21:14.149 "reconnect_delay_sec": 0, 00:21:14.149 "fast_io_fail_timeout_sec": 0, 00:21:14.149 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:14.149 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:14.149 "hdgst": false, 00:21:14.149 "ddgst": false 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_nvme_set_hotplug", 00:21:14.149 "params": { 00:21:14.149 "period_us": 100000, 00:21:14.149 "enable": false 00:21:14.149 } 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "method": "bdev_wait_for_examine" 00:21:14.149 } 00:21:14.149 ] 00:21:14.149 }, 00:21:14.149 { 00:21:14.149 "subsystem": "nbd", 00:21:14.149 "config": [] 00:21:14.149 } 00:21:14.149 ] 00:21:14.149 }' 00:21:14.149 17:14:11 -- target/tls.sh@208 -- # killprocess 1775119 00:21:14.149 17:14:11 -- common/autotest_common.sh@936 -- # '[' -z 1775119 ']' 00:21:14.149 17:14:11 -- common/autotest_common.sh@940 -- # kill -0 1775119 00:21:14.149 17:14:11 -- common/autotest_common.sh@941 -- # uname 00:21:14.149 17:14:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:14.149 17:14:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1775119 00:21:14.149 17:14:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:14.149 17:14:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:14.149 17:14:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1775119' 00:21:14.149 killing process with pid 1775119 00:21:14.149 17:14:11 -- common/autotest_common.sh@955 -- # kill 1775119 00:21:14.149 Received shutdown signal, test time was about 10.000000 seconds 00:21:14.149 00:21:14.149 Latency(us) 00:21:14.149 [2024-11-27T16:14:11.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:14.149 [2024-11-27T16:14:11.100Z] =================================================================================================================== 00:21:14.149 [2024-11-27T16:14:11.100Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:14.149 17:14:11 -- common/autotest_common.sh@960 -- # wait 1775119 00:21:14.407 17:14:11 -- target/tls.sh@209 -- # killprocess 1774815 00:21:14.407 17:14:11 -- common/autotest_common.sh@936 -- # '[' -z 1774815 ']' 00:21:14.407 17:14:11 -- common/autotest_common.sh@940 -- # kill -0 1774815 00:21:14.407 17:14:11 -- common/autotest_common.sh@941 -- # uname 00:21:14.407 17:14:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:14.407 17:14:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1774815 00:21:14.407 17:14:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:14.407 17:14:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:14.407 17:14:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1774815' 00:21:14.407 killing process with pid 1774815 00:21:14.407 17:14:11 -- common/autotest_common.sh@955 -- # kill 1774815 00:21:14.407 17:14:11 -- common/autotest_common.sh@960 -- # wait 1774815 00:21:14.667 17:14:11 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:14.667 17:14:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:14.667 17:14:11 -- target/tls.sh@212 -- # echo '{ 00:21:14.667 "subsystems": [ 00:21:14.667 { 00:21:14.667 "subsystem": "iobuf", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "iobuf_set_options", 00:21:14.667 "params": { 00:21:14.667 "small_pool_count": 8192, 00:21:14.667 "large_pool_count": 1024, 00:21:14.667 "small_bufsize": 8192, 00:21:14.667 "large_bufsize": 135168 00:21:14.667 } 00:21:14.667 } 00:21:14.667 ] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "sock", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "sock_impl_set_options", 00:21:14.667 "params": { 00:21:14.667 "impl_name": "posix", 00:21:14.667 "recv_buf_size": 2097152, 00:21:14.667 "send_buf_size": 2097152, 00:21:14.667 "enable_recv_pipe": true, 00:21:14.667 "enable_quickack": false, 00:21:14.667 "enable_placement_id": 0, 00:21:14.667 "enable_zerocopy_send_server": true, 00:21:14.667 "enable_zerocopy_send_client": false, 00:21:14.667 "zerocopy_threshold": 0, 00:21:14.667 "tls_version": 0, 00:21:14.667 "enable_ktls": false 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "sock_impl_set_options", 00:21:14.667 "params": { 00:21:14.667 "impl_name": "ssl", 00:21:14.667 "recv_buf_size": 4096, 00:21:14.667 "send_buf_size": 4096, 00:21:14.667 "enable_recv_pipe": true, 00:21:14.667 "enable_quickack": false, 00:21:14.667 "enable_placement_id": 0, 00:21:14.667 "enable_zerocopy_send_server": true, 00:21:14.667 "enable_zerocopy_send_client": false, 00:21:14.667 "zerocopy_threshold": 0, 00:21:14.667 "tls_version": 0, 00:21:14.667 "enable_ktls": false 00:21:14.667 } 00:21:14.667 } 00:21:14.667 ] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "vmd", 00:21:14.667 "config": [] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "accel", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "accel_set_options", 00:21:14.667 "params": { 00:21:14.667 "small_cache_size": 128, 00:21:14.667 "large_cache_size": 16, 00:21:14.667 "task_count": 2048, 00:21:14.667 "sequence_count": 2048, 00:21:14.667 "buf_count": 2048 00:21:14.667 } 00:21:14.667 } 00:21:14.667 ] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "bdev", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "bdev_set_options", 00:21:14.667 "params": { 00:21:14.667 "bdev_io_pool_size": 65535, 00:21:14.667 "bdev_io_cache_size": 256, 00:21:14.667 "bdev_auto_examine": true, 00:21:14.667 "iobuf_small_cache_size": 128, 00:21:14.667 "iobuf_large_cache_size": 16 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_raid_set_options", 00:21:14.667 "params": { 00:21:14.667 "process_window_size_kb": 1024 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_iscsi_set_options", 00:21:14.667 "params": { 00:21:14.667 "timeout_sec": 30 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_nvme_set_options", 00:21:14.667 "params": { 00:21:14.667 "action_on_timeout": "none", 00:21:14.667 "timeout_us": 0, 00:21:14.667 "timeout_admin_us": 0, 00:21:14.667 "keep_alive_timeout_ms": 10000, 00:21:14.667 "transport_retry_count": 4, 00:21:14.667 "arbitration_burst": 0, 00:21:14.667 "low_priority_weight": 0, 00:21:14.667 "medium_priority_weight": 0, 00:21:14.667 "high_priority_weight": 0, 00:21:14.667 "nvme_adminq_poll_period_us": 10000, 00:21:14.667 "nvme_ioq_poll_period_us": 0, 00:21:14.667 "io_queue_requests": 0, 00:21:14.667 "delay_cmd_submit": true, 00:21:14.667 "bdev_retry_count": 3, 00:21:14.667 "transport_ack_timeout": 0, 00:21:14.667 "ctrlr_loss_timeout_sec": 0, 00:21:14.667 "reconnect_delay_sec": 0, 00:21:14.667 "fast_io_fail_timeout_sec": 0, 00:21:14.667 "generate_uuids": false, 00:21:14.667 "transport_tos": 0, 00:21:14.667 "io_path_stat": false, 00:21:14.667 "allow_accel_sequence": false 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_nvme_set_hotplug", 00:21:14.667 "params": { 00:21:14.667 "period_us": 100000, 00:21:14.667 "enable": false 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_malloc_create", 00:21:14.667 "params": { 00:21:14.667 "name": "malloc0", 00:21:14.667 "num_blocks": 8192, 00:21:14.667 "block_size": 4096, 00:21:14.667 "physical_block_size": 4096, 00:21:14.667 "uuid": "a30075c3-3ab4-476a-9d65-473ff8653cf5", 00:21:14.667 "optimal_io_boundary": 0 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "bdev_wait_for_examine" 00:21:14.667 } 00:21:14.667 ] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "nbd", 00:21:14.667 "config": [] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "sch 17:14:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:14.667 eduler", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "framework_set_scheduler", 00:21:14.667 "params": { 00:21:14.667 "name": "static" 00:21:14.667 } 00:21:14.667 } 00:21:14.667 ] 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "subsystem": "nvmf", 00:21:14.667 "config": [ 00:21:14.667 { 00:21:14.667 "method": "nvmf_set_config", 00:21:14.667 "params": { 00:21:14.667 "discovery_filter": "match_any", 00:21:14.667 "admin_cmd_passthru": { 00:21:14.667 "identify_ctrlr": false 00:21:14.667 } 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "nvmf_set_max_subsystems", 00:21:14.667 "params": { 00:21:14.667 "max_subsystems": 1024 00:21:14.667 } 00:21:14.667 }, 00:21:14.667 { 00:21:14.667 "method": "nvmf_set_crdt", 00:21:14.668 "params": { 00:21:14.668 "crdt1": 0, 00:21:14.668 "crdt2": 0, 00:21:14.668 "crdt3": 0 00:21:14.668 } 00:21:14.668 }, 00:21:14.668 { 00:21:14.668 "method": "nvmf_create_transport", 00:21:14.668 "params": { 00:21:14.668 "trtype": "TCP", 00:21:14.668 "max_queue_depth": 128, 00:21:14.668 "max_io_qpairs_per_ctrlr": 127, 00:21:14.668 "in_capsule_data_size": 4096, 00:21:14.668 "max_io_size": 131072, 00:21:14.668 "io_unit_size": 131072, 00:21:14.668 "max_aq_depth": 128, 00:21:14.668 "num_shared_buffers": 511, 00:21:14.668 "buf_cache_size": 4294967295, 00:21:14.668 "dif_insert_or_strip": false, 00:21:14.668 "zcopy": false, 00:21:14.668 "c2h_success": false, 00:21:14.668 "sock_priority": 0, 00:21:14.668 "abort_timeout_sec": 1 00:21:14.668 } 00:21:14.668 }, 00:21:14.668 { 00:21:14.668 "method": "nvmf_create_subsystem", 00:21:14.668 "params": { 00:21:14.668 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.668 "allow_any_host": false, 00:21:14.668 "serial_number": "SPDK00000000000001", 00:21:14.668 "model_number": "SPDK bdev Controller", 00:21:14.668 "max_namespaces": 10, 00:21:14.668 "min_cntlid": 1, 00:21:14.668 "max_cntlid": 65519, 00:21:14.668 "ana_reporting": false 00:21:14.668 } 00:21:14.668 }, 00:21:14.668 { 00:21:14.668 "method": "nvmf_subsystem_add_host", 00:21:14.668 "params": { 00:21:14.668 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.668 "host": "nqn.2016-06.io.spdk:host1", 00:21:14.668 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:14.668 } 00:21:14.668 }, 00:21:14.668 { 00:21:14.668 "method": "nvmf_subsystem_add_ns", 00:21:14.668 "params": { 00:21:14.668 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.668 "namespace": { 00:21:14.668 "nsid": 1, 00:21:14.668 "bdev_name": "malloc0", 00:21:14.668 "nguid": "A30075C33AB4476A9D65473FF8653CF5", 00:21:14.668 "uuid": "a30075c3-3ab4-476a-9d65-473ff8653cf5" 00:21:14.668 } 00:21:14.668 } 00:21:14.668 }, 00:21:14.668 { 00:21:14.668 "method": "nvmf_subsystem_add_listener", 00:21:14.668 "params": { 00:21:14.668 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.668 "listen_address": { 00:21:14.668 "trtype": "TCP", 00:21:14.668 "adrfam": "IPv4", 00:21:14.668 "traddr": "10.0.0.2", 00:21:14.668 "trsvcid": "4420" 00:21:14.668 }, 00:21:14.668 "secure_channel": true 00:21:14.668 } 00:21:14.668 } 00:21:14.668 ] 00:21:14.668 } 00:21:14.668 ] 00:21:14.668 }' 00:21:14.668 17:14:11 -- common/autotest_common.sh@10 -- # set +x 00:21:14.668 17:14:11 -- nvmf/common.sh@469 -- # nvmfpid=1775531 00:21:14.668 17:14:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:14.668 17:14:11 -- nvmf/common.sh@470 -- # waitforlisten 1775531 00:21:14.668 17:14:11 -- common/autotest_common.sh@829 -- # '[' -z 1775531 ']' 00:21:14.668 17:14:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:14.668 17:14:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:14.668 17:14:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:14.668 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:14.668 17:14:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:14.668 17:14:11 -- common/autotest_common.sh@10 -- # set +x 00:21:14.668 [2024-11-27 17:14:11.607658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:14.668 [2024-11-27 17:14:11.607751] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:14.927 EAL: No free 2048 kB hugepages reported on node 1 00:21:14.927 [2024-11-27 17:14:11.676847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:14.927 [2024-11-27 17:14:11.762786] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:14.927 [2024-11-27 17:14:11.762966] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:14.927 [2024-11-27 17:14:11.762987] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:14.927 [2024-11-27 17:14:11.763001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:14.927 [2024-11-27 17:14:11.763034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:15.185 [2024-11-27 17:14:11.992078] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:15.185 [2024-11-27 17:14:12.024097] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:15.185 [2024-11-27 17:14:12.024378] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:15.751 17:14:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:15.751 17:14:12 -- common/autotest_common.sh@862 -- # return 0 00:21:15.751 17:14:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:15.751 17:14:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:15.751 17:14:12 -- common/autotest_common.sh@10 -- # set +x 00:21:15.751 17:14:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:15.751 17:14:12 -- target/tls.sh@216 -- # bdevperf_pid=1775694 00:21:15.751 17:14:12 -- target/tls.sh@217 -- # waitforlisten 1775694 /var/tmp/bdevperf.sock 00:21:15.751 17:14:12 -- common/autotest_common.sh@829 -- # '[' -z 1775694 ']' 00:21:15.751 17:14:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:15.751 17:14:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:15.751 17:14:12 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:15.751 17:14:12 -- target/tls.sh@213 -- # echo '{ 00:21:15.751 "subsystems": [ 00:21:15.751 { 00:21:15.751 "subsystem": "iobuf", 00:21:15.751 "config": [ 00:21:15.751 { 00:21:15.751 "method": "iobuf_set_options", 00:21:15.751 "params": { 00:21:15.751 "small_pool_count": 8192, 00:21:15.751 "large_pool_count": 1024, 00:21:15.751 "small_bufsize": 8192, 00:21:15.751 "large_bufsize": 135168 00:21:15.751 } 00:21:15.751 } 00:21:15.751 ] 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "subsystem": "sock", 00:21:15.751 "config": [ 00:21:15.751 { 00:21:15.751 "method": "sock_impl_set_options", 00:21:15.751 "params": { 00:21:15.751 "impl_name": "posix", 00:21:15.751 "recv_buf_size": 2097152, 00:21:15.751 "send_buf_size": 2097152, 00:21:15.751 "enable_recv_pipe": true, 00:21:15.751 "enable_quickack": false, 00:21:15.751 "enable_placement_id": 0, 00:21:15.751 "enable_zerocopy_send_server": true, 00:21:15.751 "enable_zerocopy_send_client": false, 00:21:15.751 "zerocopy_threshold": 0, 00:21:15.751 "tls_version": 0, 00:21:15.751 "enable_ktls": false 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "sock_impl_set_options", 00:21:15.751 "params": { 00:21:15.751 "impl_name": "ssl", 00:21:15.751 "recv_buf_size": 4096, 00:21:15.751 "send_buf_size": 4096, 00:21:15.751 "enable_recv_pipe": true, 00:21:15.751 "enable_quickack": false, 00:21:15.751 "enable_placement_id": 0, 00:21:15.751 "enable_zerocopy_send_server": true, 00:21:15.751 "enable_zerocopy_send_client": false, 00:21:15.751 "zerocopy_threshold": 0, 00:21:15.751 "tls_version": 0, 00:21:15.751 "enable_ktls": false 00:21:15.751 } 00:21:15.751 } 00:21:15.751 ] 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "subsystem": "vmd", 00:21:15.751 "config": [] 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "subsystem": "accel", 00:21:15.751 "config": [ 00:21:15.751 { 00:21:15.751 "method": "accel_set_options", 00:21:15.751 "params": { 00:21:15.751 "small_cache_size": 128, 00:21:15.751 "large_cache_size": 16, 00:21:15.751 "task_count": 2048, 00:21:15.751 "sequence_count": 2048, 00:21:15.751 "buf_count": 2048 00:21:15.751 } 00:21:15.751 } 00:21:15.751 ] 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "subsystem": "bdev", 00:21:15.751 "config": [ 00:21:15.751 { 00:21:15.751 "method": "bdev_set_options", 00:21:15.751 "params": { 00:21:15.751 "bdev_io_pool_size": 65535, 00:21:15.751 "bdev_io_cache_size": 256, 00:21:15.751 "bdev_auto_examine": true, 00:21:15.751 "iobuf_small_cache_size": 128, 00:21:15.751 "iobuf_large_cache_size": 16 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_raid_set_options", 00:21:15.751 "params": { 00:21:15.751 "process_window_size_kb": 1024 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_iscsi_set_options", 00:21:15.751 "params": { 00:21:15.751 "timeout_sec": 30 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_nvme_set_options", 00:21:15.751 "params": { 00:21:15.751 "action_on_timeout": "none", 00:21:15.751 "timeout_us": 0, 00:21:15.751 "timeout_admin_us": 0, 00:21:15.751 "keep_alive_timeout_ms": 10000, 00:21:15.751 "transport_retry_count": 4, 00:21:15.751 "arbitration_burst": 0, 00:21:15.751 "low_priority_weight": 0, 00:21:15.751 "medium_priority_weight": 0, 00:21:15.751 "high_priority_weight": 0, 00:21:15.751 "nvme_adminq_poll_period_us": 10000, 00:21:15.751 "nvme_ioq_poll_period_us": 0, 00:21:15.751 "io_queue_requests": 512, 00:21:15.751 "delay_cmd_submit": true, 00:21:15.751 "bdev_retry_count": 3, 00:21:15.751 "transport_ack_timeout": 0, 00:21:15.751 "ctrlr_loss_timeout_sec": 0, 00:21:15.751 "reconnect_delay_sec": 0, 00:21:15.751 "fast_io_fail_timeout_sec": 0, 00:21:15.751 "generate_uuids": false, 00:21:15.751 "transport_tos": 0, 00:21:15.751 "io_path_stat": false, 00:21:15.751 "allow_accel_sequence": false 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_nvme_attach_controller", 00:21:15.751 "params": { 00:21:15.751 "name": "TLSTEST", 00:21:15.751 "trtype": "TCP", 00:21:15.751 "adrfam": "IPv4", 00:21:15.751 "traddr": "10.0.0.2", 00:21:15.751 "trsvcid": "4420", 00:21:15.751 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:15.751 "prchk_reftag": false, 00:21:15.751 "prchk_guard": false, 00:21:15.751 "ctrlr_loss_timeout_sec": 0, 00:21:15.751 "reconnect_delay_sec": 0, 00:21:15.751 "fast_io_fail_timeout_sec": 0, 00:21:15.751 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:15.751 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:15.751 "hdgst": false, 00:21:15.751 "ddgst": false 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_nvme_set_hotplug", 00:21:15.751 "params": { 00:21:15.751 "period_us": 100000, 00:21:15.751 "enable": false 00:21:15.751 } 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "method": "bdev_wait_for_examine" 00:21:15.751 } 00:21:15.751 ] 00:21:15.751 }, 00:21:15.751 { 00:21:15.751 "subsystem": "nbd", 00:21:15.751 "config": [] 00:21:15.751 } 00:21:15.751 ] 00:21:15.751 }' 00:21:15.751 17:14:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:15.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:15.751 17:14:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:15.751 17:14:12 -- common/autotest_common.sh@10 -- # set +x 00:21:15.751 [2024-11-27 17:14:12.635266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:15.751 [2024-11-27 17:14:12.635334] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1775694 ] 00:21:15.751 EAL: No free 2048 kB hugepages reported on node 1 00:21:15.751 [2024-11-27 17:14:12.692177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:16.009 [2024-11-27 17:14:12.774424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:16.010 [2024-11-27 17:14:12.933740] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:16.943 17:14:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:16.943 17:14:13 -- common/autotest_common.sh@862 -- # return 0 00:21:16.943 17:14:13 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:16.943 Running I/O for 10 seconds... 00:21:27.000 00:21:27.000 Latency(us) 00:21:27.000 [2024-11-27T16:14:23.951Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:27.000 [2024-11-27T16:14:23.951Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:27.000 Verification LBA range: start 0x0 length 0x2000 00:21:27.000 TLSTESTn1 : 10.02 3390.10 13.24 0.00 0.00 37701.54 4830.25 51652.08 00:21:27.000 [2024-11-27T16:14:23.951Z] =================================================================================================================== 00:21:27.000 [2024-11-27T16:14:23.951Z] Total : 3390.10 13.24 0.00 0.00 37701.54 4830.25 51652.08 00:21:27.000 0 00:21:27.000 17:14:23 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:27.000 17:14:23 -- target/tls.sh@223 -- # killprocess 1775694 00:21:27.000 17:14:23 -- common/autotest_common.sh@936 -- # '[' -z 1775694 ']' 00:21:27.000 17:14:23 -- common/autotest_common.sh@940 -- # kill -0 1775694 00:21:27.000 17:14:23 -- common/autotest_common.sh@941 -- # uname 00:21:27.000 17:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:27.000 17:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1775694 00:21:27.000 17:14:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:27.000 17:14:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:27.000 17:14:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1775694' 00:21:27.000 killing process with pid 1775694 00:21:27.000 17:14:23 -- common/autotest_common.sh@955 -- # kill 1775694 00:21:27.000 Received shutdown signal, test time was about 10.000000 seconds 00:21:27.000 00:21:27.000 Latency(us) 00:21:27.000 [2024-11-27T16:14:23.951Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:27.000 [2024-11-27T16:14:23.951Z] =================================================================================================================== 00:21:27.000 [2024-11-27T16:14:23.951Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:27.000 17:14:23 -- common/autotest_common.sh@960 -- # wait 1775694 00:21:27.258 17:14:23 -- target/tls.sh@224 -- # killprocess 1775531 00:21:27.258 17:14:23 -- common/autotest_common.sh@936 -- # '[' -z 1775531 ']' 00:21:27.258 17:14:23 -- common/autotest_common.sh@940 -- # kill -0 1775531 00:21:27.258 17:14:23 -- common/autotest_common.sh@941 -- # uname 00:21:27.258 17:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:27.258 17:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1775531 00:21:27.258 17:14:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:27.258 17:14:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:27.258 17:14:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1775531' 00:21:27.258 killing process with pid 1775531 00:21:27.258 17:14:24 -- common/autotest_common.sh@955 -- # kill 1775531 00:21:27.258 17:14:24 -- common/autotest_common.sh@960 -- # wait 1775531 00:21:27.517 17:14:24 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:27.517 17:14:24 -- target/tls.sh@227 -- # cleanup 00:21:27.517 17:14:24 -- target/tls.sh@15 -- # process_shm --id 0 00:21:27.517 17:14:24 -- common/autotest_common.sh@806 -- # type=--id 00:21:27.517 17:14:24 -- common/autotest_common.sh@807 -- # id=0 00:21:27.517 17:14:24 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:27.517 17:14:24 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:27.517 17:14:24 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:27.517 17:14:24 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:27.517 17:14:24 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:27.517 17:14:24 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:27.517 nvmf_trace.0 00:21:27.517 17:14:24 -- common/autotest_common.sh@821 -- # return 0 00:21:27.517 17:14:24 -- target/tls.sh@16 -- # killprocess 1775694 00:21:27.517 17:14:24 -- common/autotest_common.sh@936 -- # '[' -z 1775694 ']' 00:21:27.517 17:14:24 -- common/autotest_common.sh@940 -- # kill -0 1775694 00:21:27.517 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1775694) - No such process 00:21:27.517 17:14:24 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1775694 is not found' 00:21:27.517 Process with pid 1775694 is not found 00:21:27.517 17:14:24 -- target/tls.sh@17 -- # nvmftestfini 00:21:27.517 17:14:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:27.517 17:14:24 -- nvmf/common.sh@116 -- # sync 00:21:27.517 17:14:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:27.517 17:14:24 -- nvmf/common.sh@119 -- # set +e 00:21:27.517 17:14:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:27.517 17:14:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:27.517 rmmod nvme_tcp 00:21:27.517 rmmod nvme_fabrics 00:21:27.517 rmmod nvme_keyring 00:21:27.517 17:14:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:27.517 17:14:24 -- nvmf/common.sh@123 -- # set -e 00:21:27.517 17:14:24 -- nvmf/common.sh@124 -- # return 0 00:21:27.517 17:14:24 -- nvmf/common.sh@477 -- # '[' -n 1775531 ']' 00:21:27.517 17:14:24 -- nvmf/common.sh@478 -- # killprocess 1775531 00:21:27.517 17:14:24 -- common/autotest_common.sh@936 -- # '[' -z 1775531 ']' 00:21:27.517 17:14:24 -- common/autotest_common.sh@940 -- # kill -0 1775531 00:21:27.517 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1775531) - No such process 00:21:27.517 17:14:24 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1775531 is not found' 00:21:27.517 Process with pid 1775531 is not found 00:21:27.517 17:14:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:27.517 17:14:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:27.517 17:14:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:27.517 17:14:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:27.517 17:14:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:27.517 17:14:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:27.517 17:14:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:27.517 17:14:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.054 17:14:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:30.054 17:14:26 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:30.054 00:21:30.054 real 1m14.810s 00:21:30.054 user 1m46.580s 00:21:30.054 sys 0m27.570s 00:21:30.054 17:14:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:30.054 17:14:26 -- common/autotest_common.sh@10 -- # set +x 00:21:30.054 ************************************ 00:21:30.054 END TEST nvmf_tls 00:21:30.054 ************************************ 00:21:30.054 17:14:26 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:30.054 17:14:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:30.054 17:14:26 -- common/autotest_common.sh@10 -- # set +x 00:21:30.054 ************************************ 00:21:30.054 START TEST nvmf_fips 00:21:30.054 ************************************ 00:21:30.054 17:14:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:30.054 * Looking for test storage... 00:21:30.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:30.054 17:14:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:30.054 17:14:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:30.054 17:14:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:30.054 17:14:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:30.054 17:14:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:30.054 17:14:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:30.054 17:14:26 -- scripts/common.sh@335 -- # IFS=.-: 00:21:30.054 17:14:26 -- scripts/common.sh@335 -- # read -ra ver1 00:21:30.054 17:14:26 -- scripts/common.sh@336 -- # IFS=.-: 00:21:30.054 17:14:26 -- scripts/common.sh@336 -- # read -ra ver2 00:21:30.054 17:14:26 -- scripts/common.sh@337 -- # local 'op=<' 00:21:30.054 17:14:26 -- scripts/common.sh@339 -- # ver1_l=2 00:21:30.054 17:14:26 -- scripts/common.sh@340 -- # ver2_l=1 00:21:30.054 17:14:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:30.054 17:14:26 -- scripts/common.sh@343 -- # case "$op" in 00:21:30.054 17:14:26 -- scripts/common.sh@344 -- # : 1 00:21:30.054 17:14:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:30.054 17:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:30.054 17:14:26 -- scripts/common.sh@364 -- # decimal 1 00:21:30.054 17:14:26 -- scripts/common.sh@352 -- # local d=1 00:21:30.054 17:14:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:30.054 17:14:26 -- scripts/common.sh@354 -- # echo 1 00:21:30.054 17:14:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:30.054 17:14:26 -- scripts/common.sh@365 -- # decimal 2 00:21:30.054 17:14:26 -- scripts/common.sh@352 -- # local d=2 00:21:30.054 17:14:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:30.054 17:14:26 -- scripts/common.sh@354 -- # echo 2 00:21:30.054 17:14:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:30.054 17:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:30.054 17:14:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:30.054 17:14:26 -- scripts/common.sh@367 -- # return 0 00:21:30.054 17:14:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:30.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.054 --rc genhtml_branch_coverage=1 00:21:30.054 --rc genhtml_function_coverage=1 00:21:30.054 --rc genhtml_legend=1 00:21:30.054 --rc geninfo_all_blocks=1 00:21:30.054 --rc geninfo_unexecuted_blocks=1 00:21:30.054 00:21:30.054 ' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:30.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.054 --rc genhtml_branch_coverage=1 00:21:30.054 --rc genhtml_function_coverage=1 00:21:30.054 --rc genhtml_legend=1 00:21:30.054 --rc geninfo_all_blocks=1 00:21:30.054 --rc geninfo_unexecuted_blocks=1 00:21:30.054 00:21:30.054 ' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:30.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.054 --rc genhtml_branch_coverage=1 00:21:30.054 --rc genhtml_function_coverage=1 00:21:30.054 --rc genhtml_legend=1 00:21:30.054 --rc geninfo_all_blocks=1 00:21:30.054 --rc geninfo_unexecuted_blocks=1 00:21:30.054 00:21:30.054 ' 00:21:30.054 17:14:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:30.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.054 --rc genhtml_branch_coverage=1 00:21:30.054 --rc genhtml_function_coverage=1 00:21:30.054 --rc genhtml_legend=1 00:21:30.054 --rc geninfo_all_blocks=1 00:21:30.054 --rc geninfo_unexecuted_blocks=1 00:21:30.054 00:21:30.054 ' 00:21:30.054 17:14:26 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:30.054 17:14:26 -- nvmf/common.sh@7 -- # uname -s 00:21:30.054 17:14:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:30.054 17:14:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:30.054 17:14:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:30.054 17:14:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:30.054 17:14:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:30.054 17:14:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:30.054 17:14:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:30.054 17:14:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:30.054 17:14:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:30.054 17:14:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:30.054 17:14:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:30.054 17:14:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:30.054 17:14:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:30.054 17:14:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:30.054 17:14:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:30.054 17:14:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:30.054 17:14:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:30.054 17:14:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:30.054 17:14:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:30.054 17:14:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.054 17:14:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.054 17:14:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.055 17:14:26 -- paths/export.sh@5 -- # export PATH 00:21:30.055 17:14:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.055 17:14:26 -- nvmf/common.sh@46 -- # : 0 00:21:30.055 17:14:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:30.055 17:14:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:30.055 17:14:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:30.055 17:14:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:30.055 17:14:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:30.055 17:14:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:30.055 17:14:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:30.055 17:14:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:30.055 17:14:26 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:30.055 17:14:26 -- fips/fips.sh@89 -- # check_openssl_version 00:21:30.055 17:14:26 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:30.055 17:14:26 -- fips/fips.sh@85 -- # openssl version 00:21:30.055 17:14:26 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:30.055 17:14:26 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:30.055 17:14:26 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:30.055 17:14:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:30.055 17:14:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:30.055 17:14:26 -- scripts/common.sh@335 -- # IFS=.-: 00:21:30.055 17:14:26 -- scripts/common.sh@335 -- # read -ra ver1 00:21:30.055 17:14:26 -- scripts/common.sh@336 -- # IFS=.-: 00:21:30.055 17:14:26 -- scripts/common.sh@336 -- # read -ra ver2 00:21:30.055 17:14:26 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:30.055 17:14:26 -- scripts/common.sh@339 -- # ver1_l=3 00:21:30.055 17:14:26 -- scripts/common.sh@340 -- # ver2_l=3 00:21:30.055 17:14:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:30.055 17:14:26 -- scripts/common.sh@343 -- # case "$op" in 00:21:30.055 17:14:26 -- scripts/common.sh@347 -- # : 1 00:21:30.055 17:14:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:30.055 17:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:30.055 17:14:26 -- scripts/common.sh@364 -- # decimal 3 00:21:30.055 17:14:26 -- scripts/common.sh@352 -- # local d=3 00:21:30.055 17:14:26 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:30.055 17:14:26 -- scripts/common.sh@354 -- # echo 3 00:21:30.055 17:14:26 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:30.055 17:14:26 -- scripts/common.sh@365 -- # decimal 3 00:21:30.055 17:14:26 -- scripts/common.sh@352 -- # local d=3 00:21:30.055 17:14:26 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:30.055 17:14:26 -- scripts/common.sh@354 -- # echo 3 00:21:30.055 17:14:26 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:30.055 17:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:30.055 17:14:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:30.055 17:14:26 -- scripts/common.sh@363 -- # (( v++ )) 00:21:30.055 17:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:30.055 17:14:26 -- scripts/common.sh@364 -- # decimal 1 00:21:30.055 17:14:26 -- scripts/common.sh@352 -- # local d=1 00:21:30.055 17:14:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:30.055 17:14:26 -- scripts/common.sh@354 -- # echo 1 00:21:30.055 17:14:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:30.055 17:14:26 -- scripts/common.sh@365 -- # decimal 0 00:21:30.055 17:14:26 -- scripts/common.sh@352 -- # local d=0 00:21:30.055 17:14:26 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:30.055 17:14:26 -- scripts/common.sh@354 -- # echo 0 00:21:30.055 17:14:26 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:30.055 17:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:30.055 17:14:26 -- scripts/common.sh@366 -- # return 0 00:21:30.055 17:14:26 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:30.055 17:14:26 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:30.055 17:14:26 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:30.055 17:14:26 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:30.055 17:14:26 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:30.055 17:14:26 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:30.055 17:14:26 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:30.055 17:14:26 -- fips/fips.sh@113 -- # build_openssl_config 00:21:30.055 17:14:26 -- fips/fips.sh@37 -- # cat 00:21:30.055 17:14:26 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:30.055 17:14:26 -- fips/fips.sh@58 -- # cat - 00:21:30.055 17:14:26 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:30.055 17:14:26 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:30.055 17:14:26 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:30.055 17:14:26 -- fips/fips.sh@116 -- # openssl list -providers 00:21:30.055 17:14:26 -- fips/fips.sh@116 -- # grep name 00:21:30.055 17:14:26 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:30.055 17:14:26 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:30.055 17:14:26 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:30.055 17:14:26 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:30.055 17:14:26 -- fips/fips.sh@127 -- # : 00:21:30.055 17:14:26 -- common/autotest_common.sh@650 -- # local es=0 00:21:30.055 17:14:26 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:30.055 17:14:26 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:30.055 17:14:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:30.055 17:14:26 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:30.055 17:14:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:30.055 17:14:26 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:30.055 17:14:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:30.055 17:14:26 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:30.055 17:14:26 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:30.055 17:14:26 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:30.055 Error setting digest 00:21:30.055 40A2CBB64F7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:30.055 40A2CBB64F7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:30.055 17:14:26 -- common/autotest_common.sh@653 -- # es=1 00:21:30.055 17:14:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:30.055 17:14:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:30.055 17:14:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:30.055 17:14:26 -- fips/fips.sh@130 -- # nvmftestinit 00:21:30.055 17:14:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:30.055 17:14:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:30.055 17:14:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:30.055 17:14:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:30.055 17:14:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:30.055 17:14:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.055 17:14:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.055 17:14:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.055 17:14:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:30.055 17:14:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:30.055 17:14:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:30.055 17:14:26 -- common/autotest_common.sh@10 -- # set +x 00:21:31.961 17:14:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:31.961 17:14:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:31.961 17:14:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:31.961 17:14:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:31.961 17:14:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:31.961 17:14:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:31.961 17:14:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:31.961 17:14:28 -- nvmf/common.sh@294 -- # net_devs=() 00:21:31.961 17:14:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:31.961 17:14:28 -- nvmf/common.sh@295 -- # e810=() 00:21:31.961 17:14:28 -- nvmf/common.sh@295 -- # local -ga e810 00:21:31.961 17:14:28 -- nvmf/common.sh@296 -- # x722=() 00:21:31.961 17:14:28 -- nvmf/common.sh@296 -- # local -ga x722 00:21:31.961 17:14:28 -- nvmf/common.sh@297 -- # mlx=() 00:21:31.961 17:14:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:31.961 17:14:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:31.961 17:14:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:31.961 17:14:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:31.961 17:14:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:31.961 17:14:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:31.961 17:14:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:31.961 17:14:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:31.961 17:14:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.961 17:14:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:31.961 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:31.961 17:14:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.961 17:14:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.961 17:14:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.962 17:14:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:31.962 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:31.962 17:14:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:31.962 17:14:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.962 17:14:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.962 17:14:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.962 17:14:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.962 17:14:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:31.962 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:31.962 17:14:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.962 17:14:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.962 17:14:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.962 17:14:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.962 17:14:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.962 17:14:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:31.962 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:31.962 17:14:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.962 17:14:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:31.962 17:14:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:31.962 17:14:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:31.962 17:14:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:31.962 17:14:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:31.962 17:14:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:31.962 17:14:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:31.962 17:14:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:31.962 17:14:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:31.962 17:14:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:31.962 17:14:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:31.962 17:14:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:31.962 17:14:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:31.962 17:14:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:31.962 17:14:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:31.962 17:14:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:31.962 17:14:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:31.962 17:14:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:31.962 17:14:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:31.962 17:14:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:31.962 17:14:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:31.962 17:14:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:31.962 17:14:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:31.962 17:14:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:31.962 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:31.962 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:21:31.962 00:21:31.962 --- 10.0.0.2 ping statistics --- 00:21:31.962 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:31.962 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:21:32.220 17:14:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:32.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:32.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:21:32.220 00:21:32.220 --- 10.0.0.1 ping statistics --- 00:21:32.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:32.220 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:21:32.220 17:14:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:32.220 17:14:28 -- nvmf/common.sh@410 -- # return 0 00:21:32.220 17:14:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:32.220 17:14:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:32.220 17:14:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:32.220 17:14:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:32.220 17:14:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:32.220 17:14:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:32.220 17:14:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:32.220 17:14:28 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:32.220 17:14:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:32.220 17:14:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:32.220 17:14:28 -- common/autotest_common.sh@10 -- # set +x 00:21:32.220 17:14:28 -- nvmf/common.sh@469 -- # nvmfpid=1779030 00:21:32.220 17:14:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:32.220 17:14:28 -- nvmf/common.sh@470 -- # waitforlisten 1779030 00:21:32.220 17:14:28 -- common/autotest_common.sh@829 -- # '[' -z 1779030 ']' 00:21:32.220 17:14:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:32.220 17:14:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:32.220 17:14:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:32.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:32.220 17:14:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:32.220 17:14:28 -- common/autotest_common.sh@10 -- # set +x 00:21:32.220 [2024-11-27 17:14:29.014160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:32.221 [2024-11-27 17:14:29.014248] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:32.221 EAL: No free 2048 kB hugepages reported on node 1 00:21:32.221 [2024-11-27 17:14:29.076863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:32.221 [2024-11-27 17:14:29.159559] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:32.221 [2024-11-27 17:14:29.159740] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:32.221 [2024-11-27 17:14:29.159757] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:32.221 [2024-11-27 17:14:29.159770] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:32.221 [2024-11-27 17:14:29.159807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:33.153 17:14:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:33.153 17:14:29 -- common/autotest_common.sh@862 -- # return 0 00:21:33.153 17:14:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:33.153 17:14:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:33.153 17:14:29 -- common/autotest_common.sh@10 -- # set +x 00:21:33.153 17:14:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:33.153 17:14:29 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:33.153 17:14:30 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:33.153 17:14:30 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:33.153 17:14:30 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:33.153 17:14:30 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:33.153 17:14:30 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:33.153 17:14:30 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:33.153 17:14:30 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:33.411 [2024-11-27 17:14:30.286209] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:33.411 [2024-11-27 17:14:30.302180] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:33.411 [2024-11-27 17:14:30.302420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:33.411 malloc0 00:21:33.411 17:14:30 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:33.411 17:14:30 -- fips/fips.sh@147 -- # bdevperf_pid=1779192 00:21:33.411 17:14:30 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:33.412 17:14:30 -- fips/fips.sh@148 -- # waitforlisten 1779192 /var/tmp/bdevperf.sock 00:21:33.412 17:14:30 -- common/autotest_common.sh@829 -- # '[' -z 1779192 ']' 00:21:33.412 17:14:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:33.412 17:14:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:33.412 17:14:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:33.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:33.412 17:14:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:33.412 17:14:30 -- common/autotest_common.sh@10 -- # set +x 00:21:33.670 [2024-11-27 17:14:30.421710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:33.670 [2024-11-27 17:14:30.421795] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1779192 ] 00:21:33.670 EAL: No free 2048 kB hugepages reported on node 1 00:21:33.670 [2024-11-27 17:14:30.482365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:33.670 [2024-11-27 17:14:30.573219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:34.603 17:14:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:34.603 17:14:31 -- common/autotest_common.sh@862 -- # return 0 00:21:34.603 17:14:31 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:34.861 [2024-11-27 17:14:31.725982] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:34.861 TLSTESTn1 00:21:35.120 17:14:31 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:35.120 Running I/O for 10 seconds... 00:21:45.093 00:21:45.093 Latency(us) 00:21:45.093 [2024-11-27T16:14:42.044Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:45.093 [2024-11-27T16:14:42.044Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:45.093 Verification LBA range: start 0x0 length 0x2000 00:21:45.093 TLSTESTn1 : 10.02 4426.66 17.29 0.00 0.00 28874.16 5315.70 42913.94 00:21:45.093 [2024-11-27T16:14:42.044Z] =================================================================================================================== 00:21:45.093 [2024-11-27T16:14:42.044Z] Total : 4426.66 17.29 0.00 0.00 28874.16 5315.70 42913.94 00:21:45.093 0 00:21:45.093 17:14:41 -- fips/fips.sh@1 -- # cleanup 00:21:45.093 17:14:41 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:45.093 17:14:41 -- common/autotest_common.sh@806 -- # type=--id 00:21:45.093 17:14:41 -- common/autotest_common.sh@807 -- # id=0 00:21:45.093 17:14:41 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:45.093 17:14:41 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:45.093 17:14:41 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:45.093 17:14:41 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:45.093 17:14:41 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:45.093 17:14:41 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:45.093 nvmf_trace.0 00:21:45.093 17:14:42 -- common/autotest_common.sh@821 -- # return 0 00:21:45.093 17:14:42 -- fips/fips.sh@16 -- # killprocess 1779192 00:21:45.093 17:14:42 -- common/autotest_common.sh@936 -- # '[' -z 1779192 ']' 00:21:45.093 17:14:42 -- common/autotest_common.sh@940 -- # kill -0 1779192 00:21:45.093 17:14:42 -- common/autotest_common.sh@941 -- # uname 00:21:45.093 17:14:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:45.093 17:14:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1779192 00:21:45.352 17:14:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:45.352 17:14:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:45.352 17:14:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1779192' 00:21:45.352 killing process with pid 1779192 00:21:45.352 17:14:42 -- common/autotest_common.sh@955 -- # kill 1779192 00:21:45.352 Received shutdown signal, test time was about 10.000000 seconds 00:21:45.352 00:21:45.352 Latency(us) 00:21:45.352 [2024-11-27T16:14:42.303Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:45.352 [2024-11-27T16:14:42.303Z] =================================================================================================================== 00:21:45.352 [2024-11-27T16:14:42.303Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:45.352 17:14:42 -- common/autotest_common.sh@960 -- # wait 1779192 00:21:45.352 17:14:42 -- fips/fips.sh@17 -- # nvmftestfini 00:21:45.352 17:14:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:45.352 17:14:42 -- nvmf/common.sh@116 -- # sync 00:21:45.352 17:14:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:45.352 17:14:42 -- nvmf/common.sh@119 -- # set +e 00:21:45.352 17:14:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:45.352 17:14:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:45.352 rmmod nvme_tcp 00:21:45.352 rmmod nvme_fabrics 00:21:45.610 rmmod nvme_keyring 00:21:45.610 17:14:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:45.610 17:14:42 -- nvmf/common.sh@123 -- # set -e 00:21:45.610 17:14:42 -- nvmf/common.sh@124 -- # return 0 00:21:45.610 17:14:42 -- nvmf/common.sh@477 -- # '[' -n 1779030 ']' 00:21:45.610 17:14:42 -- nvmf/common.sh@478 -- # killprocess 1779030 00:21:45.610 17:14:42 -- common/autotest_common.sh@936 -- # '[' -z 1779030 ']' 00:21:45.610 17:14:42 -- common/autotest_common.sh@940 -- # kill -0 1779030 00:21:45.610 17:14:42 -- common/autotest_common.sh@941 -- # uname 00:21:45.610 17:14:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:45.610 17:14:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1779030 00:21:45.610 17:14:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:45.610 17:14:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:45.610 17:14:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1779030' 00:21:45.610 killing process with pid 1779030 00:21:45.610 17:14:42 -- common/autotest_common.sh@955 -- # kill 1779030 00:21:45.610 17:14:42 -- common/autotest_common.sh@960 -- # wait 1779030 00:21:45.869 17:14:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:45.869 17:14:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:45.869 17:14:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:45.869 17:14:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:45.869 17:14:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:45.869 17:14:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.869 17:14:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:45.869 17:14:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:47.778 17:14:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:47.778 17:14:44 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:47.778 00:21:47.778 real 0m18.240s 00:21:47.778 user 0m23.483s 00:21:47.778 sys 0m6.210s 00:21:47.778 17:14:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:47.778 17:14:44 -- common/autotest_common.sh@10 -- # set +x 00:21:47.778 ************************************ 00:21:47.778 END TEST nvmf_fips 00:21:47.778 ************************************ 00:21:47.778 17:14:44 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:47.778 17:14:44 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:47.778 17:14:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:47.778 17:14:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:47.778 17:14:44 -- common/autotest_common.sh@10 -- # set +x 00:21:47.778 ************************************ 00:21:47.778 START TEST nvmf_fuzz 00:21:47.778 ************************************ 00:21:47.778 17:14:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:48.037 * Looking for test storage... 00:21:48.037 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:48.037 17:14:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:48.037 17:14:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:48.037 17:14:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:48.037 17:14:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:48.037 17:14:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:48.037 17:14:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:48.037 17:14:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:48.037 17:14:44 -- scripts/common.sh@335 -- # IFS=.-: 00:21:48.037 17:14:44 -- scripts/common.sh@335 -- # read -ra ver1 00:21:48.037 17:14:44 -- scripts/common.sh@336 -- # IFS=.-: 00:21:48.037 17:14:44 -- scripts/common.sh@336 -- # read -ra ver2 00:21:48.037 17:14:44 -- scripts/common.sh@337 -- # local 'op=<' 00:21:48.037 17:14:44 -- scripts/common.sh@339 -- # ver1_l=2 00:21:48.038 17:14:44 -- scripts/common.sh@340 -- # ver2_l=1 00:21:48.038 17:14:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:48.038 17:14:44 -- scripts/common.sh@343 -- # case "$op" in 00:21:48.038 17:14:44 -- scripts/common.sh@344 -- # : 1 00:21:48.038 17:14:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:48.038 17:14:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:48.038 17:14:44 -- scripts/common.sh@364 -- # decimal 1 00:21:48.038 17:14:44 -- scripts/common.sh@352 -- # local d=1 00:21:48.038 17:14:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:48.038 17:14:44 -- scripts/common.sh@354 -- # echo 1 00:21:48.038 17:14:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:48.038 17:14:44 -- scripts/common.sh@365 -- # decimal 2 00:21:48.038 17:14:44 -- scripts/common.sh@352 -- # local d=2 00:21:48.038 17:14:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:48.038 17:14:44 -- scripts/common.sh@354 -- # echo 2 00:21:48.038 17:14:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:48.038 17:14:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:48.038 17:14:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:48.038 17:14:44 -- scripts/common.sh@367 -- # return 0 00:21:48.038 17:14:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:48.038 17:14:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:48.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.038 --rc genhtml_branch_coverage=1 00:21:48.038 --rc genhtml_function_coverage=1 00:21:48.038 --rc genhtml_legend=1 00:21:48.038 --rc geninfo_all_blocks=1 00:21:48.038 --rc geninfo_unexecuted_blocks=1 00:21:48.038 00:21:48.038 ' 00:21:48.038 17:14:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:48.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.038 --rc genhtml_branch_coverage=1 00:21:48.038 --rc genhtml_function_coverage=1 00:21:48.038 --rc genhtml_legend=1 00:21:48.038 --rc geninfo_all_blocks=1 00:21:48.038 --rc geninfo_unexecuted_blocks=1 00:21:48.038 00:21:48.038 ' 00:21:48.038 17:14:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:48.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.038 --rc genhtml_branch_coverage=1 00:21:48.038 --rc genhtml_function_coverage=1 00:21:48.038 --rc genhtml_legend=1 00:21:48.038 --rc geninfo_all_blocks=1 00:21:48.038 --rc geninfo_unexecuted_blocks=1 00:21:48.038 00:21:48.038 ' 00:21:48.038 17:14:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:48.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.038 --rc genhtml_branch_coverage=1 00:21:48.038 --rc genhtml_function_coverage=1 00:21:48.038 --rc genhtml_legend=1 00:21:48.038 --rc geninfo_all_blocks=1 00:21:48.038 --rc geninfo_unexecuted_blocks=1 00:21:48.038 00:21:48.038 ' 00:21:48.038 17:14:44 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:48.038 17:14:44 -- nvmf/common.sh@7 -- # uname -s 00:21:48.038 17:14:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:48.038 17:14:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:48.038 17:14:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:48.038 17:14:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:48.038 17:14:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:48.038 17:14:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:48.038 17:14:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:48.038 17:14:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:48.038 17:14:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:48.038 17:14:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:48.038 17:14:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.038 17:14:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.038 17:14:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:48.038 17:14:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:48.038 17:14:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:48.038 17:14:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:48.038 17:14:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:48.038 17:14:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:48.038 17:14:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:48.038 17:14:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.038 17:14:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.038 17:14:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.038 17:14:44 -- paths/export.sh@5 -- # export PATH 00:21:48.038 17:14:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.038 17:14:44 -- nvmf/common.sh@46 -- # : 0 00:21:48.038 17:14:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:48.038 17:14:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:48.038 17:14:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:48.038 17:14:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:48.038 17:14:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:48.038 17:14:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:48.038 17:14:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:48.038 17:14:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:48.038 17:14:44 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:48.038 17:14:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:48.038 17:14:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.038 17:14:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:48.038 17:14:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:48.038 17:14:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:48.038 17:14:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.038 17:14:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:48.038 17:14:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.038 17:14:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:48.038 17:14:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:48.038 17:14:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:48.038 17:14:44 -- common/autotest_common.sh@10 -- # set +x 00:21:50.571 17:14:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:50.571 17:14:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:50.571 17:14:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:50.571 17:14:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:50.571 17:14:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:50.571 17:14:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:50.571 17:14:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:50.571 17:14:46 -- nvmf/common.sh@294 -- # net_devs=() 00:21:50.571 17:14:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:50.571 17:14:46 -- nvmf/common.sh@295 -- # e810=() 00:21:50.571 17:14:46 -- nvmf/common.sh@295 -- # local -ga e810 00:21:50.571 17:14:46 -- nvmf/common.sh@296 -- # x722=() 00:21:50.571 17:14:46 -- nvmf/common.sh@296 -- # local -ga x722 00:21:50.571 17:14:46 -- nvmf/common.sh@297 -- # mlx=() 00:21:50.571 17:14:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:50.571 17:14:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:50.571 17:14:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:50.571 17:14:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:50.571 17:14:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.571 17:14:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:50.571 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:50.571 17:14:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.571 17:14:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:50.571 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:50.571 17:14:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.571 17:14:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.571 17:14:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.571 17:14:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:50.571 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:50.571 17:14:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.571 17:14:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.571 17:14:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.571 17:14:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.571 17:14:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:50.571 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:50.571 17:14:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.571 17:14:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:50.571 17:14:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:50.571 17:14:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:50.571 17:14:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:50.571 17:14:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:50.571 17:14:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:50.571 17:14:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:50.571 17:14:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:50.571 17:14:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:50.571 17:14:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:50.571 17:14:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:50.571 17:14:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:50.571 17:14:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:50.571 17:14:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:50.571 17:14:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:50.571 17:14:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:50.571 17:14:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:50.571 17:14:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:50.571 17:14:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:50.571 17:14:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:50.571 17:14:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:50.571 17:14:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:50.571 17:14:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:50.571 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:50.571 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:21:50.571 00:21:50.571 --- 10.0.0.2 ping statistics --- 00:21:50.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.571 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:21:50.571 17:14:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:50.571 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:50.571 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:21:50.571 00:21:50.571 --- 10.0.0.1 ping statistics --- 00:21:50.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.571 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:21:50.571 17:14:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:50.571 17:14:47 -- nvmf/common.sh@410 -- # return 0 00:21:50.571 17:14:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:50.571 17:14:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:50.571 17:14:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:50.571 17:14:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:50.571 17:14:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:50.571 17:14:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:50.571 17:14:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:50.571 17:14:47 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1782635 00:21:50.571 17:14:47 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:50.571 17:14:47 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:50.571 17:14:47 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1782635 00:21:50.571 17:14:47 -- common/autotest_common.sh@829 -- # '[' -z 1782635 ']' 00:21:50.571 17:14:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:50.571 17:14:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:50.571 17:14:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:50.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:50.571 17:14:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:50.571 17:14:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.139 17:14:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:51.139 17:14:48 -- common/autotest_common.sh@862 -- # return 0 00:21:51.139 17:14:48 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:51.139 17:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.139 17:14:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.139 17:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.139 17:14:48 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:51.139 17:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.139 17:14:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.398 Malloc0 00:21:51.398 17:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.398 17:14:48 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:51.398 17:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.398 17:14:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.398 17:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.399 17:14:48 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:51.399 17:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.399 17:14:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.399 17:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.399 17:14:48 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:51.399 17:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.399 17:14:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.399 17:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.399 17:14:48 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:51.399 17:14:48 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:23.464 Fuzzing completed. Shutting down the fuzz application 00:22:23.464 00:22:23.464 Dumping successful admin opcodes: 00:22:23.464 8, 9, 10, 24, 00:22:23.464 Dumping successful io opcodes: 00:22:23.464 0, 9, 00:22:23.464 NS: 0x200003aeff00 I/O qp, Total commands completed: 469900, total successful commands: 2711, random_seed: 2585496896 00:22:23.464 NS: 0x200003aeff00 admin qp, Total commands completed: 57040, total successful commands: 454, random_seed: 2263656448 00:22:23.464 17:15:18 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:23.464 Fuzzing completed. Shutting down the fuzz application 00:22:23.464 00:22:23.464 Dumping successful admin opcodes: 00:22:23.464 24, 00:22:23.464 Dumping successful io opcodes: 00:22:23.464 00:22:23.464 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2256429701 00:22:23.464 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2256568297 00:22:23.464 17:15:20 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:23.464 17:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:23.464 17:15:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.464 17:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:23.464 17:15:20 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:23.464 17:15:20 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:23.464 17:15:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:23.464 17:15:20 -- nvmf/common.sh@116 -- # sync 00:22:23.464 17:15:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:23.464 17:15:20 -- nvmf/common.sh@119 -- # set +e 00:22:23.464 17:15:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:23.464 17:15:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:23.464 rmmod nvme_tcp 00:22:23.464 rmmod nvme_fabrics 00:22:23.464 rmmod nvme_keyring 00:22:23.464 17:15:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:23.464 17:15:20 -- nvmf/common.sh@123 -- # set -e 00:22:23.464 17:15:20 -- nvmf/common.sh@124 -- # return 0 00:22:23.464 17:15:20 -- nvmf/common.sh@477 -- # '[' -n 1782635 ']' 00:22:23.464 17:15:20 -- nvmf/common.sh@478 -- # killprocess 1782635 00:22:23.464 17:15:20 -- common/autotest_common.sh@936 -- # '[' -z 1782635 ']' 00:22:23.464 17:15:20 -- common/autotest_common.sh@940 -- # kill -0 1782635 00:22:23.464 17:15:20 -- common/autotest_common.sh@941 -- # uname 00:22:23.464 17:15:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:23.464 17:15:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1782635 00:22:23.464 17:15:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:23.464 17:15:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:23.464 17:15:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1782635' 00:22:23.464 killing process with pid 1782635 00:22:23.464 17:15:20 -- common/autotest_common.sh@955 -- # kill 1782635 00:22:23.464 17:15:20 -- common/autotest_common.sh@960 -- # wait 1782635 00:22:23.464 17:15:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:23.464 17:15:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:23.464 17:15:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:23.464 17:15:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:23.464 17:15:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:23.464 17:15:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.464 17:15:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.464 17:15:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:26.000 17:15:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:26.000 17:15:22 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:26.000 00:22:26.000 real 0m37.736s 00:22:26.000 user 0m52.380s 00:22:26.000 sys 0m15.304s 00:22:26.000 17:15:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:26.000 17:15:22 -- common/autotest_common.sh@10 -- # set +x 00:22:26.000 ************************************ 00:22:26.000 END TEST nvmf_fuzz 00:22:26.000 ************************************ 00:22:26.000 17:15:22 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:26.000 17:15:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:26.000 17:15:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:26.000 17:15:22 -- common/autotest_common.sh@10 -- # set +x 00:22:26.001 ************************************ 00:22:26.001 START TEST nvmf_multiconnection 00:22:26.001 ************************************ 00:22:26.001 17:15:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:26.001 * Looking for test storage... 00:22:26.001 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:26.001 17:15:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:26.001 17:15:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:26.001 17:15:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:26.001 17:15:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:26.001 17:15:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:26.001 17:15:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:26.001 17:15:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:26.001 17:15:22 -- scripts/common.sh@335 -- # IFS=.-: 00:22:26.001 17:15:22 -- scripts/common.sh@335 -- # read -ra ver1 00:22:26.001 17:15:22 -- scripts/common.sh@336 -- # IFS=.-: 00:22:26.001 17:15:22 -- scripts/common.sh@336 -- # read -ra ver2 00:22:26.001 17:15:22 -- scripts/common.sh@337 -- # local 'op=<' 00:22:26.001 17:15:22 -- scripts/common.sh@339 -- # ver1_l=2 00:22:26.001 17:15:22 -- scripts/common.sh@340 -- # ver2_l=1 00:22:26.001 17:15:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:26.001 17:15:22 -- scripts/common.sh@343 -- # case "$op" in 00:22:26.001 17:15:22 -- scripts/common.sh@344 -- # : 1 00:22:26.001 17:15:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:26.001 17:15:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:26.001 17:15:22 -- scripts/common.sh@364 -- # decimal 1 00:22:26.001 17:15:22 -- scripts/common.sh@352 -- # local d=1 00:22:26.001 17:15:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:26.001 17:15:22 -- scripts/common.sh@354 -- # echo 1 00:22:26.001 17:15:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:26.001 17:15:22 -- scripts/common.sh@365 -- # decimal 2 00:22:26.001 17:15:22 -- scripts/common.sh@352 -- # local d=2 00:22:26.001 17:15:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:26.001 17:15:22 -- scripts/common.sh@354 -- # echo 2 00:22:26.001 17:15:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:26.001 17:15:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:26.001 17:15:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:26.001 17:15:22 -- scripts/common.sh@367 -- # return 0 00:22:26.001 17:15:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:26.001 17:15:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:26.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.001 --rc genhtml_branch_coverage=1 00:22:26.001 --rc genhtml_function_coverage=1 00:22:26.001 --rc genhtml_legend=1 00:22:26.001 --rc geninfo_all_blocks=1 00:22:26.001 --rc geninfo_unexecuted_blocks=1 00:22:26.001 00:22:26.001 ' 00:22:26.001 17:15:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:26.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.001 --rc genhtml_branch_coverage=1 00:22:26.001 --rc genhtml_function_coverage=1 00:22:26.001 --rc genhtml_legend=1 00:22:26.001 --rc geninfo_all_blocks=1 00:22:26.001 --rc geninfo_unexecuted_blocks=1 00:22:26.001 00:22:26.001 ' 00:22:26.001 17:15:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:26.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.001 --rc genhtml_branch_coverage=1 00:22:26.001 --rc genhtml_function_coverage=1 00:22:26.001 --rc genhtml_legend=1 00:22:26.001 --rc geninfo_all_blocks=1 00:22:26.001 --rc geninfo_unexecuted_blocks=1 00:22:26.001 00:22:26.001 ' 00:22:26.001 17:15:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:26.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.001 --rc genhtml_branch_coverage=1 00:22:26.001 --rc genhtml_function_coverage=1 00:22:26.001 --rc genhtml_legend=1 00:22:26.001 --rc geninfo_all_blocks=1 00:22:26.001 --rc geninfo_unexecuted_blocks=1 00:22:26.001 00:22:26.001 ' 00:22:26.001 17:15:22 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:26.001 17:15:22 -- nvmf/common.sh@7 -- # uname -s 00:22:26.001 17:15:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:26.001 17:15:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:26.001 17:15:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:26.001 17:15:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:26.001 17:15:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:26.001 17:15:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:26.001 17:15:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:26.001 17:15:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:26.001 17:15:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:26.001 17:15:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:26.001 17:15:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:26.001 17:15:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:26.001 17:15:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:26.001 17:15:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:26.001 17:15:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:26.001 17:15:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:26.001 17:15:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:26.001 17:15:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:26.001 17:15:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:26.001 17:15:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.001 17:15:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.001 17:15:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.001 17:15:22 -- paths/export.sh@5 -- # export PATH 00:22:26.001 17:15:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.001 17:15:22 -- nvmf/common.sh@46 -- # : 0 00:22:26.001 17:15:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:26.001 17:15:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:26.001 17:15:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:26.001 17:15:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:26.001 17:15:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:26.001 17:15:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:26.002 17:15:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:26.002 17:15:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:26.002 17:15:22 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:26.002 17:15:22 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:26.002 17:15:22 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:26.002 17:15:22 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:26.002 17:15:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:26.002 17:15:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:26.002 17:15:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:26.002 17:15:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:26.002 17:15:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:26.002 17:15:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:26.002 17:15:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:26.002 17:15:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:26.002 17:15:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:26.002 17:15:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:26.002 17:15:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:26.002 17:15:22 -- common/autotest_common.sh@10 -- # set +x 00:22:27.969 17:15:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:27.969 17:15:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:27.969 17:15:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:27.969 17:15:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:27.969 17:15:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:27.969 17:15:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:27.969 17:15:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:27.969 17:15:24 -- nvmf/common.sh@294 -- # net_devs=() 00:22:27.969 17:15:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:27.969 17:15:24 -- nvmf/common.sh@295 -- # e810=() 00:22:27.969 17:15:24 -- nvmf/common.sh@295 -- # local -ga e810 00:22:27.969 17:15:24 -- nvmf/common.sh@296 -- # x722=() 00:22:27.969 17:15:24 -- nvmf/common.sh@296 -- # local -ga x722 00:22:27.969 17:15:24 -- nvmf/common.sh@297 -- # mlx=() 00:22:27.969 17:15:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:27.969 17:15:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:27.969 17:15:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.969 17:15:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:27.969 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:27.969 17:15:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.969 17:15:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:27.969 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:27.969 17:15:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.969 17:15:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.969 17:15:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.969 17:15:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:27.969 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:27.969 17:15:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.969 17:15:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.969 17:15:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.969 17:15:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:27.969 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:27.969 17:15:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:27.969 17:15:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:27.969 17:15:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:27.969 17:15:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:27.969 17:15:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:27.969 17:15:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:27.969 17:15:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:27.969 17:15:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:27.969 17:15:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:27.969 17:15:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:27.969 17:15:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:27.969 17:15:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:27.969 17:15:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:27.969 17:15:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:27.969 17:15:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:27.969 17:15:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:27.969 17:15:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:27.969 17:15:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:27.969 17:15:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:27.969 17:15:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:27.969 17:15:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:27.969 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:27.969 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:22:27.969 00:22:27.969 --- 10.0.0.2 ping statistics --- 00:22:27.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.969 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:22:27.969 17:15:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:27.969 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:27.969 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:22:27.969 00:22:27.969 --- 10.0.0.1 ping statistics --- 00:22:27.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.969 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:22:27.969 17:15:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:27.969 17:15:24 -- nvmf/common.sh@410 -- # return 0 00:22:27.969 17:15:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:27.969 17:15:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:27.969 17:15:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:27.969 17:15:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:27.969 17:15:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:27.969 17:15:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:27.969 17:15:24 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:27.969 17:15:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:27.969 17:15:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:27.969 17:15:24 -- common/autotest_common.sh@10 -- # set +x 00:22:27.969 17:15:24 -- nvmf/common.sh@469 -- # nvmfpid=1789126 00:22:27.969 17:15:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:27.969 17:15:24 -- nvmf/common.sh@470 -- # waitforlisten 1789126 00:22:27.969 17:15:24 -- common/autotest_common.sh@829 -- # '[' -z 1789126 ']' 00:22:27.969 17:15:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:27.969 17:15:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:27.969 17:15:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:27.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:27.969 17:15:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:27.969 17:15:24 -- common/autotest_common.sh@10 -- # set +x 00:22:27.969 [2024-11-27 17:15:24.893036] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:27.969 [2024-11-27 17:15:24.893109] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:28.228 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.228 [2024-11-27 17:15:24.979952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:28.228 [2024-11-27 17:15:25.078254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:28.228 [2024-11-27 17:15:25.078415] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:28.228 [2024-11-27 17:15:25.078435] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:28.229 [2024-11-27 17:15:25.078450] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:28.229 [2024-11-27 17:15:25.078517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:28.229 [2024-11-27 17:15:25.078577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:28.229 [2024-11-27 17:15:25.078632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:28.229 [2024-11-27 17:15:25.078635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:29.162 17:15:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:29.162 17:15:25 -- common/autotest_common.sh@862 -- # return 0 00:22:29.162 17:15:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:29.162 17:15:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:29.162 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:29.163 17:15:25 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 [2024-11-27 17:15:25.873067] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:29.163 17:15:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.163 17:15:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 Malloc1 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 [2024-11-27 17:15:25.929658] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.163 17:15:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 Malloc2 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.163 17:15:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:29.163 17:15:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 Malloc3 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.163 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 Malloc4 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.163 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 Malloc5 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.163 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.163 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:29.163 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.163 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.422 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 Malloc6 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.422 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 Malloc7 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.422 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 Malloc8 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.422 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 Malloc9 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.422 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:29.422 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.422 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.422 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.423 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:29.423 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.423 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.423 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.423 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:29.423 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.423 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.423 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.423 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.423 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:29.423 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.423 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.423 Malloc10 00:22:29.423 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.423 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:29.423 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.423 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.423 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.423 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:29.423 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.423 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:29.682 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.682 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.682 17:15:26 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:29.682 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.682 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 Malloc11 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:29.682 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.682 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:29.682 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.682 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:29.682 17:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.682 17:15:26 -- common/autotest_common.sh@10 -- # set +x 00:22:29.682 17:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.682 17:15:26 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:29.682 17:15:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.682 17:15:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:30.248 17:15:27 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:30.248 17:15:27 -- common/autotest_common.sh@1187 -- # local i=0 00:22:30.248 17:15:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:30.248 17:15:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:30.248 17:15:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:32.147 17:15:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:32.147 17:15:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:32.147 17:15:29 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:32.147 17:15:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:32.147 17:15:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:32.147 17:15:29 -- common/autotest_common.sh@1197 -- # return 0 00:22:32.147 17:15:29 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:32.147 17:15:29 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:32.725 17:15:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:32.725 17:15:29 -- common/autotest_common.sh@1187 -- # local i=0 00:22:32.725 17:15:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:32.725 17:15:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:32.725 17:15:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:35.249 17:15:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:35.249 17:15:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:35.249 17:15:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:35.249 17:15:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:35.249 17:15:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:35.249 17:15:31 -- common/autotest_common.sh@1197 -- # return 0 00:22:35.249 17:15:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:35.249 17:15:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:35.506 17:15:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:35.506 17:15:32 -- common/autotest_common.sh@1187 -- # local i=0 00:22:35.506 17:15:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:35.507 17:15:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:35.507 17:15:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.405 17:15:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.405 17:15:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.405 17:15:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:37.662 17:15:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.662 17:15:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.662 17:15:34 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.662 17:15:34 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.662 17:15:34 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:38.228 17:15:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:38.228 17:15:35 -- common/autotest_common.sh@1187 -- # local i=0 00:22:38.228 17:15:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:38.228 17:15:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:38.228 17:15:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.125 17:15:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.125 17:15:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.125 17:15:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:40.125 17:15:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.125 17:15:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.125 17:15:37 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.125 17:15:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.125 17:15:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:41.058 17:15:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:41.058 17:15:37 -- common/autotest_common.sh@1187 -- # local i=0 00:22:41.058 17:15:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:41.058 17:15:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:41.058 17:15:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:42.954 17:15:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:42.954 17:15:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:42.954 17:15:39 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:42.954 17:15:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:42.954 17:15:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:42.954 17:15:39 -- common/autotest_common.sh@1197 -- # return 0 00:22:42.954 17:15:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:42.954 17:15:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:43.887 17:15:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:43.888 17:15:40 -- common/autotest_common.sh@1187 -- # local i=0 00:22:43.888 17:15:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:43.888 17:15:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:43.888 17:15:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:45.786 17:15:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:45.786 17:15:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:45.786 17:15:42 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:45.786 17:15:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:45.786 17:15:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:45.786 17:15:42 -- common/autotest_common.sh@1197 -- # return 0 00:22:45.786 17:15:42 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.786 17:15:42 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:46.719 17:15:43 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:46.719 17:15:43 -- common/autotest_common.sh@1187 -- # local i=0 00:22:46.719 17:15:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:46.719 17:15:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:46.719 17:15:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:48.720 17:15:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:48.720 17:15:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:48.720 17:15:45 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:48.720 17:15:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:48.720 17:15:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:48.720 17:15:45 -- common/autotest_common.sh@1197 -- # return 0 00:22:48.720 17:15:45 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:48.720 17:15:45 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:49.655 17:15:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:49.655 17:15:46 -- common/autotest_common.sh@1187 -- # local i=0 00:22:49.655 17:15:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:49.655 17:15:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:49.655 17:15:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:51.555 17:15:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:51.555 17:15:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:51.555 17:15:48 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:51.555 17:15:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:51.555 17:15:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:51.555 17:15:48 -- common/autotest_common.sh@1197 -- # return 0 00:22:51.555 17:15:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.555 17:15:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:52.486 17:15:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:52.486 17:15:49 -- common/autotest_common.sh@1187 -- # local i=0 00:22:52.486 17:15:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:52.486 17:15:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:52.486 17:15:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:54.383 17:15:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:54.383 17:15:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:54.383 17:15:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:54.383 17:15:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:54.383 17:15:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:54.383 17:15:51 -- common/autotest_common.sh@1197 -- # return 0 00:22:54.383 17:15:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.383 17:15:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:55.317 17:15:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:55.317 17:15:52 -- common/autotest_common.sh@1187 -- # local i=0 00:22:55.317 17:15:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:55.317 17:15:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:55.317 17:15:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:57.217 17:15:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:57.217 17:15:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:57.217 17:15:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:57.217 17:15:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:57.217 17:15:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:57.217 17:15:54 -- common/autotest_common.sh@1197 -- # return 0 00:22:57.217 17:15:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:57.217 17:15:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:58.152 17:15:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:58.152 17:15:54 -- common/autotest_common.sh@1187 -- # local i=0 00:22:58.152 17:15:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:58.152 17:15:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:58.152 17:15:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:00.053 17:15:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:00.053 17:15:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:00.053 17:15:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:23:00.053 17:15:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:00.053 17:15:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:00.053 17:15:56 -- common/autotest_common.sh@1197 -- # return 0 00:23:00.053 17:15:56 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:23:00.053 [global] 00:23:00.053 thread=1 00:23:00.053 invalidate=1 00:23:00.053 rw=read 00:23:00.053 time_based=1 00:23:00.053 runtime=10 00:23:00.053 ioengine=libaio 00:23:00.053 direct=1 00:23:00.053 bs=262144 00:23:00.053 iodepth=64 00:23:00.053 norandommap=1 00:23:00.053 numjobs=1 00:23:00.053 00:23:00.053 [job0] 00:23:00.053 filename=/dev/nvme0n1 00:23:00.053 [job1] 00:23:00.053 filename=/dev/nvme10n1 00:23:00.053 [job2] 00:23:00.053 filename=/dev/nvme1n1 00:23:00.053 [job3] 00:23:00.053 filename=/dev/nvme2n1 00:23:00.053 [job4] 00:23:00.053 filename=/dev/nvme3n1 00:23:00.319 [job5] 00:23:00.319 filename=/dev/nvme4n1 00:23:00.319 [job6] 00:23:00.319 filename=/dev/nvme5n1 00:23:00.319 [job7] 00:23:00.319 filename=/dev/nvme6n1 00:23:00.319 [job8] 00:23:00.319 filename=/dev/nvme7n1 00:23:00.319 [job9] 00:23:00.319 filename=/dev/nvme8n1 00:23:00.319 [job10] 00:23:00.319 filename=/dev/nvme9n1 00:23:00.319 Could not set queue depth (nvme0n1) 00:23:00.319 Could not set queue depth (nvme10n1) 00:23:00.319 Could not set queue depth (nvme1n1) 00:23:00.319 Could not set queue depth (nvme2n1) 00:23:00.319 Could not set queue depth (nvme3n1) 00:23:00.319 Could not set queue depth (nvme4n1) 00:23:00.319 Could not set queue depth (nvme5n1) 00:23:00.319 Could not set queue depth (nvme6n1) 00:23:00.319 Could not set queue depth (nvme7n1) 00:23:00.319 Could not set queue depth (nvme8n1) 00:23:00.319 Could not set queue depth (nvme9n1) 00:23:00.578 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:00.578 fio-3.35 00:23:00.578 Starting 11 threads 00:23:12.788 00:23:12.788 job0: (groupid=0, jobs=1): err= 0: pid=1793619: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=699, BW=175MiB/s (183MB/s)(1758MiB/10058msec) 00:23:12.788 slat (usec): min=9, max=166407, avg=1119.46, stdev=5614.35 00:23:12.788 clat (usec): min=1612, max=366112, avg=90337.48, stdev=48428.66 00:23:12.788 lat (usec): min=1634, max=383400, avg=91456.94, stdev=49058.45 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 11], 5.00th=[ 27], 10.00th=[ 36], 20.00th=[ 55], 00:23:12.788 | 30.00th=[ 66], 40.00th=[ 74], 50.00th=[ 81], 60.00th=[ 90], 00:23:12.788 | 70.00th=[ 105], 80.00th=[ 117], 90.00th=[ 174], 95.00th=[ 205], 00:23:12.788 | 99.00th=[ 222], 99.50th=[ 226], 99.90th=[ 245], 99.95th=[ 271], 00:23:12.788 | 99.99th=[ 368] 00:23:12.788 bw ( KiB/s): min=105984, max=333824, per=8.99%, avg=178418.55, stdev=51372.58, samples=20 00:23:12.788 iops : min= 414, max= 1304, avg=696.90, stdev=200.69, samples=20 00:23:12.788 lat (msec) : 2=0.01%, 4=0.28%, 10=0.68%, 20=2.03%, 50=14.09% 00:23:12.788 lat (msec) : 100=50.25%, 250=32.56%, 500=0.09% 00:23:12.788 cpu : usr=0.30%, sys=1.88%, ctx=1404, majf=0, minf=4097 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=7033,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job1: (groupid=0, jobs=1): err= 0: pid=1793620: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=1156, BW=289MiB/s (303MB/s)(2910MiB/10063msec) 00:23:12.788 slat (usec): min=12, max=102538, avg=836.25, stdev=2771.23 00:23:12.788 clat (usec): min=1435, max=234741, avg=54455.15, stdev=31929.43 00:23:12.788 lat (usec): min=1470, max=234767, avg=55291.40, stdev=32376.36 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 6], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 31], 00:23:12.788 | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 54], 00:23:12.788 | 70.00th=[ 67], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 121], 00:23:12.788 | 99.00th=[ 157], 99.50th=[ 161], 99.90th=[ 201], 99.95th=[ 203], 00:23:12.788 | 99.99th=[ 234] 00:23:12.788 bw ( KiB/s): min=110592, max=514048, per=14.92%, avg=296266.55, stdev=123425.28, samples=20 00:23:12.788 iops : min= 432, max= 2008, avg=1157.20, stdev=482.15, samples=20 00:23:12.788 lat (msec) : 2=0.13%, 4=0.64%, 10=0.55%, 20=1.15%, 50=55.31% 00:23:12.788 lat (msec) : 100=32.48%, 250=9.74% 00:23:12.788 cpu : usr=0.61%, sys=3.62%, ctx=2085, majf=0, minf=4097 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=11638,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job2: (groupid=0, jobs=1): err= 0: pid=1793621: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=583, BW=146MiB/s (153MB/s)(1471MiB/10085msec) 00:23:12.788 slat (usec): min=12, max=57083, avg=1557.53, stdev=4961.27 00:23:12.788 clat (msec): min=2, max=276, avg=108.08, stdev=55.26 00:23:12.788 lat (msec): min=2, max=276, avg=109.63, stdev=56.25 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 11], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 63], 00:23:12.788 | 30.00th=[ 87], 40.00th=[ 94], 50.00th=[ 103], 60.00th=[ 112], 00:23:12.788 | 70.00th=[ 126], 80.00th=[ 153], 90.00th=[ 197], 95.00th=[ 213], 00:23:12.788 | 99.00th=[ 239], 99.50th=[ 243], 99.90th=[ 259], 99.95th=[ 264], 00:23:12.788 | 99.99th=[ 275] 00:23:12.788 bw ( KiB/s): min=68096, max=387072, per=7.50%, avg=148919.50, stdev=73806.79, samples=20 00:23:12.788 iops : min= 266, max= 1512, avg=581.70, stdev=288.29, samples=20 00:23:12.788 lat (msec) : 4=0.29%, 10=0.68%, 20=2.64%, 50=12.51%, 100=31.28% 00:23:12.788 lat (msec) : 250=52.40%, 500=0.20% 00:23:12.788 cpu : usr=0.37%, sys=1.95%, ctx=1207, majf=0, minf=4097 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=5882,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job3: (groupid=0, jobs=1): err= 0: pid=1793622: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=575, BW=144MiB/s (151MB/s)(1447MiB/10053msec) 00:23:12.788 slat (usec): min=9, max=160499, avg=1117.48, stdev=5503.03 00:23:12.788 clat (usec): min=1276, max=337313, avg=109978.70, stdev=52153.26 00:23:12.788 lat (usec): min=1314, max=372611, avg=111096.17, stdev=53010.89 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 10], 5.00th=[ 29], 10.00th=[ 49], 20.00th=[ 67], 00:23:12.788 | 30.00th=[ 79], 40.00th=[ 92], 50.00th=[ 107], 60.00th=[ 115], 00:23:12.788 | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 209], 00:23:12.788 | 99.00th=[ 232], 99.50th=[ 241], 99.90th=[ 275], 99.95th=[ 288], 00:23:12.788 | 99.99th=[ 338] 00:23:12.788 bw ( KiB/s): min=76288, max=236544, per=7.38%, avg=146508.10, stdev=46450.84, samples=20 00:23:12.788 iops : min= 298, max= 924, avg=572.25, stdev=181.46, samples=20 00:23:12.788 lat (msec) : 2=0.02%, 4=0.17%, 10=0.81%, 20=1.80%, 50=7.88% 00:23:12.788 lat (msec) : 100=35.10%, 250=54.00%, 500=0.22% 00:23:12.788 cpu : usr=0.33%, sys=1.44%, ctx=1400, majf=0, minf=4097 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=5787,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job4: (groupid=0, jobs=1): err= 0: pid=1793623: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=688, BW=172MiB/s (180MB/s)(1735MiB/10084msec) 00:23:12.788 slat (usec): min=9, max=140668, avg=1056.73, stdev=5201.78 00:23:12.788 clat (msec): min=2, max=321, avg=91.88, stdev=62.26 00:23:12.788 lat (msec): min=2, max=341, avg=92.94, stdev=63.28 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 9], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 31], 00:23:12.788 | 30.00th=[ 40], 40.00th=[ 61], 50.00th=[ 87], 60.00th=[ 102], 00:23:12.788 | 70.00th=[ 120], 80.00th=[ 146], 90.00th=[ 192], 95.00th=[ 211], 00:23:12.788 | 99.00th=[ 241], 99.50th=[ 247], 99.90th=[ 257], 99.95th=[ 305], 00:23:12.788 | 99.99th=[ 321] 00:23:12.788 bw ( KiB/s): min=70656, max=408064, per=8.87%, avg=176016.70, stdev=93082.37, samples=20 00:23:12.788 iops : min= 276, max= 1594, avg=687.50, stdev=363.58, samples=20 00:23:12.788 lat (msec) : 4=0.17%, 10=1.31%, 20=4.81%, 50=30.13%, 100=23.04% 00:23:12.788 lat (msec) : 250=40.20%, 500=0.33% 00:23:12.788 cpu : usr=0.35%, sys=2.05%, ctx=1430, majf=0, minf=4097 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=6940,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job5: (groupid=0, jobs=1): err= 0: pid=1793625: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=596, BW=149MiB/s (156MB/s)(1496MiB/10040msec) 00:23:12.788 slat (usec): min=9, max=100753, avg=1504.82, stdev=5516.27 00:23:12.788 clat (msec): min=4, max=298, avg=105.78, stdev=54.98 00:23:12.788 lat (msec): min=4, max=302, avg=107.28, stdev=56.04 00:23:12.788 clat percentiles (msec): 00:23:12.788 | 1.00th=[ 14], 5.00th=[ 31], 10.00th=[ 41], 20.00th=[ 56], 00:23:12.788 | 30.00th=[ 70], 40.00th=[ 87], 50.00th=[ 97], 60.00th=[ 111], 00:23:12.788 | 70.00th=[ 128], 80.00th=[ 155], 90.00th=[ 194], 95.00th=[ 211], 00:23:12.788 | 99.00th=[ 239], 99.50th=[ 247], 99.90th=[ 296], 99.95th=[ 296], 00:23:12.788 | 99.99th=[ 300] 00:23:12.788 bw ( KiB/s): min=71680, max=301988, per=7.63%, avg=151527.05, stdev=73045.81, samples=20 00:23:12.788 iops : min= 280, max= 1179, avg=591.85, stdev=285.25, samples=20 00:23:12.788 lat (msec) : 10=0.58%, 20=1.30%, 50=12.56%, 100=38.78%, 250=46.37% 00:23:12.788 lat (msec) : 500=0.40% 00:23:12.788 cpu : usr=0.30%, sys=1.97%, ctx=1255, majf=0, minf=3721 00:23:12.788 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:12.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.788 issued rwts: total=5985,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.788 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.788 job6: (groupid=0, jobs=1): err= 0: pid=1793626: Wed Nov 27 17:16:07 2024 00:23:12.788 read: IOPS=823, BW=206MiB/s (216MB/s)(2077MiB/10082msec) 00:23:12.789 slat (usec): min=8, max=61360, avg=961.17, stdev=3161.97 00:23:12.789 clat (msec): min=2, max=205, avg=76.67, stdev=35.03 00:23:12.789 lat (msec): min=2, max=232, avg=77.63, stdev=35.43 00:23:12.789 clat percentiles (msec): 00:23:12.789 | 1.00th=[ 13], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 47], 00:23:12.789 | 30.00th=[ 53], 40.00th=[ 61], 50.00th=[ 71], 60.00th=[ 84], 00:23:12.789 | 70.00th=[ 93], 80.00th=[ 109], 90.00th=[ 125], 95.00th=[ 142], 00:23:12.789 | 99.00th=[ 169], 99.50th=[ 188], 99.90th=[ 203], 99.95th=[ 205], 00:23:12.789 | 99.99th=[ 205] 00:23:12.789 bw ( KiB/s): min=111104, max=391168, per=10.63%, avg=210991.95, stdev=78826.81, samples=20 00:23:12.789 iops : min= 434, max= 1528, avg=824.10, stdev=308.00, samples=20 00:23:12.789 lat (msec) : 4=0.01%, 10=0.43%, 20=1.69%, 50=23.71%, 100=48.95% 00:23:12.789 lat (msec) : 250=25.21% 00:23:12.789 cpu : usr=0.40%, sys=2.49%, ctx=1686, majf=0, minf=4097 00:23:12.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:12.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.789 issued rwts: total=8306,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.789 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.789 job7: (groupid=0, jobs=1): err= 0: pid=1793627: Wed Nov 27 17:16:07 2024 00:23:12.789 read: IOPS=793, BW=198MiB/s (208MB/s)(1994MiB/10047msec) 00:23:12.789 slat (usec): min=9, max=73187, avg=1123.50, stdev=3551.44 00:23:12.789 clat (msec): min=3, max=240, avg=79.45, stdev=38.24 00:23:12.789 lat (msec): min=3, max=240, avg=80.57, stdev=38.76 00:23:12.789 clat percentiles (msec): 00:23:12.789 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 28], 20.00th=[ 51], 00:23:12.789 | 30.00th=[ 59], 40.00th=[ 67], 50.00th=[ 75], 60.00th=[ 88], 00:23:12.789 | 70.00th=[ 102], 80.00th=[ 113], 90.00th=[ 128], 95.00th=[ 144], 00:23:12.789 | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 230], 99.95th=[ 239], 00:23:12.789 | 99.99th=[ 241] 00:23:12.789 bw ( KiB/s): min=112128, max=397029, per=10.20%, avg=202491.10, stdev=78077.53, samples=20 00:23:12.789 iops : min= 438, max= 1550, avg=790.90, stdev=304.89, samples=20 00:23:12.789 lat (msec) : 4=0.13%, 10=1.20%, 20=3.57%, 50=15.39%, 100=48.88% 00:23:12.789 lat (msec) : 250=30.83% 00:23:12.789 cpu : usr=0.52%, sys=2.33%, ctx=1479, majf=0, minf=4097 00:23:12.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:12.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.789 issued rwts: total=7975,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.789 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.789 job8: (groupid=0, jobs=1): err= 0: pid=1793628: Wed Nov 27 17:16:07 2024 00:23:12.789 read: IOPS=588, BW=147MiB/s (154MB/s)(1479MiB/10052msec) 00:23:12.789 slat (usec): min=9, max=82038, avg=1267.27, stdev=4540.81 00:23:12.789 clat (msec): min=2, max=275, avg=107.41, stdev=54.97 00:23:12.789 lat (msec): min=2, max=275, avg=108.68, stdev=55.71 00:23:12.789 clat percentiles (msec): 00:23:12.789 | 1.00th=[ 12], 5.00th=[ 42], 10.00th=[ 50], 20.00th=[ 59], 00:23:12.789 | 30.00th=[ 67], 40.00th=[ 80], 50.00th=[ 95], 60.00th=[ 114], 00:23:12.789 | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 197], 95.00th=[ 213], 00:23:12.789 | 99.00th=[ 234], 99.50th=[ 243], 99.90th=[ 266], 99.95th=[ 268], 00:23:12.789 | 99.99th=[ 275] 00:23:12.789 bw ( KiB/s): min=67072, max=279504, per=7.54%, avg=149770.65, stdev=65365.91, samples=20 00:23:12.789 iops : min= 262, max= 1091, avg=585.00, stdev=255.25, samples=20 00:23:12.789 lat (msec) : 4=0.05%, 10=0.83%, 20=1.42%, 50=8.44%, 100=42.15% 00:23:12.789 lat (msec) : 250=46.80%, 500=0.32% 00:23:12.789 cpu : usr=0.45%, sys=1.69%, ctx=1352, majf=0, minf=4098 00:23:12.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:12.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.789 issued rwts: total=5915,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.789 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.789 job9: (groupid=0, jobs=1): err= 0: pid=1793631: Wed Nov 27 17:16:07 2024 00:23:12.789 read: IOPS=768, BW=192MiB/s (201MB/s)(1937MiB/10086msec) 00:23:12.789 slat (usec): min=8, max=166791, avg=980.79, stdev=5638.42 00:23:12.789 clat (usec): min=727, max=374591, avg=82268.45, stdev=55962.96 00:23:12.789 lat (usec): min=785, max=374653, avg=83249.24, stdev=56925.00 00:23:12.789 clat percentiles (msec): 00:23:12.789 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 22], 20.00th=[ 30], 00:23:12.789 | 30.00th=[ 42], 40.00th=[ 57], 50.00th=[ 75], 60.00th=[ 91], 00:23:12.789 | 70.00th=[ 107], 80.00th=[ 123], 90.00th=[ 165], 95.00th=[ 201], 00:23:12.789 | 99.00th=[ 224], 99.50th=[ 239], 99.90th=[ 253], 99.95th=[ 359], 00:23:12.789 | 99.99th=[ 376] 00:23:12.789 bw ( KiB/s): min=66560, max=485376, per=9.91%, avg=196709.90, stdev=108927.57, samples=20 00:23:12.789 iops : min= 260, max= 1896, avg=768.35, stdev=425.50, samples=20 00:23:12.789 lat (usec) : 750=0.01%, 1000=0.03% 00:23:12.789 lat (msec) : 2=0.30%, 4=1.90%, 10=3.76%, 20=3.65%, 50=25.05% 00:23:12.789 lat (msec) : 100=30.98%, 250=34.23%, 500=0.10% 00:23:12.789 cpu : usr=0.28%, sys=1.93%, ctx=1659, majf=0, minf=4097 00:23:12.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:12.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.789 issued rwts: total=7748,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.789 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.789 job10: (groupid=0, jobs=1): err= 0: pid=1793632: Wed Nov 27 17:16:07 2024 00:23:12.789 read: IOPS=495, BW=124MiB/s (130MB/s)(1250MiB/10082msec) 00:23:12.789 slat (usec): min=8, max=102524, avg=1730.03, stdev=5898.75 00:23:12.789 clat (msec): min=4, max=285, avg=127.23, stdev=49.00 00:23:12.789 lat (msec): min=4, max=286, avg=128.96, stdev=50.00 00:23:12.789 clat percentiles (msec): 00:23:12.789 | 1.00th=[ 14], 5.00th=[ 46], 10.00th=[ 81], 20.00th=[ 92], 00:23:12.789 | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 118], 60.00th=[ 130], 00:23:12.789 | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 205], 95.00th=[ 213], 00:23:12.789 | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 271], 99.95th=[ 275], 00:23:12.789 | 99.99th=[ 288] 00:23:12.789 bw ( KiB/s): min=73216, max=220672, per=6.37%, avg=126367.70, stdev=39484.32, samples=20 00:23:12.789 iops : min= 286, max= 862, avg=493.60, stdev=154.26, samples=20 00:23:12.789 lat (msec) : 10=0.48%, 20=1.58%, 50=3.58%, 100=22.78%, 250=71.08% 00:23:12.789 lat (msec) : 500=0.50% 00:23:12.789 cpu : usr=0.29%, sys=1.67%, ctx=1105, majf=0, minf=4097 00:23:12.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:12.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.789 issued rwts: total=5000,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.789 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.789 00:23:12.789 Run status group 0 (all jobs): 00:23:12.789 READ: bw=1939MiB/s (2033MB/s), 124MiB/s-289MiB/s (130MB/s-303MB/s), io=19.1GiB (20.5GB), run=10040-10086msec 00:23:12.789 00:23:12.789 Disk stats (read/write): 00:23:12.789 nvme0n1: ios=13870/0, merge=0/0, ticks=1241874/0, in_queue=1241874, util=97.36% 00:23:12.789 nvme10n1: ios=23060/0, merge=0/0, ticks=1237315/0, in_queue=1237315, util=97.58% 00:23:12.789 nvme1n1: ios=11584/0, merge=0/0, ticks=1231622/0, in_queue=1231622, util=97.83% 00:23:12.789 nvme2n1: ios=11364/0, merge=0/0, ticks=1241941/0, in_queue=1241941, util=97.95% 00:23:12.789 nvme3n1: ios=13703/0, merge=0/0, ticks=1235390/0, in_queue=1235390, util=98.02% 00:23:12.789 nvme4n1: ios=11746/0, merge=0/0, ticks=1234498/0, in_queue=1234498, util=98.35% 00:23:12.789 nvme5n1: ios=16428/0, merge=0/0, ticks=1243097/0, in_queue=1243097, util=98.49% 00:23:12.789 nvme6n1: ios=15702/0, merge=0/0, ticks=1233590/0, in_queue=1233590, util=98.59% 00:23:12.789 nvme7n1: ios=11617/0, merge=0/0, ticks=1238814/0, in_queue=1238814, util=98.96% 00:23:12.789 nvme8n1: ios=15328/0, merge=0/0, ticks=1237879/0, in_queue=1237879, util=99.11% 00:23:12.789 nvme9n1: ios=9836/0, merge=0/0, ticks=1231780/0, in_queue=1231780, util=99.23% 00:23:12.789 17:16:07 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:12.789 [global] 00:23:12.789 thread=1 00:23:12.789 invalidate=1 00:23:12.789 rw=randwrite 00:23:12.789 time_based=1 00:23:12.789 runtime=10 00:23:12.789 ioengine=libaio 00:23:12.789 direct=1 00:23:12.789 bs=262144 00:23:12.789 iodepth=64 00:23:12.789 norandommap=1 00:23:12.789 numjobs=1 00:23:12.789 00:23:12.789 [job0] 00:23:12.789 filename=/dev/nvme0n1 00:23:12.789 [job1] 00:23:12.789 filename=/dev/nvme10n1 00:23:12.789 [job2] 00:23:12.789 filename=/dev/nvme1n1 00:23:12.789 [job3] 00:23:12.789 filename=/dev/nvme2n1 00:23:12.789 [job4] 00:23:12.789 filename=/dev/nvme3n1 00:23:12.789 [job5] 00:23:12.789 filename=/dev/nvme4n1 00:23:12.789 [job6] 00:23:12.789 filename=/dev/nvme5n1 00:23:12.789 [job7] 00:23:12.789 filename=/dev/nvme6n1 00:23:12.789 [job8] 00:23:12.789 filename=/dev/nvme7n1 00:23:12.789 [job9] 00:23:12.789 filename=/dev/nvme8n1 00:23:12.789 [job10] 00:23:12.789 filename=/dev/nvme9n1 00:23:12.789 Could not set queue depth (nvme0n1) 00:23:12.789 Could not set queue depth (nvme10n1) 00:23:12.789 Could not set queue depth (nvme1n1) 00:23:12.789 Could not set queue depth (nvme2n1) 00:23:12.789 Could not set queue depth (nvme3n1) 00:23:12.789 Could not set queue depth (nvme4n1) 00:23:12.789 Could not set queue depth (nvme5n1) 00:23:12.789 Could not set queue depth (nvme6n1) 00:23:12.789 Could not set queue depth (nvme7n1) 00:23:12.789 Could not set queue depth (nvme8n1) 00:23:12.789 Could not set queue depth (nvme9n1) 00:23:12.789 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.789 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.789 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.789 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.789 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:12.790 fio-3.35 00:23:12.790 Starting 11 threads 00:23:22.759 00:23:22.759 job0: (groupid=0, jobs=1): err= 0: pid=1794821: Wed Nov 27 17:16:18 2024 00:23:22.759 write: IOPS=544, BW=136MiB/s (143MB/s)(1374MiB/10099msec); 0 zone resets 00:23:22.759 slat (usec): min=25, max=30765, avg=1597.71, stdev=3299.71 00:23:22.759 clat (msec): min=8, max=254, avg=115.85, stdev=43.17 00:23:22.759 lat (msec): min=8, max=254, avg=117.44, stdev=43.69 00:23:22.759 clat percentiles (msec): 00:23:22.759 | 1.00th=[ 20], 5.00th=[ 47], 10.00th=[ 70], 20.00th=[ 77], 00:23:22.759 | 30.00th=[ 90], 40.00th=[ 106], 50.00th=[ 113], 60.00th=[ 121], 00:23:22.759 | 70.00th=[ 133], 80.00th=[ 150], 90.00th=[ 180], 95.00th=[ 197], 00:23:22.759 | 99.00th=[ 224], 99.50th=[ 228], 99.90th=[ 247], 99.95th=[ 247], 00:23:22.759 | 99.99th=[ 255] 00:23:22.759 bw ( KiB/s): min=86016, max=212992, per=9.75%, avg=139097.70, stdev=37296.55, samples=20 00:23:22.759 iops : min= 336, max= 832, avg=543.35, stdev=145.69, samples=20 00:23:22.759 lat (msec) : 10=0.07%, 20=0.95%, 50=4.73%, 100=28.75%, 250=65.47% 00:23:22.759 lat (msec) : 500=0.04% 00:23:22.759 cpu : usr=1.72%, sys=1.90%, ctx=1966, majf=0, minf=1 00:23:22.759 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:22.759 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.759 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.759 issued rwts: total=0,5496,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.759 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.759 job1: (groupid=0, jobs=1): err= 0: pid=1794834: Wed Nov 27 17:16:18 2024 00:23:22.759 write: IOPS=572, BW=143MiB/s (150MB/s)(1452MiB/10143msec); 0 zone resets 00:23:22.759 slat (usec): min=20, max=132120, avg=944.60, stdev=3456.96 00:23:22.759 clat (msec): min=2, max=376, avg=110.79, stdev=63.15 00:23:22.759 lat (msec): min=2, max=391, avg=111.74, stdev=63.75 00:23:22.759 clat percentiles (msec): 00:23:22.759 | 1.00th=[ 10], 5.00th=[ 27], 10.00th=[ 39], 20.00th=[ 52], 00:23:22.759 | 30.00th=[ 65], 40.00th=[ 84], 50.00th=[ 104], 60.00th=[ 118], 00:23:22.759 | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 197], 95.00th=[ 228], 00:23:22.759 | 99.00th=[ 268], 99.50th=[ 288], 99.90th=[ 363], 99.95th=[ 376], 00:23:22.759 | 99.99th=[ 376] 00:23:22.759 bw ( KiB/s): min=71680, max=324096, per=10.30%, avg=147017.95, stdev=56817.55, samples=20 00:23:22.759 iops : min= 280, max= 1266, avg=574.25, stdev=221.98, samples=20 00:23:22.759 lat (msec) : 4=0.03%, 10=1.07%, 20=2.20%, 50=10.61%, 100=34.58% 00:23:22.759 lat (msec) : 250=48.93%, 500=2.57% 00:23:22.759 cpu : usr=1.72%, sys=2.25%, ctx=3578, majf=0, minf=1 00:23:22.759 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:22.759 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.759 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.759 issued rwts: total=0,5806,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.759 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.759 job2: (groupid=0, jobs=1): err= 0: pid=1794835: Wed Nov 27 17:16:18 2024 00:23:22.759 write: IOPS=455, BW=114MiB/s (120MB/s)(1151MiB/10095msec); 0 zone resets 00:23:22.759 slat (usec): min=25, max=82666, avg=1801.77, stdev=4314.54 00:23:22.759 clat (msec): min=4, max=301, avg=138.50, stdev=57.51 00:23:22.759 lat (msec): min=6, max=327, avg=140.30, stdev=58.16 00:23:22.759 clat percentiles (msec): 00:23:22.759 | 1.00th=[ 15], 5.00th=[ 49], 10.00th=[ 77], 20.00th=[ 84], 00:23:22.759 | 30.00th=[ 92], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 161], 00:23:22.759 | 70.00th=[ 178], 80.00th=[ 192], 90.00th=[ 211], 95.00th=[ 228], 00:23:22.759 | 99.00th=[ 264], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 279], 00:23:22.759 | 99.99th=[ 300] 00:23:22.759 bw ( KiB/s): min=65536, max=194560, per=8.14%, avg=116189.60, stdev=38382.00, samples=20 00:23:22.759 iops : min= 256, max= 760, avg=453.85, stdev=149.94, samples=20 00:23:22.759 lat (msec) : 10=0.28%, 20=1.83%, 50=3.06%, 100=27.79%, 250=64.65% 00:23:22.759 lat (msec) : 500=2.39% 00:23:22.759 cpu : usr=1.44%, sys=1.56%, ctx=1831, majf=0, minf=1 00:23:22.759 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:23:22.759 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,4602,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job3: (groupid=0, jobs=1): err= 0: pid=1794836: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=447, BW=112MiB/s (117MB/s)(1141MiB/10196msec); 0 zone resets 00:23:22.760 slat (usec): min=23, max=53733, avg=1813.55, stdev=4120.32 00:23:22.760 clat (msec): min=5, max=354, avg=141.06, stdev=52.64 00:23:22.760 lat (msec): min=7, max=354, avg=142.88, stdev=53.33 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 23], 5.00th=[ 48], 10.00th=[ 80], 20.00th=[ 96], 00:23:22.760 | 30.00th=[ 110], 40.00th=[ 124], 50.00th=[ 142], 60.00th=[ 161], 00:23:22.760 | 70.00th=[ 176], 80.00th=[ 188], 90.00th=[ 205], 95.00th=[ 220], 00:23:22.760 | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 321], 99.95th=[ 351], 00:23:22.760 | 99.99th=[ 355] 00:23:22.760 bw ( KiB/s): min=77824, max=192000, per=8.07%, avg=115224.70, stdev=30391.50, samples=20 00:23:22.760 iops : min= 304, max= 750, avg=450.05, stdev=118.66, samples=20 00:23:22.760 lat (msec) : 10=0.09%, 20=0.77%, 50=4.56%, 100=17.73%, 250=75.50% 00:23:22.760 lat (msec) : 500=1.36% 00:23:22.760 cpu : usr=1.26%, sys=1.45%, ctx=1882, majf=0, minf=1 00:23:22.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:22.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,4564,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job4: (groupid=0, jobs=1): err= 0: pid=1794837: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=544, BW=136MiB/s (143MB/s)(1376MiB/10114msec); 0 zone resets 00:23:22.760 slat (usec): min=24, max=20628, avg=1363.86, stdev=3105.00 00:23:22.760 clat (msec): min=6, max=264, avg=116.15, stdev=49.68 00:23:22.760 lat (msec): min=6, max=264, avg=117.51, stdev=50.18 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 17], 5.00th=[ 44], 10.00th=[ 48], 20.00th=[ 66], 00:23:22.760 | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 126], 00:23:22.760 | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 184], 95.00th=[ 197], 00:23:22.760 | 99.00th=[ 222], 99.50th=[ 232], 99.90th=[ 251], 99.95th=[ 259], 00:23:22.760 | 99.99th=[ 266] 00:23:22.760 bw ( KiB/s): min=89932, max=281600, per=9.76%, avg=139318.50, stdev=49294.51, samples=20 00:23:22.760 iops : min= 351, max= 1100, avg=544.15, stdev=192.59, samples=20 00:23:22.760 lat (msec) : 10=0.22%, 20=1.34%, 50=13.51%, 100=21.87%, 250=62.92% 00:23:22.760 lat (msec) : 500=0.13% 00:23:22.760 cpu : usr=1.58%, sys=2.19%, ctx=2338, majf=0, minf=1 00:23:22.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:22.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,5505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job5: (groupid=0, jobs=1): err= 0: pid=1794838: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=436, BW=109MiB/s (114MB/s)(1105MiB/10115msec); 0 zone resets 00:23:22.760 slat (usec): min=25, max=41878, avg=1846.54, stdev=4148.28 00:23:22.760 clat (usec): min=1875, max=278666, avg=144606.23, stdev=51406.31 00:23:22.760 lat (msec): min=2, max=278, avg=146.45, stdev=52.18 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 15], 5.00th=[ 48], 10.00th=[ 81], 20.00th=[ 101], 00:23:22.760 | 30.00th=[ 118], 40.00th=[ 134], 50.00th=[ 150], 60.00th=[ 167], 00:23:22.760 | 70.00th=[ 180], 80.00th=[ 188], 90.00th=[ 201], 95.00th=[ 220], 00:23:22.760 | 99.00th=[ 259], 99.50th=[ 268], 99.90th=[ 279], 99.95th=[ 279], 00:23:22.760 | 99.99th=[ 279] 00:23:22.760 bw ( KiB/s): min=69632, max=157184, per=7.81%, avg=111492.40, stdev=24731.53, samples=20 00:23:22.760 iops : min= 272, max= 614, avg=435.50, stdev=96.62, samples=20 00:23:22.760 lat (msec) : 2=0.02%, 4=0.07%, 10=0.36%, 20=1.29%, 50=3.62% 00:23:22.760 lat (msec) : 100=14.21%, 250=79.22%, 500=1.20% 00:23:22.760 cpu : usr=1.36%, sys=1.55%, ctx=1960, majf=0, minf=1 00:23:22.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:22.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,4418,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job6: (groupid=0, jobs=1): err= 0: pid=1794844: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=474, BW=119MiB/s (124MB/s)(1208MiB/10194msec); 0 zone resets 00:23:22.760 slat (usec): min=15, max=34545, avg=1450.17, stdev=3662.47 00:23:22.760 clat (usec): min=1564, max=394048, avg=133476.16, stdev=58724.89 00:23:22.760 lat (usec): min=1607, max=394116, avg=134926.33, stdev=59465.33 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 7], 5.00th=[ 29], 10.00th=[ 51], 20.00th=[ 86], 00:23:22.760 | 30.00th=[ 110], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 157], 00:23:22.760 | 70.00th=[ 171], 80.00th=[ 184], 90.00th=[ 201], 95.00th=[ 215], 00:23:22.760 | 99.00th=[ 268], 99.50th=[ 334], 99.90th=[ 388], 99.95th=[ 393], 00:23:22.760 | 99.99th=[ 393] 00:23:22.760 bw ( KiB/s): min=77312, max=165888, per=8.56%, avg=122102.50, stdev=27412.04, samples=20 00:23:22.760 iops : min= 302, max= 648, avg=476.95, stdev=107.06, samples=20 00:23:22.760 lat (msec) : 2=0.04%, 4=0.39%, 10=1.32%, 20=1.59%, 50=6.66% 00:23:22.760 lat (msec) : 100=14.86%, 250=73.72%, 500=1.41% 00:23:22.760 cpu : usr=1.41%, sys=1.59%, ctx=2576, majf=0, minf=1 00:23:22.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:22.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,4832,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job7: (groupid=0, jobs=1): err= 0: pid=1794846: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=517, BW=129MiB/s (136MB/s)(1317MiB/10183msec); 0 zone resets 00:23:22.760 slat (usec): min=19, max=31056, avg=1231.43, stdev=3384.61 00:23:22.760 clat (usec): min=926, max=436832, avg=122432.64, stdev=65725.77 00:23:22.760 lat (usec): min=954, max=436861, avg=123664.07, stdev=66521.53 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 7], 5.00th=[ 21], 10.00th=[ 36], 20.00th=[ 58], 00:23:22.760 | 30.00th=[ 71], 40.00th=[ 101], 50.00th=[ 130], 60.00th=[ 146], 00:23:22.760 | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 201], 95.00th=[ 220], 00:23:22.760 | 99.00th=[ 257], 99.50th=[ 288], 99.90th=[ 409], 99.95th=[ 422], 00:23:22.760 | 99.99th=[ 439] 00:23:22.760 bw ( KiB/s): min=71680, max=267776, per=9.34%, avg=133211.10, stdev=51908.13, samples=20 00:23:22.760 iops : min= 280, max= 1046, avg=520.35, stdev=202.77, samples=20 00:23:22.760 lat (usec) : 1000=0.02% 00:23:22.760 lat (msec) : 2=0.34%, 4=0.30%, 10=0.89%, 20=3.38%, 50=9.91% 00:23:22.760 lat (msec) : 100=25.31%, 250=58.29%, 500=1.56% 00:23:22.760 cpu : usr=1.54%, sys=1.82%, ctx=3057, majf=0, minf=1 00:23:22.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:22.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.760 issued rwts: total=0,5267,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.760 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.760 job8: (groupid=0, jobs=1): err= 0: pid=1794847: Wed Nov 27 17:16:18 2024 00:23:22.760 write: IOPS=465, BW=116MiB/s (122MB/s)(1186MiB/10183msec); 0 zone resets 00:23:22.760 slat (usec): min=20, max=33436, avg=1452.96, stdev=3762.17 00:23:22.760 clat (msec): min=3, max=430, avg=135.82, stdev=63.80 00:23:22.760 lat (msec): min=3, max=430, avg=137.27, stdev=64.53 00:23:22.760 clat percentiles (msec): 00:23:22.760 | 1.00th=[ 14], 5.00th=[ 34], 10.00th=[ 46], 20.00th=[ 55], 00:23:22.760 | 30.00th=[ 102], 40.00th=[ 134], 50.00th=[ 148], 60.00th=[ 165], 00:23:22.760 | 70.00th=[ 180], 80.00th=[ 192], 90.00th=[ 205], 95.00th=[ 220], 00:23:22.760 | 99.00th=[ 245], 99.50th=[ 255], 99.90th=[ 426], 99.95th=[ 426], 00:23:22.760 | 99.99th=[ 430] 00:23:22.760 bw ( KiB/s): min=71680, max=292864, per=8.40%, avg=119862.20, stdev=51185.58, samples=20 00:23:22.760 iops : min= 280, max= 1144, avg=468.20, stdev=199.95, samples=20 00:23:22.760 lat (msec) : 4=0.02%, 10=0.42%, 20=1.85%, 50=15.24%, 100=12.24% 00:23:22.761 lat (msec) : 250=69.65%, 500=0.57% 00:23:22.761 cpu : usr=1.36%, sys=1.74%, ctx=2499, majf=0, minf=1 00:23:22.761 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:22.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.761 issued rwts: total=0,4745,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.761 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.761 job9: (groupid=0, jobs=1): err= 0: pid=1794848: Wed Nov 27 17:16:18 2024 00:23:22.761 write: IOPS=598, BW=150MiB/s (157MB/s)(1522MiB/10163msec); 0 zone resets 00:23:22.761 slat (usec): min=17, max=37837, avg=1084.76, stdev=2858.14 00:23:22.761 clat (msec): min=3, max=398, avg=105.72, stdev=54.75 00:23:22.761 lat (msec): min=3, max=412, avg=106.80, stdev=55.29 00:23:22.761 clat percentiles (msec): 00:23:22.761 | 1.00th=[ 14], 5.00th=[ 32], 10.00th=[ 48], 20.00th=[ 57], 00:23:22.761 | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 102], 60.00th=[ 115], 00:23:22.761 | 70.00th=[ 132], 80.00th=[ 150], 90.00th=[ 186], 95.00th=[ 207], 00:23:22.761 | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 317], 99.95th=[ 397], 00:23:22.761 | 99.99th=[ 401] 00:23:22.761 bw ( KiB/s): min=75776, max=287232, per=10.81%, avg=154206.20, stdev=53450.72, samples=20 00:23:22.761 iops : min= 296, max= 1122, avg=602.35, stdev=208.82, samples=20 00:23:22.761 lat (msec) : 4=0.02%, 10=0.36%, 20=1.72%, 50=8.43%, 100=38.67% 00:23:22.761 lat (msec) : 250=50.30%, 500=0.49% 00:23:22.761 cpu : usr=1.69%, sys=2.13%, ctx=3104, majf=0, minf=1 00:23:22.761 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:22.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.761 issued rwts: total=0,6087,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.761 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.761 job10: (groupid=0, jobs=1): err= 0: pid=1794849: Wed Nov 27 17:16:18 2024 00:23:22.761 write: IOPS=544, BW=136MiB/s (143MB/s)(1378MiB/10115msec); 0 zone resets 00:23:22.761 slat (usec): min=19, max=97208, avg=1184.34, stdev=3541.40 00:23:22.761 clat (usec): min=1442, max=302461, avg=116243.22, stdev=56769.08 00:23:22.761 lat (msec): min=2, max=302, avg=117.43, stdev=57.57 00:23:22.761 clat percentiles (msec): 00:23:22.761 | 1.00th=[ 8], 5.00th=[ 26], 10.00th=[ 47], 20.00th=[ 72], 00:23:22.761 | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 110], 60.00th=[ 124], 00:23:22.761 | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 197], 95.00th=[ 218], 00:23:22.761 | 99.00th=[ 236], 99.50th=[ 247], 99.90th=[ 288], 99.95th=[ 292], 00:23:22.761 | 99.99th=[ 305] 00:23:22.761 bw ( KiB/s): min=79872, max=225792, per=9.77%, avg=139443.05, stdev=50410.75, samples=20 00:23:22.761 iops : min= 312, max= 882, avg=544.65, stdev=196.96, samples=20 00:23:22.761 lat (msec) : 2=0.02%, 4=0.11%, 10=1.23%, 20=2.47%, 50=7.21% 00:23:22.761 lat (msec) : 100=33.97%, 250=54.57%, 500=0.42% 00:23:22.761 cpu : usr=1.67%, sys=1.83%, ctx=3238, majf=0, minf=1 00:23:22.761 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:22.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:22.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:22.761 issued rwts: total=0,5510,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:22.761 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:22.761 00:23:22.761 Run status group 0 (all jobs): 00:23:22.761 WRITE: bw=1393MiB/s (1461MB/s), 109MiB/s-150MiB/s (114MB/s-157MB/s), io=13.9GiB (14.9GB), run=10095-10196msec 00:23:22.761 00:23:22.761 Disk stats (read/write): 00:23:22.761 nvme0n1: ios=44/10827, merge=0/0, ticks=649/1210781, in_queue=1211430, util=100.00% 00:23:22.761 nvme10n1: ios=43/11422, merge=0/0, ticks=199/1221161, in_queue=1221360, util=99.18% 00:23:22.761 nvme1n1: ios=40/9031, merge=0/0, ticks=521/1214486, in_queue=1215007, util=100.00% 00:23:22.761 nvme2n1: ios=0/9104, merge=0/0, ticks=0/1241596, in_queue=1241596, util=97.87% 00:23:22.761 nvme3n1: ios=0/10828, merge=0/0, ticks=0/1217960, in_queue=1217960, util=97.88% 00:23:22.761 nvme4n1: ios=0/8650, merge=0/0, ticks=0/1215880, in_queue=1215880, util=98.17% 00:23:22.761 nvme5n1: ios=0/9645, merge=0/0, ticks=0/1246669, in_queue=1246669, util=98.37% 00:23:22.761 nvme6n1: ios=0/10359, merge=0/0, ticks=0/1216105, in_queue=1216105, util=98.45% 00:23:22.761 nvme7n1: ios=0/9292, merge=0/0, ticks=0/1215181, in_queue=1215181, util=98.83% 00:23:22.761 nvme8n1: ios=0/11990, merge=0/0, ticks=0/1215862, in_queue=1215862, util=98.93% 00:23:22.761 nvme9n1: ios=0/10836, merge=0/0, ticks=0/1224084, in_queue=1224084, util=99.11% 00:23:22.761 17:16:18 -- target/multiconnection.sh@36 -- # sync 00:23:22.761 17:16:18 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:22.761 17:16:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:22.761 17:16:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:22.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:22.761 17:16:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:22.761 17:16:18 -- common/autotest_common.sh@1208 -- # local i=0 00:23:22.761 17:16:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:22.761 17:16:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:22.761 17:16:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:22.761 17:16:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:22.761 17:16:18 -- common/autotest_common.sh@1220 -- # return 0 00:23:22.761 17:16:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:22.761 17:16:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.761 17:16:18 -- common/autotest_common.sh@10 -- # set +x 00:23:22.761 17:16:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.761 17:16:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:22.761 17:16:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:22.761 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:22.761 17:16:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:22.761 17:16:19 -- common/autotest_common.sh@1208 -- # local i=0 00:23:22.761 17:16:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:22.761 17:16:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:22.761 17:16:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:22.761 17:16:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:22.761 17:16:19 -- common/autotest_common.sh@1220 -- # return 0 00:23:22.761 17:16:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:22.761 17:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.761 17:16:19 -- common/autotest_common.sh@10 -- # set +x 00:23:22.761 17:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.761 17:16:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:22.761 17:16:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:22.761 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:22.761 17:16:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:22.761 17:16:19 -- common/autotest_common.sh@1208 -- # local i=0 00:23:22.761 17:16:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:22.761 17:16:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:22.761 17:16:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:22.761 17:16:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:22.761 17:16:19 -- common/autotest_common.sh@1220 -- # return 0 00:23:22.761 17:16:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:22.761 17:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.761 17:16:19 -- common/autotest_common.sh@10 -- # set +x 00:23:22.761 17:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.761 17:16:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:22.761 17:16:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:23.019 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:23.019 17:16:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:23.019 17:16:19 -- common/autotest_common.sh@1208 -- # local i=0 00:23:23.019 17:16:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:23.019 17:16:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:23.019 17:16:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:23.019 17:16:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:23.277 17:16:19 -- common/autotest_common.sh@1220 -- # return 0 00:23:23.277 17:16:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:23.277 17:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.277 17:16:19 -- common/autotest_common.sh@10 -- # set +x 00:23:23.277 17:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.277 17:16:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:23.277 17:16:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:23.277 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:23.277 17:16:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:23.277 17:16:20 -- common/autotest_common.sh@1208 -- # local i=0 00:23:23.277 17:16:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:23.277 17:16:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:23.277 17:16:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:23.277 17:16:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:23.536 17:16:20 -- common/autotest_common.sh@1220 -- # return 0 00:23:23.536 17:16:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:23.536 17:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.536 17:16:20 -- common/autotest_common.sh@10 -- # set +x 00:23:23.536 17:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.536 17:16:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:23.536 17:16:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:23.536 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:23.536 17:16:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:23.536 17:16:20 -- common/autotest_common.sh@1208 -- # local i=0 00:23:23.536 17:16:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:23.536 17:16:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:23.536 17:16:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:23.536 17:16:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:23.536 17:16:20 -- common/autotest_common.sh@1220 -- # return 0 00:23:23.536 17:16:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:23.536 17:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.536 17:16:20 -- common/autotest_common.sh@10 -- # set +x 00:23:23.536 17:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.536 17:16:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:23.536 17:16:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:23.794 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:23.794 17:16:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:23.794 17:16:20 -- common/autotest_common.sh@1208 -- # local i=0 00:23:23.794 17:16:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:23.794 17:16:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:23.794 17:16:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:23.794 17:16:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:23.794 17:16:20 -- common/autotest_common.sh@1220 -- # return 0 00:23:23.794 17:16:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:23.794 17:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.794 17:16:20 -- common/autotest_common.sh@10 -- # set +x 00:23:23.794 17:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.794 17:16:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:23.794 17:16:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:24.052 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:24.052 17:16:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:24.052 17:16:20 -- common/autotest_common.sh@1208 -- # local i=0 00:23:24.052 17:16:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:24.052 17:16:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:24.052 17:16:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:24.052 17:16:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:24.052 17:16:20 -- common/autotest_common.sh@1220 -- # return 0 00:23:24.052 17:16:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:24.052 17:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.052 17:16:20 -- common/autotest_common.sh@10 -- # set +x 00:23:24.052 17:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.052 17:16:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:24.052 17:16:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:24.052 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:24.052 17:16:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:24.052 17:16:20 -- common/autotest_common.sh@1208 -- # local i=0 00:23:24.052 17:16:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:24.052 17:16:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:24.052 17:16:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:24.052 17:16:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:24.052 17:16:21 -- common/autotest_common.sh@1220 -- # return 0 00:23:24.052 17:16:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:24.052 17:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.052 17:16:21 -- common/autotest_common.sh@10 -- # set +x 00:23:24.311 17:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.311 17:16:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:24.311 17:16:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:24.311 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:24.311 17:16:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:24.311 17:16:21 -- common/autotest_common.sh@1208 -- # local i=0 00:23:24.311 17:16:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:24.311 17:16:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:24.311 17:16:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:24.311 17:16:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:24.311 17:16:21 -- common/autotest_common.sh@1220 -- # return 0 00:23:24.311 17:16:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:24.311 17:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.311 17:16:21 -- common/autotest_common.sh@10 -- # set +x 00:23:24.311 17:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.311 17:16:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:24.311 17:16:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:24.311 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:24.311 17:16:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:24.311 17:16:21 -- common/autotest_common.sh@1208 -- # local i=0 00:23:24.311 17:16:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:24.311 17:16:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:24.311 17:16:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:24.311 17:16:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:24.311 17:16:21 -- common/autotest_common.sh@1220 -- # return 0 00:23:24.311 17:16:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:24.311 17:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.311 17:16:21 -- common/autotest_common.sh@10 -- # set +x 00:23:24.311 17:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.311 17:16:21 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:24.311 17:16:21 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:24.311 17:16:21 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:24.311 17:16:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:24.311 17:16:21 -- nvmf/common.sh@116 -- # sync 00:23:24.311 17:16:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:24.311 17:16:21 -- nvmf/common.sh@119 -- # set +e 00:23:24.311 17:16:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:24.311 17:16:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:24.311 rmmod nvme_tcp 00:23:24.311 rmmod nvme_fabrics 00:23:24.311 rmmod nvme_keyring 00:23:24.569 17:16:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:24.569 17:16:21 -- nvmf/common.sh@123 -- # set -e 00:23:24.569 17:16:21 -- nvmf/common.sh@124 -- # return 0 00:23:24.569 17:16:21 -- nvmf/common.sh@477 -- # '[' -n 1789126 ']' 00:23:24.569 17:16:21 -- nvmf/common.sh@478 -- # killprocess 1789126 00:23:24.569 17:16:21 -- common/autotest_common.sh@936 -- # '[' -z 1789126 ']' 00:23:24.569 17:16:21 -- common/autotest_common.sh@940 -- # kill -0 1789126 00:23:24.569 17:16:21 -- common/autotest_common.sh@941 -- # uname 00:23:24.569 17:16:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:24.569 17:16:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1789126 00:23:24.569 17:16:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:24.569 17:16:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:24.569 17:16:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1789126' 00:23:24.569 killing process with pid 1789126 00:23:24.569 17:16:21 -- common/autotest_common.sh@955 -- # kill 1789126 00:23:24.569 17:16:21 -- common/autotest_common.sh@960 -- # wait 1789126 00:23:25.137 17:16:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:25.137 17:16:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:25.137 17:16:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:25.137 17:16:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:25.137 17:16:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:25.137 17:16:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:25.137 17:16:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:25.137 17:16:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.043 17:16:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:27.043 00:23:27.043 real 1m1.376s 00:23:27.043 user 3m23.210s 00:23:27.043 sys 0m26.510s 00:23:27.043 17:16:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:27.043 17:16:23 -- common/autotest_common.sh@10 -- # set +x 00:23:27.043 ************************************ 00:23:27.044 END TEST nvmf_multiconnection 00:23:27.044 ************************************ 00:23:27.044 17:16:23 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:27.044 17:16:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:27.044 17:16:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:27.044 17:16:23 -- common/autotest_common.sh@10 -- # set +x 00:23:27.044 ************************************ 00:23:27.044 START TEST nvmf_initiator_timeout 00:23:27.044 ************************************ 00:23:27.044 17:16:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:27.044 * Looking for test storage... 00:23:27.044 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:27.044 17:16:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:27.044 17:16:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:27.044 17:16:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:27.303 17:16:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:27.303 17:16:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:27.303 17:16:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:27.303 17:16:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:27.303 17:16:24 -- scripts/common.sh@335 -- # IFS=.-: 00:23:27.303 17:16:24 -- scripts/common.sh@335 -- # read -ra ver1 00:23:27.303 17:16:24 -- scripts/common.sh@336 -- # IFS=.-: 00:23:27.303 17:16:24 -- scripts/common.sh@336 -- # read -ra ver2 00:23:27.303 17:16:24 -- scripts/common.sh@337 -- # local 'op=<' 00:23:27.303 17:16:24 -- scripts/common.sh@339 -- # ver1_l=2 00:23:27.303 17:16:24 -- scripts/common.sh@340 -- # ver2_l=1 00:23:27.303 17:16:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:27.303 17:16:24 -- scripts/common.sh@343 -- # case "$op" in 00:23:27.303 17:16:24 -- scripts/common.sh@344 -- # : 1 00:23:27.303 17:16:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:27.303 17:16:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:27.303 17:16:24 -- scripts/common.sh@364 -- # decimal 1 00:23:27.303 17:16:24 -- scripts/common.sh@352 -- # local d=1 00:23:27.303 17:16:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:27.303 17:16:24 -- scripts/common.sh@354 -- # echo 1 00:23:27.303 17:16:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:27.303 17:16:24 -- scripts/common.sh@365 -- # decimal 2 00:23:27.303 17:16:24 -- scripts/common.sh@352 -- # local d=2 00:23:27.303 17:16:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:27.303 17:16:24 -- scripts/common.sh@354 -- # echo 2 00:23:27.303 17:16:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:27.303 17:16:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:27.303 17:16:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:27.303 17:16:24 -- scripts/common.sh@367 -- # return 0 00:23:27.303 17:16:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:27.303 17:16:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:27.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.303 --rc genhtml_branch_coverage=1 00:23:27.303 --rc genhtml_function_coverage=1 00:23:27.303 --rc genhtml_legend=1 00:23:27.303 --rc geninfo_all_blocks=1 00:23:27.303 --rc geninfo_unexecuted_blocks=1 00:23:27.303 00:23:27.303 ' 00:23:27.303 17:16:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:27.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.303 --rc genhtml_branch_coverage=1 00:23:27.303 --rc genhtml_function_coverage=1 00:23:27.303 --rc genhtml_legend=1 00:23:27.303 --rc geninfo_all_blocks=1 00:23:27.303 --rc geninfo_unexecuted_blocks=1 00:23:27.303 00:23:27.303 ' 00:23:27.303 17:16:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:27.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.303 --rc genhtml_branch_coverage=1 00:23:27.303 --rc genhtml_function_coverage=1 00:23:27.303 --rc genhtml_legend=1 00:23:27.303 --rc geninfo_all_blocks=1 00:23:27.303 --rc geninfo_unexecuted_blocks=1 00:23:27.303 00:23:27.303 ' 00:23:27.303 17:16:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:27.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.303 --rc genhtml_branch_coverage=1 00:23:27.303 --rc genhtml_function_coverage=1 00:23:27.303 --rc genhtml_legend=1 00:23:27.303 --rc geninfo_all_blocks=1 00:23:27.303 --rc geninfo_unexecuted_blocks=1 00:23:27.303 00:23:27.303 ' 00:23:27.303 17:16:24 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:27.303 17:16:24 -- nvmf/common.sh@7 -- # uname -s 00:23:27.303 17:16:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:27.303 17:16:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:27.304 17:16:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:27.304 17:16:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:27.304 17:16:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:27.304 17:16:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:27.304 17:16:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:27.304 17:16:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:27.304 17:16:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:27.304 17:16:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:27.304 17:16:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:27.304 17:16:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:27.304 17:16:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:27.304 17:16:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:27.304 17:16:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:27.304 17:16:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:27.304 17:16:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:27.304 17:16:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:27.304 17:16:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:27.304 17:16:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.304 17:16:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.304 17:16:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.304 17:16:24 -- paths/export.sh@5 -- # export PATH 00:23:27.304 17:16:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.304 17:16:24 -- nvmf/common.sh@46 -- # : 0 00:23:27.304 17:16:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:27.304 17:16:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:27.304 17:16:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:27.304 17:16:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:27.304 17:16:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:27.304 17:16:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:27.304 17:16:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:27.304 17:16:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:27.304 17:16:24 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:27.304 17:16:24 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:27.304 17:16:24 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:27.304 17:16:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:27.304 17:16:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:27.304 17:16:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:27.304 17:16:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:27.304 17:16:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:27.304 17:16:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.304 17:16:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:27.304 17:16:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.304 17:16:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:27.304 17:16:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:27.304 17:16:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:27.304 17:16:24 -- common/autotest_common.sh@10 -- # set +x 00:23:29.210 17:16:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:29.210 17:16:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:29.210 17:16:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:29.210 17:16:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:29.210 17:16:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:29.210 17:16:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:29.210 17:16:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:29.210 17:16:26 -- nvmf/common.sh@294 -- # net_devs=() 00:23:29.210 17:16:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:29.210 17:16:26 -- nvmf/common.sh@295 -- # e810=() 00:23:29.210 17:16:26 -- nvmf/common.sh@295 -- # local -ga e810 00:23:29.210 17:16:26 -- nvmf/common.sh@296 -- # x722=() 00:23:29.210 17:16:26 -- nvmf/common.sh@296 -- # local -ga x722 00:23:29.210 17:16:26 -- nvmf/common.sh@297 -- # mlx=() 00:23:29.210 17:16:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:29.210 17:16:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:29.210 17:16:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:29.210 17:16:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:29.210 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:29.210 17:16:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:29.210 17:16:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:29.210 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:29.210 17:16:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:29.210 17:16:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.210 17:16:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.210 17:16:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:29.210 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:29.210 17:16:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:29.210 17:16:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.210 17:16:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.210 17:16:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:29.210 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:29.210 17:16:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:29.210 17:16:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:29.210 17:16:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:29.210 17:16:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:29.210 17:16:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:29.210 17:16:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:29.210 17:16:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:29.210 17:16:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:29.210 17:16:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:29.210 17:16:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:29.210 17:16:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:29.210 17:16:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:29.210 17:16:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:29.210 17:16:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:29.210 17:16:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:29.210 17:16:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:29.210 17:16:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:29.210 17:16:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:29.210 17:16:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:29.210 17:16:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:29.210 17:16:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:29.210 17:16:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:29.210 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:29.210 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:23:29.210 00:23:29.210 --- 10.0.0.2 ping statistics --- 00:23:29.210 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.210 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:23:29.210 17:16:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:29.210 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:29.210 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:23:29.210 00:23:29.210 --- 10.0.0.1 ping statistics --- 00:23:29.210 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.210 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:23:29.210 17:16:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:29.210 17:16:26 -- nvmf/common.sh@410 -- # return 0 00:23:29.210 17:16:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:29.211 17:16:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:29.211 17:16:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:29.211 17:16:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:29.469 17:16:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:29.469 17:16:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:29.469 17:16:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:29.469 17:16:26 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:29.469 17:16:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:29.469 17:16:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:29.469 17:16:26 -- common/autotest_common.sh@10 -- # set +x 00:23:29.469 17:16:26 -- nvmf/common.sh@469 -- # nvmfpid=1798230 00:23:29.469 17:16:26 -- nvmf/common.sh@470 -- # waitforlisten 1798230 00:23:29.469 17:16:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:29.469 17:16:26 -- common/autotest_common.sh@829 -- # '[' -z 1798230 ']' 00:23:29.469 17:16:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:29.469 17:16:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:29.469 17:16:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:29.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:29.469 17:16:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:29.469 17:16:26 -- common/autotest_common.sh@10 -- # set +x 00:23:29.469 [2024-11-27 17:16:26.236327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:29.469 [2024-11-27 17:16:26.236420] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:29.469 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.469 [2024-11-27 17:16:26.313635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:29.469 [2024-11-27 17:16:26.412220] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:29.469 [2024-11-27 17:16:26.412394] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:29.469 [2024-11-27 17:16:26.412414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:29.469 [2024-11-27 17:16:26.412429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:29.469 [2024-11-27 17:16:26.413552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:29.469 [2024-11-27 17:16:26.416548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:29.469 [2024-11-27 17:16:26.416587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:29.469 [2024-11-27 17:16:26.416592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:30.405 17:16:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:30.405 17:16:27 -- common/autotest_common.sh@862 -- # return 0 00:23:30.405 17:16:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:30.405 17:16:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 17:16:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 Malloc0 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 Delay0 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 [2024-11-27 17:16:27.296121] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:30.405 17:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:30.405 17:16:27 -- common/autotest_common.sh@10 -- # set +x 00:23:30.405 [2024-11-27 17:16:27.324400] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:30.405 17:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:30.405 17:16:27 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:31.347 17:16:28 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:31.347 17:16:28 -- common/autotest_common.sh@1187 -- # local i=0 00:23:31.347 17:16:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:31.347 17:16:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:31.347 17:16:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:33.244 17:16:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:33.244 17:16:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:33.244 17:16:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:33.244 17:16:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:33.244 17:16:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:33.244 17:16:30 -- common/autotest_common.sh@1197 -- # return 0 00:23:33.244 17:16:30 -- target/initiator_timeout.sh@35 -- # fio_pid=1798800 00:23:33.244 17:16:30 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:33.244 17:16:30 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:33.244 [global] 00:23:33.244 thread=1 00:23:33.244 invalidate=1 00:23:33.244 rw=write 00:23:33.244 time_based=1 00:23:33.244 runtime=60 00:23:33.244 ioengine=libaio 00:23:33.244 direct=1 00:23:33.244 bs=4096 00:23:33.244 iodepth=1 00:23:33.244 norandommap=0 00:23:33.244 numjobs=1 00:23:33.244 00:23:33.244 verify_dump=1 00:23:33.244 verify_backlog=512 00:23:33.244 verify_state_save=0 00:23:33.244 do_verify=1 00:23:33.244 verify=crc32c-intel 00:23:33.244 [job0] 00:23:33.244 filename=/dev/nvme0n1 00:23:33.244 Could not set queue depth (nvme0n1) 00:23:33.502 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:33.502 fio-3.35 00:23:33.502 Starting 1 thread 00:23:36.788 17:16:33 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:36.788 17:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.788 17:16:33 -- common/autotest_common.sh@10 -- # set +x 00:23:36.788 true 00:23:36.788 17:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.788 17:16:33 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:36.788 17:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.788 17:16:33 -- common/autotest_common.sh@10 -- # set +x 00:23:36.788 true 00:23:36.788 17:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.788 17:16:33 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:36.788 17:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.788 17:16:33 -- common/autotest_common.sh@10 -- # set +x 00:23:36.788 true 00:23:36.788 17:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.788 17:16:33 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:36.788 17:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.788 17:16:33 -- common/autotest_common.sh@10 -- # set +x 00:23:36.788 true 00:23:36.788 17:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.788 17:16:33 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:39.317 17:16:36 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:39.318 17:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:39.318 17:16:36 -- common/autotest_common.sh@10 -- # set +x 00:23:39.318 true 00:23:39.318 17:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:39.318 17:16:36 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:39.318 17:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:39.318 17:16:36 -- common/autotest_common.sh@10 -- # set +x 00:23:39.318 true 00:23:39.318 17:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:39.318 17:16:36 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:39.318 17:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:39.318 17:16:36 -- common/autotest_common.sh@10 -- # set +x 00:23:39.318 true 00:23:39.318 17:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:39.318 17:16:36 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:39.318 17:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:39.318 17:16:36 -- common/autotest_common.sh@10 -- # set +x 00:23:39.318 true 00:23:39.318 17:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:39.318 17:16:36 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:39.318 17:16:36 -- target/initiator_timeout.sh@54 -- # wait 1798800 00:24:35.536 00:24:35.536 job0: (groupid=0, jobs=1): err= 0: pid=1798869: Wed Nov 27 17:17:30 2024 00:24:35.536 read: IOPS=74, BW=296KiB/s (303kB/s)(17.4MiB/60007msec) 00:24:35.536 slat (usec): min=5, max=15833, avg=16.90, stdev=237.47 00:24:35.536 clat (usec): min=239, max=41166k, avg=13215.55, stdev=617709.71 00:24:35.536 lat (usec): min=245, max=41166k, avg=13232.45, stdev=617710.06 00:24:35.536 clat percentiles (usec): 00:24:35.536 | 1.00th=[ 255], 5.00th=[ 265], 10.00th=[ 273], 00:24:35.536 | 20.00th=[ 281], 30.00th=[ 293], 40.00th=[ 302], 00:24:35.536 | 50.00th=[ 310], 60.00th=[ 314], 70.00th=[ 326], 00:24:35.536 | 80.00th=[ 445], 90.00th=[ 469], 95.00th=[ 41157], 00:24:35.536 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 42206], 00:24:35.536 | 99.95th=[ 44827], 99.99th=[17112761] 00:24:35.536 write: IOPS=76, BW=307KiB/s (315kB/s)(18.0MiB/60007msec); 0 zone resets 00:24:35.536 slat (usec): min=7, max=30885, avg=24.07, stdev=454.81 00:24:35.536 clat (usec): min=172, max=4187, avg=233.83, stdev=65.93 00:24:35.536 lat (usec): min=181, max=31189, avg=257.90, stdev=460.86 00:24:35.536 clat percentiles (usec): 00:24:35.536 | 1.00th=[ 182], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 208], 00:24:35.536 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 237], 00:24:35.536 | 70.00th=[ 241], 80.00th=[ 249], 90.00th=[ 273], 95.00th=[ 293], 00:24:35.536 | 99.00th=[ 330], 99.50th=[ 355], 99.90th=[ 412], 99.95th=[ 441], 00:24:35.536 | 99.99th=[ 4178] 00:24:35.536 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=1836.15, samples=6 00:24:35.536 iops : min= 1024, max= 2048, avg=1536.00, stdev=459.04, samples=6 00:24:35.536 lat (usec) : 250=41.67%, 500=53.90%, 750=0.02% 00:24:35.536 lat (msec) : 4=0.01%, 10=0.01%, 50=4.38%, >=2000=0.01% 00:24:35.536 cpu : usr=0.17%, sys=0.30%, ctx=9053, majf=0, minf=1 00:24:35.536 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:35.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:35.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:35.536 issued rwts: total=4442,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:35.536 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:35.536 00:24:35.536 Run status group 0 (all jobs): 00:24:35.536 READ: bw=296KiB/s (303kB/s), 296KiB/s-296KiB/s (303kB/s-303kB/s), io=17.4MiB (18.2MB), run=60007-60007msec 00:24:35.536 WRITE: bw=307KiB/s (315kB/s), 307KiB/s-307KiB/s (315kB/s-315kB/s), io=18.0MiB (18.9MB), run=60007-60007msec 00:24:35.536 00:24:35.536 Disk stats (read/write): 00:24:35.536 nvme0n1: ios=4491/4608, merge=0/0, ticks=18720/1020, in_queue=19740, util=99.68% 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:35.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:35.536 17:17:30 -- common/autotest_common.sh@1208 -- # local i=0 00:24:35.536 17:17:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:35.536 17:17:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:35.536 17:17:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:35.536 17:17:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:35.536 17:17:30 -- common/autotest_common.sh@1220 -- # return 0 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:35.536 nvmf hotplug test: fio successful as expected 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:35.536 17:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:35.536 17:17:30 -- common/autotest_common.sh@10 -- # set +x 00:24:35.536 17:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:35.536 17:17:30 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:35.536 17:17:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:35.536 17:17:30 -- nvmf/common.sh@116 -- # sync 00:24:35.536 17:17:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:35.536 17:17:30 -- nvmf/common.sh@119 -- # set +e 00:24:35.536 17:17:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:35.536 17:17:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:35.536 rmmod nvme_tcp 00:24:35.536 rmmod nvme_fabrics 00:24:35.536 rmmod nvme_keyring 00:24:35.536 17:17:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:35.536 17:17:30 -- nvmf/common.sh@123 -- # set -e 00:24:35.536 17:17:30 -- nvmf/common.sh@124 -- # return 0 00:24:35.536 17:17:30 -- nvmf/common.sh@477 -- # '[' -n 1798230 ']' 00:24:35.536 17:17:30 -- nvmf/common.sh@478 -- # killprocess 1798230 00:24:35.536 17:17:30 -- common/autotest_common.sh@936 -- # '[' -z 1798230 ']' 00:24:35.537 17:17:30 -- common/autotest_common.sh@940 -- # kill -0 1798230 00:24:35.537 17:17:30 -- common/autotest_common.sh@941 -- # uname 00:24:35.537 17:17:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:35.537 17:17:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1798230 00:24:35.537 17:17:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:35.537 17:17:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:35.537 17:17:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1798230' 00:24:35.537 killing process with pid 1798230 00:24:35.537 17:17:30 -- common/autotest_common.sh@955 -- # kill 1798230 00:24:35.537 17:17:30 -- common/autotest_common.sh@960 -- # wait 1798230 00:24:35.537 17:17:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:35.537 17:17:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:35.537 17:17:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:35.537 17:17:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:35.537 17:17:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:35.537 17:17:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:35.537 17:17:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:35.537 17:17:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:36.105 17:17:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:36.105 00:24:36.105 real 1m9.039s 00:24:36.105 user 4m14.188s 00:24:36.105 sys 0m6.609s 00:24:36.105 17:17:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:36.105 17:17:32 -- common/autotest_common.sh@10 -- # set +x 00:24:36.105 ************************************ 00:24:36.105 END TEST nvmf_initiator_timeout 00:24:36.105 ************************************ 00:24:36.105 17:17:32 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:36.105 17:17:32 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:36.105 17:17:32 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:36.105 17:17:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:36.105 17:17:32 -- common/autotest_common.sh@10 -- # set +x 00:24:38.638 17:17:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:38.638 17:17:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:38.638 17:17:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:38.638 17:17:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:38.638 17:17:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:38.638 17:17:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:38.638 17:17:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:38.638 17:17:35 -- nvmf/common.sh@294 -- # net_devs=() 00:24:38.638 17:17:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:38.638 17:17:35 -- nvmf/common.sh@295 -- # e810=() 00:24:38.638 17:17:35 -- nvmf/common.sh@295 -- # local -ga e810 00:24:38.638 17:17:35 -- nvmf/common.sh@296 -- # x722=() 00:24:38.638 17:17:35 -- nvmf/common.sh@296 -- # local -ga x722 00:24:38.638 17:17:35 -- nvmf/common.sh@297 -- # mlx=() 00:24:38.638 17:17:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:38.638 17:17:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:38.638 17:17:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:38.639 17:17:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:38.639 17:17:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:38.639 17:17:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:38.639 17:17:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:38.639 17:17:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:38.639 17:17:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.639 17:17:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:38.639 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:38.639 17:17:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.639 17:17:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:38.639 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:38.639 17:17:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:38.639 17:17:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.639 17:17:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.639 17:17:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.639 17:17:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.639 17:17:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:38.639 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:38.639 17:17:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.639 17:17:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.639 17:17:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.639 17:17:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.639 17:17:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.639 17:17:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:38.639 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:38.639 17:17:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.639 17:17:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:38.639 17:17:35 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:38.639 17:17:35 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:38.639 17:17:35 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:38.639 17:17:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:38.639 17:17:35 -- common/autotest_common.sh@10 -- # set +x 00:24:38.639 ************************************ 00:24:38.639 START TEST nvmf_perf_adq 00:24:38.639 ************************************ 00:24:38.639 17:17:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:38.639 * Looking for test storage... 00:24:38.639 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:38.639 17:17:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:38.639 17:17:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:38.639 17:17:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:38.639 17:17:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:38.639 17:17:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:38.639 17:17:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:38.639 17:17:35 -- scripts/common.sh@335 -- # IFS=.-: 00:24:38.639 17:17:35 -- scripts/common.sh@335 -- # read -ra ver1 00:24:38.639 17:17:35 -- scripts/common.sh@336 -- # IFS=.-: 00:24:38.639 17:17:35 -- scripts/common.sh@336 -- # read -ra ver2 00:24:38.639 17:17:35 -- scripts/common.sh@337 -- # local 'op=<' 00:24:38.639 17:17:35 -- scripts/common.sh@339 -- # ver1_l=2 00:24:38.639 17:17:35 -- scripts/common.sh@340 -- # ver2_l=1 00:24:38.639 17:17:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:38.639 17:17:35 -- scripts/common.sh@343 -- # case "$op" in 00:24:38.639 17:17:35 -- scripts/common.sh@344 -- # : 1 00:24:38.639 17:17:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:38.639 17:17:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:38.639 17:17:35 -- scripts/common.sh@364 -- # decimal 1 00:24:38.639 17:17:35 -- scripts/common.sh@352 -- # local d=1 00:24:38.639 17:17:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:38.639 17:17:35 -- scripts/common.sh@354 -- # echo 1 00:24:38.639 17:17:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:38.639 17:17:35 -- scripts/common.sh@365 -- # decimal 2 00:24:38.639 17:17:35 -- scripts/common.sh@352 -- # local d=2 00:24:38.639 17:17:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:38.639 17:17:35 -- scripts/common.sh@354 -- # echo 2 00:24:38.639 17:17:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:38.639 17:17:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:38.639 17:17:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:38.639 17:17:35 -- scripts/common.sh@367 -- # return 0 00:24:38.639 17:17:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:38.639 --rc genhtml_branch_coverage=1 00:24:38.639 --rc genhtml_function_coverage=1 00:24:38.639 --rc genhtml_legend=1 00:24:38.639 --rc geninfo_all_blocks=1 00:24:38.639 --rc geninfo_unexecuted_blocks=1 00:24:38.639 00:24:38.639 ' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:38.639 --rc genhtml_branch_coverage=1 00:24:38.639 --rc genhtml_function_coverage=1 00:24:38.639 --rc genhtml_legend=1 00:24:38.639 --rc geninfo_all_blocks=1 00:24:38.639 --rc geninfo_unexecuted_blocks=1 00:24:38.639 00:24:38.639 ' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:38.639 --rc genhtml_branch_coverage=1 00:24:38.639 --rc genhtml_function_coverage=1 00:24:38.639 --rc genhtml_legend=1 00:24:38.639 --rc geninfo_all_blocks=1 00:24:38.639 --rc geninfo_unexecuted_blocks=1 00:24:38.639 00:24:38.639 ' 00:24:38.639 17:17:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:38.639 --rc genhtml_branch_coverage=1 00:24:38.639 --rc genhtml_function_coverage=1 00:24:38.639 --rc genhtml_legend=1 00:24:38.639 --rc geninfo_all_blocks=1 00:24:38.639 --rc geninfo_unexecuted_blocks=1 00:24:38.639 00:24:38.639 ' 00:24:38.639 17:17:35 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:38.639 17:17:35 -- nvmf/common.sh@7 -- # uname -s 00:24:38.639 17:17:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:38.639 17:17:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:38.639 17:17:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:38.639 17:17:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:38.639 17:17:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:38.639 17:17:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:38.639 17:17:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:38.639 17:17:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:38.639 17:17:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:38.639 17:17:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:38.639 17:17:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:38.639 17:17:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:38.639 17:17:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:38.639 17:17:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:38.639 17:17:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:38.639 17:17:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:38.639 17:17:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:38.639 17:17:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:38.639 17:17:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:38.639 17:17:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.639 17:17:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.639 17:17:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.639 17:17:35 -- paths/export.sh@5 -- # export PATH 00:24:38.640 17:17:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.640 17:17:35 -- nvmf/common.sh@46 -- # : 0 00:24:38.640 17:17:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:38.640 17:17:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:38.640 17:17:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:38.640 17:17:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:38.640 17:17:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:38.640 17:17:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:38.640 17:17:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:38.640 17:17:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:38.640 17:17:35 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:38.640 17:17:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:38.640 17:17:35 -- common/autotest_common.sh@10 -- # set +x 00:24:40.545 17:17:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:40.545 17:17:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:40.545 17:17:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:40.545 17:17:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:40.545 17:17:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:40.545 17:17:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:40.545 17:17:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:40.545 17:17:37 -- nvmf/common.sh@294 -- # net_devs=() 00:24:40.545 17:17:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:40.545 17:17:37 -- nvmf/common.sh@295 -- # e810=() 00:24:40.545 17:17:37 -- nvmf/common.sh@295 -- # local -ga e810 00:24:40.545 17:17:37 -- nvmf/common.sh@296 -- # x722=() 00:24:40.545 17:17:37 -- nvmf/common.sh@296 -- # local -ga x722 00:24:40.545 17:17:37 -- nvmf/common.sh@297 -- # mlx=() 00:24:40.545 17:17:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:40.545 17:17:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:40.545 17:17:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:40.545 17:17:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:40.545 17:17:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:40.545 17:17:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:40.545 17:17:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:40.545 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:40.545 17:17:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:40.545 17:17:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:40.545 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:40.545 17:17:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:40.545 17:17:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:40.545 17:17:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:40.545 17:17:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:40.545 17:17:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:40.545 17:17:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:40.545 17:17:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:40.545 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:40.545 17:17:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:40.545 17:17:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:40.545 17:17:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:40.545 17:17:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:40.545 17:17:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:40.545 17:17:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:40.545 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:40.545 17:17:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:40.545 17:17:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:40.545 17:17:37 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:40.545 17:17:37 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:40.545 17:17:37 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:40.545 17:17:37 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:40.545 17:17:37 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:41.112 17:17:37 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:43.645 17:17:40 -- target/perf_adq.sh@54 -- # sleep 5 00:24:49.017 17:17:45 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:49.017 17:17:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:49.017 17:17:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:49.017 17:17:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:49.017 17:17:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:49.017 17:17:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:49.017 17:17:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.017 17:17:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.017 17:17:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:49.017 17:17:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:49.017 17:17:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:49.017 17:17:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:49.017 17:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:49.017 17:17:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:49.017 17:17:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:49.017 17:17:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:49.017 17:17:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:49.017 17:17:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:49.017 17:17:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:49.017 17:17:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:49.017 17:17:45 -- nvmf/common.sh@294 -- # net_devs=() 00:24:49.017 17:17:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:49.017 17:17:45 -- nvmf/common.sh@295 -- # e810=() 00:24:49.017 17:17:45 -- nvmf/common.sh@295 -- # local -ga e810 00:24:49.017 17:17:45 -- nvmf/common.sh@296 -- # x722=() 00:24:49.017 17:17:45 -- nvmf/common.sh@296 -- # local -ga x722 00:24:49.017 17:17:45 -- nvmf/common.sh@297 -- # mlx=() 00:24:49.017 17:17:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:49.017 17:17:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:49.017 17:17:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:49.018 17:17:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.018 17:17:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:49.018 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:49.018 17:17:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.018 17:17:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:49.018 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:49.018 17:17:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.018 17:17:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.018 17:17:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.018 17:17:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:49.018 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:49.018 17:17:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.018 17:17:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.018 17:17:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.018 17:17:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:49.018 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:49.018 17:17:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:49.018 17:17:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:49.018 17:17:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:49.018 17:17:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:49.018 17:17:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:49.018 17:17:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:49.018 17:17:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:49.018 17:17:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:49.018 17:17:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:49.018 17:17:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:49.018 17:17:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:49.018 17:17:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:49.018 17:17:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:49.018 17:17:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:49.018 17:17:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:49.018 17:17:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:49.018 17:17:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:49.018 17:17:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:49.018 17:17:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:49.018 17:17:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:49.018 17:17:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:49.018 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:49.018 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:24:49.018 00:24:49.018 --- 10.0.0.2 ping statistics --- 00:24:49.018 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.018 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:24:49.018 17:17:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:49.018 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:49.018 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:24:49.018 00:24:49.018 --- 10.0.0.1 ping statistics --- 00:24:49.018 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.018 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:24:49.018 17:17:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:49.018 17:17:45 -- nvmf/common.sh@410 -- # return 0 00:24:49.018 17:17:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:49.018 17:17:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:49.018 17:17:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:49.018 17:17:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:49.018 17:17:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:49.018 17:17:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:49.018 17:17:45 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:49.018 17:17:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:49.018 17:17:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:49.018 17:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:49.018 17:17:45 -- nvmf/common.sh@469 -- # nvmfpid=1810805 00:24:49.018 17:17:45 -- nvmf/common.sh@470 -- # waitforlisten 1810805 00:24:49.018 17:17:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:49.018 17:17:45 -- common/autotest_common.sh@829 -- # '[' -z 1810805 ']' 00:24:49.018 17:17:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:49.018 17:17:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:49.018 17:17:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:49.018 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:49.018 17:17:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:49.018 17:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:49.018 [2024-11-27 17:17:45.811017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:49.018 [2024-11-27 17:17:45.811107] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:49.018 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.018 [2024-11-27 17:17:45.889455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:49.277 [2024-11-27 17:17:45.989950] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:49.277 [2024-11-27 17:17:45.990113] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:49.277 [2024-11-27 17:17:45.990132] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:49.277 [2024-11-27 17:17:45.990147] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:49.277 [2024-11-27 17:17:45.990207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:49.277 [2024-11-27 17:17:45.990238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:49.277 [2024-11-27 17:17:45.990293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:49.277 [2024-11-27 17:17:45.990296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:49.277 17:17:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:49.277 17:17:46 -- common/autotest_common.sh@862 -- # return 0 00:24:49.277 17:17:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:49.277 17:17:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.277 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.277 17:17:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:49.277 17:17:46 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:49.277 17:17:46 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:49.277 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.277 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.277 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.277 17:17:46 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:49.277 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.277 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.277 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.277 17:17:46 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:49.277 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.277 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.277 [2024-11-27 17:17:46.221242] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.535 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.535 17:17:46 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:49.535 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.535 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.535 Malloc1 00:24:49.535 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.535 17:17:46 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:49.535 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.535 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.535 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.535 17:17:46 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:49.535 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.535 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.535 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.535 17:17:46 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:49.535 17:17:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.535 17:17:46 -- common/autotest_common.sh@10 -- # set +x 00:24:49.535 [2024-11-27 17:17:46.274320] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.535 17:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.535 17:17:46 -- target/perf_adq.sh@73 -- # perfpid=1810952 00:24:49.535 17:17:46 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:49.535 17:17:46 -- target/perf_adq.sh@74 -- # sleep 2 00:24:49.535 EAL: No free 2048 kB hugepages reported on node 1 00:24:51.435 17:17:48 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:51.436 17:17:48 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:51.436 17:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.436 17:17:48 -- common/autotest_common.sh@10 -- # set +x 00:24:51.436 17:17:48 -- target/perf_adq.sh@76 -- # wc -l 00:24:51.436 17:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.436 17:17:48 -- target/perf_adq.sh@76 -- # count=4 00:24:51.436 17:17:48 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:51.436 17:17:48 -- target/perf_adq.sh@81 -- # wait 1810952 00:24:59.543 Initializing NVMe Controllers 00:24:59.543 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:59.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:59.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:59.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:59.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:59.543 Initialization complete. Launching workers. 00:24:59.543 ======================================================== 00:24:59.543 Latency(us) 00:24:59.543 Device Information : IOPS MiB/s Average min max 00:24:59.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11175.60 43.65 5727.48 1328.82 8860.36 00:24:59.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10338.20 40.38 6192.08 2138.21 9824.47 00:24:59.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11654.90 45.53 5502.86 1284.08 43915.93 00:24:59.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11222.00 43.84 5704.43 1331.36 9346.49 00:24:59.543 ======================================================== 00:24:59.543 Total : 44390.69 173.40 5770.88 1284.08 43915.93 00:24:59.543 00:24:59.543 17:17:56 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:59.543 17:17:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:59.543 17:17:56 -- nvmf/common.sh@116 -- # sync 00:24:59.543 17:17:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:59.543 17:17:56 -- nvmf/common.sh@119 -- # set +e 00:24:59.543 17:17:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:59.543 17:17:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:59.543 rmmod nvme_tcp 00:24:59.543 rmmod nvme_fabrics 00:24:59.801 rmmod nvme_keyring 00:24:59.801 17:17:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:59.801 17:17:56 -- nvmf/common.sh@123 -- # set -e 00:24:59.801 17:17:56 -- nvmf/common.sh@124 -- # return 0 00:24:59.801 17:17:56 -- nvmf/common.sh@477 -- # '[' -n 1810805 ']' 00:24:59.801 17:17:56 -- nvmf/common.sh@478 -- # killprocess 1810805 00:24:59.801 17:17:56 -- common/autotest_common.sh@936 -- # '[' -z 1810805 ']' 00:24:59.801 17:17:56 -- common/autotest_common.sh@940 -- # kill -0 1810805 00:24:59.801 17:17:56 -- common/autotest_common.sh@941 -- # uname 00:24:59.801 17:17:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:59.801 17:17:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1810805 00:24:59.801 17:17:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:59.801 17:17:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:59.801 17:17:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1810805' 00:24:59.801 killing process with pid 1810805 00:24:59.801 17:17:56 -- common/autotest_common.sh@955 -- # kill 1810805 00:24:59.801 17:17:56 -- common/autotest_common.sh@960 -- # wait 1810805 00:25:00.059 17:17:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:00.059 17:17:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:00.059 17:17:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:00.059 17:17:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:00.059 17:17:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:00.059 17:17:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.059 17:17:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.059 17:17:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.960 17:17:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:01.960 17:17:58 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:01.960 17:17:58 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:02.893 17:17:59 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:05.419 17:18:01 -- target/perf_adq.sh@54 -- # sleep 5 00:25:10.686 17:18:06 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:10.686 17:18:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:10.686 17:18:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:10.686 17:18:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:10.686 17:18:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:10.686 17:18:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:10.686 17:18:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.686 17:18:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.686 17:18:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:10.686 17:18:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:10.686 17:18:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:10.686 17:18:06 -- common/autotest_common.sh@10 -- # set +x 00:25:10.686 17:18:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:10.686 17:18:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:10.686 17:18:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:10.686 17:18:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:10.686 17:18:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:10.686 17:18:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:10.686 17:18:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:10.686 17:18:06 -- nvmf/common.sh@294 -- # net_devs=() 00:25:10.686 17:18:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:10.686 17:18:06 -- nvmf/common.sh@295 -- # e810=() 00:25:10.686 17:18:06 -- nvmf/common.sh@295 -- # local -ga e810 00:25:10.686 17:18:06 -- nvmf/common.sh@296 -- # x722=() 00:25:10.686 17:18:06 -- nvmf/common.sh@296 -- # local -ga x722 00:25:10.686 17:18:06 -- nvmf/common.sh@297 -- # mlx=() 00:25:10.686 17:18:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:10.686 17:18:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:10.686 17:18:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:10.686 17:18:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:10.686 17:18:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:10.686 17:18:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:10.686 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:10.686 17:18:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:10.686 17:18:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:10.686 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:10.686 17:18:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:10.686 17:18:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:10.686 17:18:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:10.686 17:18:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:10.686 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:10.686 17:18:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:10.686 17:18:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:10.686 17:18:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:10.686 17:18:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:10.686 17:18:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:10.686 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:10.686 17:18:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:10.686 17:18:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:10.686 17:18:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:10.686 17:18:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:10.686 17:18:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:10.686 17:18:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:10.686 17:18:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:10.686 17:18:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:10.686 17:18:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:10.686 17:18:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:10.686 17:18:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:10.686 17:18:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:10.686 17:18:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:10.686 17:18:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:10.686 17:18:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:10.686 17:18:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:10.686 17:18:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:10.686 17:18:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:10.686 17:18:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:10.686 17:18:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:10.686 17:18:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:10.686 17:18:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:10.686 17:18:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:10.686 17:18:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:10.686 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:10.686 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:25:10.686 00:25:10.686 --- 10.0.0.2 ping statistics --- 00:25:10.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:10.686 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:25:10.686 17:18:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:10.686 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:10.686 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:25:10.686 00:25:10.686 --- 10.0.0.1 ping statistics --- 00:25:10.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:10.686 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:25:10.686 17:18:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:10.686 17:18:07 -- nvmf/common.sh@410 -- # return 0 00:25:10.686 17:18:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:10.686 17:18:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:10.686 17:18:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:10.686 17:18:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:10.686 17:18:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:10.686 17:18:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:10.686 17:18:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:10.686 17:18:07 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:10.686 17:18:07 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:10.686 17:18:07 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:10.686 17:18:07 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:10.686 net.core.busy_poll = 1 00:25:10.686 17:18:07 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:10.686 net.core.busy_read = 1 00:25:10.686 17:18:07 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:10.686 17:18:07 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:10.686 17:18:07 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:10.686 17:18:07 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:10.686 17:18:07 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:10.686 17:18:07 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:10.686 17:18:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:10.686 17:18:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:10.686 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.686 17:18:07 -- nvmf/common.sh@469 -- # nvmfpid=1813759 00:25:10.687 17:18:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:10.687 17:18:07 -- nvmf/common.sh@470 -- # waitforlisten 1813759 00:25:10.687 17:18:07 -- common/autotest_common.sh@829 -- # '[' -z 1813759 ']' 00:25:10.687 17:18:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:10.687 17:18:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:10.687 17:18:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:10.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:10.687 17:18:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 [2024-11-27 17:18:07.193029] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:10.687 [2024-11-27 17:18:07.193102] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:10.687 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.687 [2024-11-27 17:18:07.262620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:10.687 [2024-11-27 17:18:07.350467] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:10.687 [2024-11-27 17:18:07.350628] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:10.687 [2024-11-27 17:18:07.350646] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:10.687 [2024-11-27 17:18:07.350660] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:10.687 [2024-11-27 17:18:07.350710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:10.687 [2024-11-27 17:18:07.354544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:10.687 [2024-11-27 17:18:07.354617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:10.687 [2024-11-27 17:18:07.354621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:10.687 17:18:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:10.687 17:18:07 -- common/autotest_common.sh@862 -- # return 0 00:25:10.687 17:18:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:10.687 17:18:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 17:18:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:10.687 17:18:07 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:10.687 17:18:07 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 [2024-11-27 17:18:07.556105] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 Malloc1 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:10.687 17:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.687 17:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:10.687 [2024-11-27 17:18:07.608229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:10.687 17:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.687 17:18:07 -- target/perf_adq.sh@94 -- # perfpid=1813981 00:25:10.687 17:18:07 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:10.687 17:18:07 -- target/perf_adq.sh@95 -- # sleep 2 00:25:10.945 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.844 17:18:09 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:12.844 17:18:09 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:12.844 17:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:12.844 17:18:09 -- target/perf_adq.sh@97 -- # wc -l 00:25:12.844 17:18:09 -- common/autotest_common.sh@10 -- # set +x 00:25:12.844 17:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:12.844 17:18:09 -- target/perf_adq.sh@97 -- # count=2 00:25:12.844 17:18:09 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:12.844 17:18:09 -- target/perf_adq.sh@103 -- # wait 1813981 00:25:20.955 Initializing NVMe Controllers 00:25:20.955 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:20.955 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:20.955 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:20.955 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:20.955 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:20.955 Initialization complete. Launching workers. 00:25:20.955 ======================================================== 00:25:20.955 Latency(us) 00:25:20.955 Device Information : IOPS MiB/s Average min max 00:25:20.955 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 13933.00 54.43 4607.01 1377.87 45054.64 00:25:20.955 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4676.90 18.27 13748.75 1790.76 59833.02 00:25:20.955 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5801.40 22.66 11038.96 2428.81 58328.50 00:25:20.955 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4706.30 18.38 13607.67 1672.71 59041.08 00:25:20.955 ======================================================== 00:25:20.955 Total : 29117.60 113.74 8811.65 1377.87 59833.02 00:25:20.955 00:25:20.955 17:18:17 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:20.955 17:18:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:20.955 17:18:17 -- nvmf/common.sh@116 -- # sync 00:25:20.955 17:18:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:20.955 17:18:17 -- nvmf/common.sh@119 -- # set +e 00:25:20.955 17:18:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:20.955 17:18:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:20.955 rmmod nvme_tcp 00:25:20.955 rmmod nvme_fabrics 00:25:20.955 rmmod nvme_keyring 00:25:20.955 17:18:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:20.955 17:18:17 -- nvmf/common.sh@123 -- # set -e 00:25:20.955 17:18:17 -- nvmf/common.sh@124 -- # return 0 00:25:20.955 17:18:17 -- nvmf/common.sh@477 -- # '[' -n 1813759 ']' 00:25:20.955 17:18:17 -- nvmf/common.sh@478 -- # killprocess 1813759 00:25:20.955 17:18:17 -- common/autotest_common.sh@936 -- # '[' -z 1813759 ']' 00:25:20.955 17:18:17 -- common/autotest_common.sh@940 -- # kill -0 1813759 00:25:20.955 17:18:17 -- common/autotest_common.sh@941 -- # uname 00:25:20.955 17:18:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:20.955 17:18:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1813759 00:25:20.955 17:18:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:20.955 17:18:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:20.955 17:18:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1813759' 00:25:20.955 killing process with pid 1813759 00:25:20.955 17:18:17 -- common/autotest_common.sh@955 -- # kill 1813759 00:25:20.955 17:18:17 -- common/autotest_common.sh@960 -- # wait 1813759 00:25:21.214 17:18:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:21.214 17:18:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:21.214 17:18:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:21.214 17:18:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:21.214 17:18:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:21.214 17:18:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.214 17:18:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.214 17:18:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.746 17:18:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:23.746 17:18:20 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:23.746 00:25:23.746 real 0m45.098s 00:25:23.746 user 2m35.051s 00:25:23.746 sys 0m11.766s 00:25:23.746 17:18:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:23.746 17:18:20 -- common/autotest_common.sh@10 -- # set +x 00:25:23.746 ************************************ 00:25:23.746 END TEST nvmf_perf_adq 00:25:23.746 ************************************ 00:25:23.746 17:18:20 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:23.746 17:18:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:23.746 17:18:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:23.746 17:18:20 -- common/autotest_common.sh@10 -- # set +x 00:25:23.746 ************************************ 00:25:23.746 START TEST nvmf_shutdown 00:25:23.746 ************************************ 00:25:23.746 17:18:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:23.746 * Looking for test storage... 00:25:23.746 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:23.746 17:18:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:23.746 17:18:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:23.746 17:18:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:23.746 17:18:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:23.746 17:18:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:23.746 17:18:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:23.746 17:18:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:23.746 17:18:20 -- scripts/common.sh@335 -- # IFS=.-: 00:25:23.746 17:18:20 -- scripts/common.sh@335 -- # read -ra ver1 00:25:23.746 17:18:20 -- scripts/common.sh@336 -- # IFS=.-: 00:25:23.746 17:18:20 -- scripts/common.sh@336 -- # read -ra ver2 00:25:23.746 17:18:20 -- scripts/common.sh@337 -- # local 'op=<' 00:25:23.747 17:18:20 -- scripts/common.sh@339 -- # ver1_l=2 00:25:23.747 17:18:20 -- scripts/common.sh@340 -- # ver2_l=1 00:25:23.747 17:18:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:23.747 17:18:20 -- scripts/common.sh@343 -- # case "$op" in 00:25:23.747 17:18:20 -- scripts/common.sh@344 -- # : 1 00:25:23.747 17:18:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:23.747 17:18:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:23.747 17:18:20 -- scripts/common.sh@364 -- # decimal 1 00:25:23.747 17:18:20 -- scripts/common.sh@352 -- # local d=1 00:25:23.747 17:18:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:23.747 17:18:20 -- scripts/common.sh@354 -- # echo 1 00:25:23.747 17:18:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:23.747 17:18:20 -- scripts/common.sh@365 -- # decimal 2 00:25:23.747 17:18:20 -- scripts/common.sh@352 -- # local d=2 00:25:23.747 17:18:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:23.747 17:18:20 -- scripts/common.sh@354 -- # echo 2 00:25:23.747 17:18:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:23.747 17:18:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:23.747 17:18:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:23.747 17:18:20 -- scripts/common.sh@367 -- # return 0 00:25:23.747 17:18:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:23.747 17:18:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:23.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.747 --rc genhtml_branch_coverage=1 00:25:23.747 --rc genhtml_function_coverage=1 00:25:23.747 --rc genhtml_legend=1 00:25:23.747 --rc geninfo_all_blocks=1 00:25:23.747 --rc geninfo_unexecuted_blocks=1 00:25:23.747 00:25:23.747 ' 00:25:23.747 17:18:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:23.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.747 --rc genhtml_branch_coverage=1 00:25:23.747 --rc genhtml_function_coverage=1 00:25:23.747 --rc genhtml_legend=1 00:25:23.747 --rc geninfo_all_blocks=1 00:25:23.747 --rc geninfo_unexecuted_blocks=1 00:25:23.747 00:25:23.747 ' 00:25:23.747 17:18:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:23.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.747 --rc genhtml_branch_coverage=1 00:25:23.747 --rc genhtml_function_coverage=1 00:25:23.747 --rc genhtml_legend=1 00:25:23.747 --rc geninfo_all_blocks=1 00:25:23.747 --rc geninfo_unexecuted_blocks=1 00:25:23.747 00:25:23.747 ' 00:25:23.747 17:18:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:23.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.747 --rc genhtml_branch_coverage=1 00:25:23.747 --rc genhtml_function_coverage=1 00:25:23.747 --rc genhtml_legend=1 00:25:23.747 --rc geninfo_all_blocks=1 00:25:23.747 --rc geninfo_unexecuted_blocks=1 00:25:23.747 00:25:23.747 ' 00:25:23.747 17:18:20 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:23.747 17:18:20 -- nvmf/common.sh@7 -- # uname -s 00:25:23.747 17:18:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:23.747 17:18:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:23.747 17:18:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:23.747 17:18:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:23.747 17:18:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:23.747 17:18:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:23.747 17:18:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:23.747 17:18:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:23.747 17:18:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:23.747 17:18:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:23.747 17:18:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.747 17:18:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.747 17:18:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:23.747 17:18:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:23.747 17:18:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:23.747 17:18:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:23.747 17:18:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:23.747 17:18:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:23.747 17:18:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:23.747 17:18:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.747 17:18:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.747 17:18:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.747 17:18:20 -- paths/export.sh@5 -- # export PATH 00:25:23.747 17:18:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.747 17:18:20 -- nvmf/common.sh@46 -- # : 0 00:25:23.747 17:18:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:23.747 17:18:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:23.747 17:18:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:23.747 17:18:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:23.747 17:18:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:23.747 17:18:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:23.747 17:18:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:23.747 17:18:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:23.747 17:18:20 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:23.747 17:18:20 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:23.747 17:18:20 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:23.747 17:18:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:23.747 17:18:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:23.747 17:18:20 -- common/autotest_common.sh@10 -- # set +x 00:25:23.747 ************************************ 00:25:23.747 START TEST nvmf_shutdown_tc1 00:25:23.747 ************************************ 00:25:23.747 17:18:20 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:23.747 17:18:20 -- target/shutdown.sh@74 -- # starttarget 00:25:23.747 17:18:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:23.747 17:18:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:23.747 17:18:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:23.748 17:18:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:23.748 17:18:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:23.748 17:18:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:23.748 17:18:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.748 17:18:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.748 17:18:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.748 17:18:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:23.748 17:18:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:23.748 17:18:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:23.748 17:18:20 -- common/autotest_common.sh@10 -- # set +x 00:25:25.649 17:18:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:25.649 17:18:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:25.649 17:18:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:25.649 17:18:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:25.649 17:18:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:25.649 17:18:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:25.649 17:18:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:25.649 17:18:22 -- nvmf/common.sh@294 -- # net_devs=() 00:25:25.649 17:18:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:25.649 17:18:22 -- nvmf/common.sh@295 -- # e810=() 00:25:25.649 17:18:22 -- nvmf/common.sh@295 -- # local -ga e810 00:25:25.649 17:18:22 -- nvmf/common.sh@296 -- # x722=() 00:25:25.649 17:18:22 -- nvmf/common.sh@296 -- # local -ga x722 00:25:25.649 17:18:22 -- nvmf/common.sh@297 -- # mlx=() 00:25:25.649 17:18:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:25.649 17:18:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:25.649 17:18:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:25.649 17:18:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:25.649 17:18:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:25.649 17:18:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.649 17:18:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:25.649 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:25.649 17:18:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.649 17:18:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:25.649 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:25.649 17:18:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:25.649 17:18:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:25.649 17:18:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.649 17:18:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.649 17:18:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.649 17:18:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.649 17:18:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:25.650 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:25.650 17:18:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.650 17:18:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.650 17:18:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.650 17:18:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.650 17:18:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.650 17:18:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:25.650 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:25.650 17:18:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.650 17:18:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:25.650 17:18:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:25.650 17:18:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:25.650 17:18:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:25.650 17:18:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:25.650 17:18:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:25.650 17:18:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:25.650 17:18:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:25.650 17:18:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:25.650 17:18:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:25.650 17:18:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:25.650 17:18:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:25.650 17:18:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:25.650 17:18:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:25.650 17:18:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:25.650 17:18:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:25.650 17:18:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:25.650 17:18:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:25.650 17:18:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:25.650 17:18:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:25.650 17:18:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:25.650 17:18:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:25.650 17:18:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:25.650 17:18:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:25.650 17:18:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:25.650 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:25.650 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:25:25.650 00:25:25.650 --- 10.0.0.2 ping statistics --- 00:25:25.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.650 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:25:25.650 17:18:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:25.650 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:25.650 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:25:25.650 00:25:25.650 --- 10.0.0.1 ping statistics --- 00:25:25.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.650 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:25:25.650 17:18:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:25.650 17:18:22 -- nvmf/common.sh@410 -- # return 0 00:25:25.650 17:18:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:25.650 17:18:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:25.650 17:18:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:25.650 17:18:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:25.650 17:18:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:25.650 17:18:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:25.650 17:18:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:25.650 17:18:22 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:25.650 17:18:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:25.650 17:18:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.650 17:18:22 -- common/autotest_common.sh@10 -- # set +x 00:25:25.650 17:18:22 -- nvmf/common.sh@469 -- # nvmfpid=1817570 00:25:25.650 17:18:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:25.650 17:18:22 -- nvmf/common.sh@470 -- # waitforlisten 1817570 00:25:25.650 17:18:22 -- common/autotest_common.sh@829 -- # '[' -z 1817570 ']' 00:25:25.650 17:18:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:25.650 17:18:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.650 17:18:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:25.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:25.650 17:18:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.650 17:18:22 -- common/autotest_common.sh@10 -- # set +x 00:25:25.650 [2024-11-27 17:18:22.556974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:25.650 [2024-11-27 17:18:22.557075] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:25.650 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.909 [2024-11-27 17:18:22.628754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:25.909 [2024-11-27 17:18:22.718480] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:25.909 [2024-11-27 17:18:22.718674] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:25.909 [2024-11-27 17:18:22.718694] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:25.909 [2024-11-27 17:18:22.718708] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:25.909 [2024-11-27 17:18:22.718815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:25.909 [2024-11-27 17:18:22.718863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:25.909 [2024-11-27 17:18:22.718920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:25.909 [2024-11-27 17:18:22.718922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:26.842 17:18:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.842 17:18:23 -- common/autotest_common.sh@862 -- # return 0 00:25:26.842 17:18:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:26.842 17:18:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.842 17:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:26.842 17:18:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:26.842 17:18:23 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:26.842 17:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.842 17:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:26.842 [2024-11-27 17:18:23.538147] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:26.842 17:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.842 17:18:23 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:26.842 17:18:23 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:26.842 17:18:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:26.842 17:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:26.842 17:18:23 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:26.842 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.842 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.842 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.842 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.842 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.842 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.842 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.842 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.843 17:18:23 -- target/shutdown.sh@28 -- # cat 00:25:26.843 17:18:23 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:26.843 17:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.843 17:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:26.843 Malloc1 00:25:26.843 [2024-11-27 17:18:23.626317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:26.843 Malloc2 00:25:26.843 Malloc3 00:25:26.843 Malloc4 00:25:27.101 Malloc5 00:25:27.101 Malloc6 00:25:27.101 Malloc7 00:25:27.101 Malloc8 00:25:27.101 Malloc9 00:25:27.360 Malloc10 00:25:27.360 17:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.360 17:18:24 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:27.360 17:18:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:27.360 17:18:24 -- common/autotest_common.sh@10 -- # set +x 00:25:27.360 17:18:24 -- target/shutdown.sh@78 -- # perfpid=1817823 00:25:27.360 17:18:24 -- target/shutdown.sh@79 -- # waitforlisten 1817823 /var/tmp/bdevperf.sock 00:25:27.360 17:18:24 -- common/autotest_common.sh@829 -- # '[' -z 1817823 ']' 00:25:27.360 17:18:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:27.360 17:18:24 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:27.360 17:18:24 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:27.360 17:18:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:27.360 17:18:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:27.360 17:18:24 -- nvmf/common.sh@520 -- # config=() 00:25:27.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:27.360 17:18:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:27.360 17:18:24 -- nvmf/common.sh@520 -- # local subsystem config 00:25:27.360 17:18:24 -- common/autotest_common.sh@10 -- # set +x 00:25:27.360 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.360 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.360 { 00:25:27.360 "params": { 00:25:27.360 "name": "Nvme$subsystem", 00:25:27.360 "trtype": "$TEST_TRANSPORT", 00:25:27.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.360 "adrfam": "ipv4", 00:25:27.360 "trsvcid": "$NVMF_PORT", 00:25:27.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.360 "hdgst": ${hdgst:-false}, 00:25:27.360 "ddgst": ${ddgst:-false} 00:25:27.360 }, 00:25:27.360 "method": "bdev_nvme_attach_controller" 00:25:27.360 } 00:25:27.360 EOF 00:25:27.360 )") 00:25:27.360 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.360 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.360 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.360 { 00:25:27.360 "params": { 00:25:27.360 "name": "Nvme$subsystem", 00:25:27.360 "trtype": "$TEST_TRANSPORT", 00:25:27.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.361 { 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme$subsystem", 00:25:27.361 "trtype": "$TEST_TRANSPORT", 00:25:27.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.361 "adrfam": "ipv4", 00:25:27.361 "trsvcid": "$NVMF_PORT", 00:25:27.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.361 "hdgst": ${hdgst:-false}, 00:25:27.361 "ddgst": ${ddgst:-false} 00:25:27.361 }, 00:25:27.361 "method": "bdev_nvme_attach_controller" 00:25:27.361 } 00:25:27.361 EOF 00:25:27.361 )") 00:25:27.361 17:18:24 -- nvmf/common.sh@542 -- # cat 00:25:27.361 17:18:24 -- nvmf/common.sh@544 -- # jq . 00:25:27.361 17:18:24 -- nvmf/common.sh@545 -- # IFS=, 00:25:27.361 17:18:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:27.361 "params": { 00:25:27.361 "name": "Nvme1", 00:25:27.361 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme2", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme3", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme4", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme5", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme6", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme7", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme8", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme9", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 },{ 00:25:27.362 "params": { 00:25:27.362 "name": "Nvme10", 00:25:27.362 "trtype": "tcp", 00:25:27.362 "traddr": "10.0.0.2", 00:25:27.362 "adrfam": "ipv4", 00:25:27.362 "trsvcid": "4420", 00:25:27.362 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:27.362 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:27.362 "hdgst": false, 00:25:27.362 "ddgst": false 00:25:27.362 }, 00:25:27.362 "method": "bdev_nvme_attach_controller" 00:25:27.362 }' 00:25:27.362 [2024-11-27 17:18:24.147395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:27.362 [2024-11-27 17:18:24.147482] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:27.362 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.362 [2024-11-27 17:18:24.212008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:27.362 [2024-11-27 17:18:24.297233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:29.311 17:18:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.311 17:18:25 -- common/autotest_common.sh@862 -- # return 0 00:25:29.311 17:18:25 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:29.311 17:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.311 17:18:25 -- common/autotest_common.sh@10 -- # set +x 00:25:29.311 17:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.311 17:18:25 -- target/shutdown.sh@83 -- # kill -9 1817823 00:25:29.311 17:18:25 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:29.311 17:18:25 -- target/shutdown.sh@87 -- # sleep 1 00:25:30.242 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1817823 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:30.243 17:18:26 -- target/shutdown.sh@88 -- # kill -0 1817570 00:25:30.243 17:18:26 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:30.243 17:18:26 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:30.243 17:18:26 -- nvmf/common.sh@520 -- # config=() 00:25:30.243 17:18:26 -- nvmf/common.sh@520 -- # local subsystem config 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:30.243 { 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme$subsystem", 00:25:30.243 "trtype": "$TEST_TRANSPORT", 00:25:30.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "$NVMF_PORT", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:30.243 "hdgst": ${hdgst:-false}, 00:25:30.243 "ddgst": ${ddgst:-false} 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 } 00:25:30.243 EOF 00:25:30.243 )") 00:25:30.243 17:18:26 -- nvmf/common.sh@542 -- # cat 00:25:30.243 17:18:26 -- nvmf/common.sh@544 -- # jq . 00:25:30.243 17:18:26 -- nvmf/common.sh@545 -- # IFS=, 00:25:30.243 17:18:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme1", 00:25:30.243 "trtype": "tcp", 00:25:30.243 "traddr": "10.0.0.2", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "4420", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:30.243 "hdgst": false, 00:25:30.243 "ddgst": false 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 },{ 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme2", 00:25:30.243 "trtype": "tcp", 00:25:30.243 "traddr": "10.0.0.2", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "4420", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:30.243 "hdgst": false, 00:25:30.243 "ddgst": false 00:25:30.243 }, 00:25:30.243 "method": "bdev_nvme_attach_controller" 00:25:30.243 },{ 00:25:30.243 "params": { 00:25:30.243 "name": "Nvme3", 00:25:30.243 "trtype": "tcp", 00:25:30.243 "traddr": "10.0.0.2", 00:25:30.243 "adrfam": "ipv4", 00:25:30.243 "trsvcid": "4420", 00:25:30.243 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:30.243 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme4", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme5", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme6", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme7", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme8", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme9", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 },{ 00:25:30.244 "params": { 00:25:30.244 "name": "Nvme10", 00:25:30.244 "trtype": "tcp", 00:25:30.244 "traddr": "10.0.0.2", 00:25:30.244 "adrfam": "ipv4", 00:25:30.244 "trsvcid": "4420", 00:25:30.244 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:30.244 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:30.244 "hdgst": false, 00:25:30.244 "ddgst": false 00:25:30.244 }, 00:25:30.244 "method": "bdev_nvme_attach_controller" 00:25:30.244 }' 00:25:30.244 [2024-11-27 17:18:26.959869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:30.244 [2024-11-27 17:18:26.959960] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1818138 ] 00:25:30.244 EAL: No free 2048 kB hugepages reported on node 1 00:25:30.244 [2024-11-27 17:18:27.026903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:30.244 [2024-11-27 17:18:27.115264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:31.618 Running I/O for 1 seconds... 00:25:32.992 00:25:32.992 Latency(us) 00:25:32.992 [2024-11-27T16:18:29.943Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:32.992 [2024-11-27T16:18:29.943Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.992 Verification LBA range: start 0x0 length 0x400 00:25:32.992 Nvme1n1 : 1.06 374.03 23.38 0.00 0.00 167256.95 33010.73 126605.84 00:25:32.992 [2024-11-27T16:18:29.943Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.992 Verification LBA range: start 0x0 length 0x400 00:25:32.992 Nvme2n1 : 1.07 373.26 23.33 0.00 0.00 166418.75 33010.73 123498.95 00:25:32.992 [2024-11-27T16:18:29.943Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.992 Verification LBA range: start 0x0 length 0x400 00:25:32.992 Nvme3n1 : 1.07 371.70 23.23 0.00 0.00 165786.44 34564.17 122722.23 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme4n1 : 1.08 369.76 23.11 0.00 0.00 165259.52 36700.16 121945.51 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme5n1 : 1.08 368.28 23.02 0.00 0.00 164808.71 36311.80 125829.12 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme6n1 : 1.08 367.23 22.95 0.00 0.00 164196.89 35340.89 126605.84 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme7n1 : 1.09 366.12 22.88 0.00 0.00 163502.14 35146.71 128936.01 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme8n1 : 1.09 365.25 22.83 0.00 0.00 162832.75 32816.55 131266.18 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme9n1 : 1.09 367.92 22.99 0.00 0.00 160872.76 1159.02 134373.07 00:25:32.993 [2024-11-27T16:18:29.944Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:32.993 Verification LBA range: start 0x0 length 0x400 00:25:32.993 Nvme10n1 : 1.13 353.73 22.11 0.00 0.00 161258.84 5873.97 135149.80 00:25:32.993 [2024-11-27T16:18:29.944Z] =================================================================================================================== 00:25:32.993 [2024-11-27T16:18:29.944Z] Total : 3677.28 229.83 0.00 0.00 164213.79 1159.02 135149.80 00:25:32.993 17:18:29 -- target/shutdown.sh@93 -- # stoptarget 00:25:32.993 17:18:29 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:32.993 17:18:29 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:32.993 17:18:29 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:32.993 17:18:29 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:32.993 17:18:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:32.993 17:18:29 -- nvmf/common.sh@116 -- # sync 00:25:32.993 17:18:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:32.993 17:18:29 -- nvmf/common.sh@119 -- # set +e 00:25:32.993 17:18:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:32.993 17:18:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:32.993 rmmod nvme_tcp 00:25:32.993 rmmod nvme_fabrics 00:25:32.993 rmmod nvme_keyring 00:25:32.993 17:18:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:32.993 17:18:29 -- nvmf/common.sh@123 -- # set -e 00:25:32.993 17:18:29 -- nvmf/common.sh@124 -- # return 0 00:25:32.993 17:18:29 -- nvmf/common.sh@477 -- # '[' -n 1817570 ']' 00:25:32.993 17:18:29 -- nvmf/common.sh@478 -- # killprocess 1817570 00:25:32.993 17:18:29 -- common/autotest_common.sh@936 -- # '[' -z 1817570 ']' 00:25:32.993 17:18:29 -- common/autotest_common.sh@940 -- # kill -0 1817570 00:25:32.993 17:18:29 -- common/autotest_common.sh@941 -- # uname 00:25:32.993 17:18:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:32.993 17:18:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1817570 00:25:32.993 17:18:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:32.993 17:18:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:32.993 17:18:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1817570' 00:25:32.993 killing process with pid 1817570 00:25:32.993 17:18:29 -- common/autotest_common.sh@955 -- # kill 1817570 00:25:32.993 17:18:29 -- common/autotest_common.sh@960 -- # wait 1817570 00:25:33.558 17:18:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:33.558 17:18:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:33.558 17:18:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:33.559 17:18:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:33.559 17:18:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:33.559 17:18:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.559 17:18:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.559 17:18:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.089 17:18:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:36.089 00:25:36.089 real 0m12.048s 00:25:36.089 user 0m35.210s 00:25:36.089 sys 0m3.259s 00:25:36.089 17:18:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:36.089 17:18:32 -- common/autotest_common.sh@10 -- # set +x 00:25:36.089 ************************************ 00:25:36.089 END TEST nvmf_shutdown_tc1 00:25:36.089 ************************************ 00:25:36.089 17:18:32 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:36.089 17:18:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:36.089 17:18:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:36.089 17:18:32 -- common/autotest_common.sh@10 -- # set +x 00:25:36.089 ************************************ 00:25:36.089 START TEST nvmf_shutdown_tc2 00:25:36.089 ************************************ 00:25:36.089 17:18:32 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:36.089 17:18:32 -- target/shutdown.sh@98 -- # starttarget 00:25:36.089 17:18:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:36.089 17:18:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:36.089 17:18:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:36.089 17:18:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:36.089 17:18:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:36.089 17:18:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:36.089 17:18:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.089 17:18:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.089 17:18:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.089 17:18:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:36.089 17:18:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:36.089 17:18:32 -- common/autotest_common.sh@10 -- # set +x 00:25:36.089 17:18:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:36.089 17:18:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:36.089 17:18:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:36.089 17:18:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:36.089 17:18:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:36.089 17:18:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:36.089 17:18:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:36.089 17:18:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:36.089 17:18:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:36.089 17:18:32 -- nvmf/common.sh@295 -- # e810=() 00:25:36.089 17:18:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:36.089 17:18:32 -- nvmf/common.sh@296 -- # x722=() 00:25:36.089 17:18:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:36.089 17:18:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:36.089 17:18:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:36.089 17:18:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:36.089 17:18:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.089 17:18:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:36.089 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:36.089 17:18:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.089 17:18:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:36.089 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:36.089 17:18:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.089 17:18:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.089 17:18:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.089 17:18:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:36.089 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:36.089 17:18:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.089 17:18:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.089 17:18:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.089 17:18:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:36.089 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:36.089 17:18:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:36.089 17:18:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:36.089 17:18:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:36.089 17:18:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:36.089 17:18:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:36.089 17:18:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:36.089 17:18:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:36.089 17:18:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:36.089 17:18:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:36.089 17:18:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:36.089 17:18:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:36.089 17:18:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:36.089 17:18:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:36.089 17:18:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:36.089 17:18:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:36.089 17:18:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:36.089 17:18:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:36.089 17:18:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:36.089 17:18:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:36.089 17:18:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:36.089 17:18:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:36.089 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:36.089 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.121 ms 00:25:36.089 00:25:36.089 --- 10.0.0.2 ping statistics --- 00:25:36.089 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.089 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:25:36.089 17:18:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:36.089 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:36.089 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:25:36.089 00:25:36.089 --- 10.0.0.1 ping statistics --- 00:25:36.089 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.089 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:25:36.089 17:18:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:36.089 17:18:32 -- nvmf/common.sh@410 -- # return 0 00:25:36.089 17:18:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:36.089 17:18:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:36.089 17:18:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:36.089 17:18:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:36.089 17:18:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:36.089 17:18:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:36.089 17:18:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:36.089 17:18:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:36.090 17:18:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:36.090 17:18:32 -- common/autotest_common.sh@10 -- # set +x 00:25:36.090 17:18:32 -- nvmf/common.sh@469 -- # nvmfpid=1818937 00:25:36.090 17:18:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:36.090 17:18:32 -- nvmf/common.sh@470 -- # waitforlisten 1818937 00:25:36.090 17:18:32 -- common/autotest_common.sh@829 -- # '[' -z 1818937 ']' 00:25:36.090 17:18:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:36.090 17:18:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:36.090 17:18:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:36.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:36.090 17:18:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:36.090 17:18:32 -- common/autotest_common.sh@10 -- # set +x 00:25:36.090 [2024-11-27 17:18:32.672608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:36.090 [2024-11-27 17:18:32.672699] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:36.090 EAL: No free 2048 kB hugepages reported on node 1 00:25:36.090 [2024-11-27 17:18:32.744078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:36.090 [2024-11-27 17:18:32.835689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:36.090 [2024-11-27 17:18:32.835856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:36.090 [2024-11-27 17:18:32.835877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:36.090 [2024-11-27 17:18:32.835899] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:36.090 [2024-11-27 17:18:32.835993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:36.090 [2024-11-27 17:18:32.836109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:36.090 [2024-11-27 17:18:32.836175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:36.090 [2024-11-27 17:18:32.836178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:37.023 17:18:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.023 17:18:33 -- common/autotest_common.sh@862 -- # return 0 00:25:37.023 17:18:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:37.023 17:18:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.023 17:18:33 -- common/autotest_common.sh@10 -- # set +x 00:25:37.023 17:18:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:37.023 17:18:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:37.023 17:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.023 17:18:33 -- common/autotest_common.sh@10 -- # set +x 00:25:37.023 [2024-11-27 17:18:33.687219] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:37.023 17:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.023 17:18:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:37.023 17:18:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:37.023 17:18:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:37.023 17:18:33 -- common/autotest_common.sh@10 -- # set +x 00:25:37.023 17:18:33 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.023 17:18:33 -- target/shutdown.sh@28 -- # cat 00:25:37.023 17:18:33 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:37.023 17:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.023 17:18:33 -- common/autotest_common.sh@10 -- # set +x 00:25:37.023 Malloc1 00:25:37.023 [2024-11-27 17:18:33.775165] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.023 Malloc2 00:25:37.023 Malloc3 00:25:37.023 Malloc4 00:25:37.023 Malloc5 00:25:37.282 Malloc6 00:25:37.282 Malloc7 00:25:37.282 Malloc8 00:25:37.282 Malloc9 00:25:37.282 Malloc10 00:25:37.282 17:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.282 17:18:34 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:37.282 17:18:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.282 17:18:34 -- common/autotest_common.sh@10 -- # set +x 00:25:37.541 17:18:34 -- target/shutdown.sh@102 -- # perfpid=1819239 00:25:37.541 17:18:34 -- target/shutdown.sh@103 -- # waitforlisten 1819239 /var/tmp/bdevperf.sock 00:25:37.541 17:18:34 -- common/autotest_common.sh@829 -- # '[' -z 1819239 ']' 00:25:37.541 17:18:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:37.541 17:18:34 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:37.541 17:18:34 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:37.541 17:18:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:37.541 17:18:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:37.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:37.541 17:18:34 -- nvmf/common.sh@520 -- # config=() 00:25:37.541 17:18:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:37.541 17:18:34 -- nvmf/common.sh@520 -- # local subsystem config 00:25:37.541 17:18:34 -- common/autotest_common.sh@10 -- # set +x 00:25:37.541 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.541 { 00:25:37.541 "params": { 00:25:37.541 "name": "Nvme$subsystem", 00:25:37.541 "trtype": "$TEST_TRANSPORT", 00:25:37.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.541 "adrfam": "ipv4", 00:25:37.541 "trsvcid": "$NVMF_PORT", 00:25:37.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.541 "hdgst": ${hdgst:-false}, 00:25:37.541 "ddgst": ${ddgst:-false} 00:25:37.541 }, 00:25:37.541 "method": "bdev_nvme_attach_controller" 00:25:37.541 } 00:25:37.541 EOF 00:25:37.541 )") 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.541 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.541 { 00:25:37.541 "params": { 00:25:37.541 "name": "Nvme$subsystem", 00:25:37.541 "trtype": "$TEST_TRANSPORT", 00:25:37.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.541 "adrfam": "ipv4", 00:25:37.541 "trsvcid": "$NVMF_PORT", 00:25:37.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.541 "hdgst": ${hdgst:-false}, 00:25:37.541 "ddgst": ${ddgst:-false} 00:25:37.541 }, 00:25:37.541 "method": "bdev_nvme_attach_controller" 00:25:37.541 } 00:25:37.541 EOF 00:25:37.541 )") 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.541 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.541 { 00:25:37.541 "params": { 00:25:37.541 "name": "Nvme$subsystem", 00:25:37.541 "trtype": "$TEST_TRANSPORT", 00:25:37.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.541 "adrfam": "ipv4", 00:25:37.541 "trsvcid": "$NVMF_PORT", 00:25:37.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.541 "hdgst": ${hdgst:-false}, 00:25:37.541 "ddgst": ${ddgst:-false} 00:25:37.541 }, 00:25:37.541 "method": "bdev_nvme_attach_controller" 00:25:37.541 } 00:25:37.541 EOF 00:25:37.541 )") 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.541 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.541 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.541 { 00:25:37.541 "params": { 00:25:37.541 "name": "Nvme$subsystem", 00:25:37.541 "trtype": "$TEST_TRANSPORT", 00:25:37.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.541 "adrfam": "ipv4", 00:25:37.541 "trsvcid": "$NVMF_PORT", 00:25:37.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.541 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.542 { 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme$subsystem", 00:25:37.542 "trtype": "$TEST_TRANSPORT", 00:25:37.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "$NVMF_PORT", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.542 "hdgst": ${hdgst:-false}, 00:25:37.542 "ddgst": ${ddgst:-false} 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 } 00:25:37.542 EOF 00:25:37.542 )") 00:25:37.542 17:18:34 -- nvmf/common.sh@542 -- # cat 00:25:37.542 17:18:34 -- nvmf/common.sh@544 -- # jq . 00:25:37.542 17:18:34 -- nvmf/common.sh@545 -- # IFS=, 00:25:37.542 17:18:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme1", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme2", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme3", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme4", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme5", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme6", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme7", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme8", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme9", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.542 "trsvcid": "4420", 00:25:37.542 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:37.542 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:37.542 "hdgst": false, 00:25:37.542 "ddgst": false 00:25:37.542 }, 00:25:37.542 "method": "bdev_nvme_attach_controller" 00:25:37.542 },{ 00:25:37.542 "params": { 00:25:37.542 "name": "Nvme10", 00:25:37.542 "trtype": "tcp", 00:25:37.542 "traddr": "10.0.0.2", 00:25:37.542 "adrfam": "ipv4", 00:25:37.543 "trsvcid": "4420", 00:25:37.543 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:37.543 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:37.543 "hdgst": false, 00:25:37.543 "ddgst": false 00:25:37.543 }, 00:25:37.543 "method": "bdev_nvme_attach_controller" 00:25:37.543 }' 00:25:37.543 [2024-11-27 17:18:34.295922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:37.543 [2024-11-27 17:18:34.296008] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1819239 ] 00:25:37.543 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.543 [2024-11-27 17:18:34.358146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:37.543 [2024-11-27 17:18:34.443026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:39.442 Running I/O for 10 seconds... 00:25:39.442 17:18:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.442 17:18:36 -- common/autotest_common.sh@862 -- # return 0 00:25:39.442 17:18:36 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:39.442 17:18:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.442 17:18:36 -- common/autotest_common.sh@10 -- # set +x 00:25:39.442 17:18:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.442 17:18:36 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:39.442 17:18:36 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:39.442 17:18:36 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:39.442 17:18:36 -- target/shutdown.sh@57 -- # local ret=1 00:25:39.442 17:18:36 -- target/shutdown.sh@58 -- # local i 00:25:39.442 17:18:36 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:39.442 17:18:36 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:39.442 17:18:36 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:39.442 17:18:36 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:39.442 17:18:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.442 17:18:36 -- common/autotest_common.sh@10 -- # set +x 00:25:39.442 17:18:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.442 17:18:36 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:39.442 17:18:36 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:39.442 17:18:36 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:39.700 17:18:36 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:39.700 17:18:36 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:39.700 17:18:36 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:39.700 17:18:36 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:39.700 17:18:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.700 17:18:36 -- common/autotest_common.sh@10 -- # set +x 00:25:39.700 17:18:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.700 17:18:36 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:39.700 17:18:36 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:39.700 17:18:36 -- target/shutdown.sh@64 -- # ret=0 00:25:39.700 17:18:36 -- target/shutdown.sh@65 -- # break 00:25:39.700 17:18:36 -- target/shutdown.sh@69 -- # return 0 00:25:39.700 17:18:36 -- target/shutdown.sh@109 -- # killprocess 1819239 00:25:39.700 17:18:36 -- common/autotest_common.sh@936 -- # '[' -z 1819239 ']' 00:25:39.700 17:18:36 -- common/autotest_common.sh@940 -- # kill -0 1819239 00:25:39.700 17:18:36 -- common/autotest_common.sh@941 -- # uname 00:25:39.700 17:18:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:39.700 17:18:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1819239 00:25:39.700 17:18:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:39.700 17:18:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:39.700 17:18:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1819239' 00:25:39.700 killing process with pid 1819239 00:25:39.700 17:18:36 -- common/autotest_common.sh@955 -- # kill 1819239 00:25:39.700 17:18:36 -- common/autotest_common.sh@960 -- # wait 1819239 00:25:39.700 Received shutdown signal, test time was about 0.586722 seconds 00:25:39.700 00:25:39.700 Latency(us) 00:25:39.700 [2024-11-27T16:18:36.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme1n1 : 0.57 401.08 25.07 0.00 0.00 153143.88 26602.76 119615.34 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme2n1 : 0.57 400.14 25.01 0.00 0.00 151452.46 26602.76 118838.61 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme3n1 : 0.57 399.21 24.95 0.00 0.00 149733.79 26214.40 118061.89 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme4n1 : 0.57 398.26 24.89 0.00 0.00 147978.50 25437.68 116508.44 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme5n1 : 0.58 395.52 24.72 0.00 0.00 146608.16 28738.75 118838.61 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme6n1 : 0.58 394.60 24.66 0.00 0.00 145151.81 27573.67 120392.06 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme7n1 : 0.58 391.84 24.49 0.00 0.00 143995.24 27379.48 119615.34 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme8n1 : 0.58 390.42 24.40 0.00 0.00 142694.74 27767.85 125829.12 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme9n1 : 0.59 389.49 24.34 0.00 0.00 141046.76 27573.67 128159.29 00:25:39.700 [2024-11-27T16:18:36.651Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.700 Verification LBA range: start 0x0 length 0x400 00:25:39.700 Nvme10n1 : 0.58 392.86 24.55 0.00 0.00 138779.61 20291.89 121945.51 00:25:39.700 [2024-11-27T16:18:36.651Z] =================================================================================================================== 00:25:39.700 [2024-11-27T16:18:36.651Z] Total : 3953.40 247.09 0.00 0.00 146058.49 20291.89 128159.29 00:25:39.958 17:18:36 -- target/shutdown.sh@112 -- # sleep 1 00:25:40.893 17:18:37 -- target/shutdown.sh@113 -- # kill -0 1818937 00:25:40.893 17:18:37 -- target/shutdown.sh@115 -- # stoptarget 00:25:40.893 17:18:37 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:40.893 17:18:37 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:40.893 17:18:37 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:40.893 17:18:37 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:40.893 17:18:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:40.893 17:18:37 -- nvmf/common.sh@116 -- # sync 00:25:40.893 17:18:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:40.893 17:18:37 -- nvmf/common.sh@119 -- # set +e 00:25:40.893 17:18:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:40.893 17:18:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:40.893 rmmod nvme_tcp 00:25:40.893 rmmod nvme_fabrics 00:25:40.893 rmmod nvme_keyring 00:25:40.893 17:18:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:40.893 17:18:37 -- nvmf/common.sh@123 -- # set -e 00:25:40.893 17:18:37 -- nvmf/common.sh@124 -- # return 0 00:25:40.893 17:18:37 -- nvmf/common.sh@477 -- # '[' -n 1818937 ']' 00:25:40.893 17:18:37 -- nvmf/common.sh@478 -- # killprocess 1818937 00:25:40.893 17:18:37 -- common/autotest_common.sh@936 -- # '[' -z 1818937 ']' 00:25:40.893 17:18:37 -- common/autotest_common.sh@940 -- # kill -0 1818937 00:25:40.893 17:18:37 -- common/autotest_common.sh@941 -- # uname 00:25:40.893 17:18:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:40.893 17:18:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1818937 00:25:41.151 17:18:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:41.151 17:18:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:41.151 17:18:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1818937' 00:25:41.151 killing process with pid 1818937 00:25:41.151 17:18:37 -- common/autotest_common.sh@955 -- # kill 1818937 00:25:41.151 17:18:37 -- common/autotest_common.sh@960 -- # wait 1818937 00:25:41.409 17:18:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:41.409 17:18:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:41.409 17:18:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:41.409 17:18:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:41.409 17:18:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:41.409 17:18:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.409 17:18:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.409 17:18:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.942 17:18:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:43.942 00:25:43.942 real 0m7.943s 00:25:43.942 user 0m24.507s 00:25:43.942 sys 0m1.417s 00:25:43.942 17:18:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:43.942 17:18:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 ************************************ 00:25:43.942 END TEST nvmf_shutdown_tc2 00:25:43.942 ************************************ 00:25:43.942 17:18:40 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:43.942 17:18:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:43.942 17:18:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:43.942 17:18:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 ************************************ 00:25:43.942 START TEST nvmf_shutdown_tc3 00:25:43.942 ************************************ 00:25:43.942 17:18:40 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:43.942 17:18:40 -- target/shutdown.sh@120 -- # starttarget 00:25:43.942 17:18:40 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:43.942 17:18:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:43.942 17:18:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:43.942 17:18:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:43.942 17:18:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:43.942 17:18:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:43.942 17:18:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:43.942 17:18:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:43.942 17:18:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.942 17:18:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:43.942 17:18:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:43.942 17:18:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 17:18:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.942 17:18:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.942 17:18:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.942 17:18:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.942 17:18:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.942 17:18:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.942 17:18:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.942 17:18:40 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.942 17:18:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.942 17:18:40 -- nvmf/common.sh@295 -- # e810=() 00:25:43.942 17:18:40 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.942 17:18:40 -- nvmf/common.sh@296 -- # x722=() 00:25:43.942 17:18:40 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.942 17:18:40 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.942 17:18:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.942 17:18:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.942 17:18:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.942 17:18:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.942 17:18:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.942 17:18:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.942 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.942 17:18:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.942 17:18:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.942 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.942 17:18:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.942 17:18:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.942 17:18:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.942 17:18:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.942 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.942 17:18:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.942 17:18:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.942 17:18:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.942 17:18:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.942 17:18:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.942 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.942 17:18:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.942 17:18:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.942 17:18:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.942 17:18:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.942 17:18:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.942 17:18:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.942 17:18:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.942 17:18:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.942 17:18:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.942 17:18:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.942 17:18:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.942 17:18:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.942 17:18:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.942 17:18:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.942 17:18:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.942 17:18:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.942 17:18:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.942 17:18:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.942 17:18:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.942 17:18:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.942 17:18:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.942 17:18:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.942 17:18:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.942 17:18:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.942 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.942 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:25:43.942 00:25:43.942 --- 10.0.0.2 ping statistics --- 00:25:43.942 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.943 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:25:43.943 17:18:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.943 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.943 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.061 ms 00:25:43.943 00:25:43.943 --- 10.0.0.1 ping statistics --- 00:25:43.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.943 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:25:43.943 17:18:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.943 17:18:40 -- nvmf/common.sh@410 -- # return 0 00:25:43.943 17:18:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.943 17:18:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.943 17:18:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.943 17:18:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.943 17:18:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.943 17:18:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.943 17:18:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.943 17:18:40 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:43.943 17:18:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.943 17:18:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.943 17:18:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.943 17:18:40 -- nvmf/common.sh@469 -- # nvmfpid=1820073 00:25:43.943 17:18:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:43.943 17:18:40 -- nvmf/common.sh@470 -- # waitforlisten 1820073 00:25:43.943 17:18:40 -- common/autotest_common.sh@829 -- # '[' -z 1820073 ']' 00:25:43.943 17:18:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.943 17:18:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.943 17:18:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.943 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.943 17:18:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.943 17:18:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.943 [2024-11-27 17:18:40.630230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:43.943 [2024-11-27 17:18:40.630296] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.943 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.943 [2024-11-27 17:18:40.701152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:43.943 [2024-11-27 17:18:40.791513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.943 [2024-11-27 17:18:40.791679] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.943 [2024-11-27 17:18:40.791700] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.943 [2024-11-27 17:18:40.791715] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.943 [2024-11-27 17:18:40.791819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.943 [2024-11-27 17:18:40.791917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.943 [2024-11-27 17:18:40.791984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:43.943 [2024-11-27 17:18:40.791986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:44.872 17:18:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.872 17:18:41 -- common/autotest_common.sh@862 -- # return 0 00:25:44.872 17:18:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:44.872 17:18:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.872 17:18:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.872 17:18:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:44.872 17:18:41 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.872 17:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.872 17:18:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.872 [2024-11-27 17:18:41.633146] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.872 17:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.872 17:18:41 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:44.872 17:18:41 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:44.872 17:18:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:44.872 17:18:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.872 17:18:41 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:44.872 17:18:41 -- target/shutdown.sh@28 -- # cat 00:25:44.872 17:18:41 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:44.872 17:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.872 17:18:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.872 Malloc1 00:25:44.872 [2024-11-27 17:18:41.708850] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.872 Malloc2 00:25:44.872 Malloc3 00:25:45.128 Malloc4 00:25:45.128 Malloc5 00:25:45.128 Malloc6 00:25:45.128 Malloc7 00:25:45.128 Malloc8 00:25:45.128 Malloc9 00:25:45.386 Malloc10 00:25:45.386 17:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.386 17:18:42 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:45.386 17:18:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:45.386 17:18:42 -- common/autotest_common.sh@10 -- # set +x 00:25:45.386 17:18:42 -- target/shutdown.sh@124 -- # perfpid=1820351 00:25:45.386 17:18:42 -- target/shutdown.sh@125 -- # waitforlisten 1820351 /var/tmp/bdevperf.sock 00:25:45.386 17:18:42 -- common/autotest_common.sh@829 -- # '[' -z 1820351 ']' 00:25:45.386 17:18:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:45.386 17:18:42 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:45.386 17:18:42 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:45.386 17:18:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:45.386 17:18:42 -- nvmf/common.sh@520 -- # config=() 00:25:45.386 17:18:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:45.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:45.386 17:18:42 -- nvmf/common.sh@520 -- # local subsystem config 00:25:45.386 17:18:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:45.386 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.386 17:18:42 -- common/autotest_common.sh@10 -- # set +x 00:25:45.386 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.386 { 00:25:45.386 "params": { 00:25:45.386 "name": "Nvme$subsystem", 00:25:45.386 "trtype": "$TEST_TRANSPORT", 00:25:45.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.386 "adrfam": "ipv4", 00:25:45.386 "trsvcid": "$NVMF_PORT", 00:25:45.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.386 "hdgst": ${hdgst:-false}, 00:25:45.386 "ddgst": ${ddgst:-false} 00:25:45.386 }, 00:25:45.386 "method": "bdev_nvme_attach_controller" 00:25:45.386 } 00:25:45.386 EOF 00:25:45.386 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:45.387 { 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme$subsystem", 00:25:45.387 "trtype": "$TEST_TRANSPORT", 00:25:45.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "$NVMF_PORT", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:45.387 "hdgst": ${hdgst:-false}, 00:25:45.387 "ddgst": ${ddgst:-false} 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 } 00:25:45.387 EOF 00:25:45.387 )") 00:25:45.387 17:18:42 -- nvmf/common.sh@542 -- # cat 00:25:45.387 17:18:42 -- nvmf/common.sh@544 -- # jq . 00:25:45.387 17:18:42 -- nvmf/common.sh@545 -- # IFS=, 00:25:45.387 17:18:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme1", 00:25:45.387 "trtype": "tcp", 00:25:45.387 "traddr": "10.0.0.2", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "4420", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:45.387 "hdgst": false, 00:25:45.387 "ddgst": false 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 },{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme2", 00:25:45.387 "trtype": "tcp", 00:25:45.387 "traddr": "10.0.0.2", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "4420", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:45.387 "hdgst": false, 00:25:45.387 "ddgst": false 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 },{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme3", 00:25:45.387 "trtype": "tcp", 00:25:45.387 "traddr": "10.0.0.2", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "4420", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:45.387 "hdgst": false, 00:25:45.387 "ddgst": false 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 },{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme4", 00:25:45.387 "trtype": "tcp", 00:25:45.387 "traddr": "10.0.0.2", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "4420", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:45.387 "hdgst": false, 00:25:45.387 "ddgst": false 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 },{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme5", 00:25:45.387 "trtype": "tcp", 00:25:45.387 "traddr": "10.0.0.2", 00:25:45.387 "adrfam": "ipv4", 00:25:45.387 "trsvcid": "4420", 00:25:45.387 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:45.387 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:45.387 "hdgst": false, 00:25:45.387 "ddgst": false 00:25:45.387 }, 00:25:45.387 "method": "bdev_nvme_attach_controller" 00:25:45.387 },{ 00:25:45.387 "params": { 00:25:45.387 "name": "Nvme6", 00:25:45.387 "trtype": "tcp", 00:25:45.388 "traddr": "10.0.0.2", 00:25:45.388 "adrfam": "ipv4", 00:25:45.388 "trsvcid": "4420", 00:25:45.388 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:45.388 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:45.388 "hdgst": false, 00:25:45.388 "ddgst": false 00:25:45.388 }, 00:25:45.388 "method": "bdev_nvme_attach_controller" 00:25:45.388 },{ 00:25:45.388 "params": { 00:25:45.388 "name": "Nvme7", 00:25:45.388 "trtype": "tcp", 00:25:45.388 "traddr": "10.0.0.2", 00:25:45.388 "adrfam": "ipv4", 00:25:45.388 "trsvcid": "4420", 00:25:45.388 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:45.388 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:45.388 "hdgst": false, 00:25:45.388 "ddgst": false 00:25:45.388 }, 00:25:45.388 "method": "bdev_nvme_attach_controller" 00:25:45.388 },{ 00:25:45.388 "params": { 00:25:45.388 "name": "Nvme8", 00:25:45.388 "trtype": "tcp", 00:25:45.388 "traddr": "10.0.0.2", 00:25:45.388 "adrfam": "ipv4", 00:25:45.388 "trsvcid": "4420", 00:25:45.388 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:45.388 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:45.388 "hdgst": false, 00:25:45.388 "ddgst": false 00:25:45.388 }, 00:25:45.388 "method": "bdev_nvme_attach_controller" 00:25:45.388 },{ 00:25:45.388 "params": { 00:25:45.388 "name": "Nvme9", 00:25:45.388 "trtype": "tcp", 00:25:45.388 "traddr": "10.0.0.2", 00:25:45.388 "adrfam": "ipv4", 00:25:45.388 "trsvcid": "4420", 00:25:45.388 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:45.388 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:45.388 "hdgst": false, 00:25:45.388 "ddgst": false 00:25:45.388 }, 00:25:45.388 "method": "bdev_nvme_attach_controller" 00:25:45.388 },{ 00:25:45.388 "params": { 00:25:45.388 "name": "Nvme10", 00:25:45.388 "trtype": "tcp", 00:25:45.388 "traddr": "10.0.0.2", 00:25:45.388 "adrfam": "ipv4", 00:25:45.388 "trsvcid": "4420", 00:25:45.388 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:45.388 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:45.388 "hdgst": false, 00:25:45.388 "ddgst": false 00:25:45.388 }, 00:25:45.388 "method": "bdev_nvme_attach_controller" 00:25:45.388 }' 00:25:45.388 [2024-11-27 17:18:42.195867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:45.388 [2024-11-27 17:18:42.195954] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1820351 ] 00:25:45.388 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.388 [2024-11-27 17:18:42.258033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:45.645 [2024-11-27 17:18:42.349421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.543 Running I/O for 10 seconds... 00:25:48.135 17:18:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:48.135 17:18:44 -- common/autotest_common.sh@862 -- # return 0 00:25:48.135 17:18:44 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:48.135 17:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.135 17:18:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.135 17:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.135 17:18:44 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:48.135 17:18:44 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:48.135 17:18:44 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:48.135 17:18:44 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:48.135 17:18:44 -- target/shutdown.sh@57 -- # local ret=1 00:25:48.135 17:18:44 -- target/shutdown.sh@58 -- # local i 00:25:48.135 17:18:44 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:48.135 17:18:44 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:48.135 17:18:44 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:48.135 17:18:44 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:48.135 17:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.135 17:18:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.135 17:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.135 17:18:44 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:48.135 17:18:44 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:48.135 17:18:44 -- target/shutdown.sh@64 -- # ret=0 00:25:48.135 17:18:44 -- target/shutdown.sh@65 -- # break 00:25:48.135 17:18:44 -- target/shutdown.sh@69 -- # return 0 00:25:48.135 17:18:44 -- target/shutdown.sh@134 -- # killprocess 1820073 00:25:48.135 17:18:44 -- common/autotest_common.sh@936 -- # '[' -z 1820073 ']' 00:25:48.135 17:18:44 -- common/autotest_common.sh@940 -- # kill -0 1820073 00:25:48.135 17:18:44 -- common/autotest_common.sh@941 -- # uname 00:25:48.135 17:18:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.135 17:18:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1820073 00:25:48.135 17:18:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:48.135 17:18:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:48.135 17:18:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1820073' 00:25:48.135 killing process with pid 1820073 00:25:48.135 17:18:44 -- common/autotest_common.sh@955 -- # kill 1820073 00:25:48.135 17:18:44 -- common/autotest_common.sh@960 -- # wait 1820073 00:25:48.135 [2024-11-27 17:18:44.900456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.900993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.135 [2024-11-27 17:18:44.901117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.901216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a0e70 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.902992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.903569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3820 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.136 [2024-11-27 17:18:44.905214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.905732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1300 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.137 [2024-11-27 17:18:44.907852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.907995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a17b0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.909194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909273] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909304] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909334] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7240 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.909421] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xedffe0 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.909651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909753] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0c200 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.909834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909870] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.138 [2024-11-27 17:18:44.909941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.909955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0a710 is same with the state(5) to be set 00:25:48.138 [2024-11-27 17:18:44.910007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.138 [2024-11-27 17:18:44.910493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.138 [2024-11-27 17:18:44.910509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.910980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.910995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.139 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32896 len:12[2024-11-27 17:18:44.911142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 he state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.139 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33408 len:12[2024-11-27 17:18:44.911210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 he state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.139 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 [2024-11-27 17:18:44.911255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.139 [2024-11-27 17:18:44.911268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37504 len:12[2024-11-27 17:18:44.911281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.139 he state(5) to be set 00:25:48.139 [2024-11-27 17:18:44.911295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.139 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.911425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 he state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38144 len:12he state(5) to be set 00:25:48.140 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38528 len:12[2024-11-27 17:18:44.911681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 he state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.140 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:1[2024-11-27 17:18:44.911746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 he state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t[2024-11-27 17:18:44.911760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.140 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.911850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 he state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 [2024-11-27 17:18:44.911876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39296 len:12[2024-11-27 17:18:44.911901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.140 he state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1c40 is same with the state(5) to be set 00:25:48.140 [2024-11-27 17:18:44.911916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.140 [2024-11-27 17:18:44.911933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.911947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.911961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.911975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.911991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.912005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.912020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.912033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.912049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.912063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.912079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.912093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.912108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.912122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 [2024-11-27 17:18:44.912239] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xeb7ac0 was disconnected and freed. reset controller. 00:25:48.141 [2024-11-27 17:18:44.912672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.912999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.913430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a20f0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.914842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.914855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.141 he state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.141 [2024-11-27 17:18:44.914876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.141 [2024-11-27 17:18:44.914881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.914894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.914922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.914934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.914947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.914961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.914992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.914995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t[2024-11-27 17:18:44.915059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128he state(5) to be set 00:25:48.142 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128[2024-11-27 17:18:44.915125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.915139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:12[2024-11-27 17:18:44.915191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.915208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31872 len:12[2024-11-27 17:18:44.915259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.915274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32512 len:12[2024-11-27 17:18:44.915324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t[2024-11-27 17:18:44.915338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.142 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:12[2024-11-27 17:18:44.915418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 he state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with t[2024-11-27 17:18:44.915432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.142 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.142 [2024-11-27 17:18:44.915483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.142 [2024-11-27 17:18:44.915491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.142 [2024-11-27 17:18:44.915495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.915530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 he state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a25a0 is same with the state(5) to be set 00:25:48.143 [2024-11-27 17:18:44.915604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.915970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.915984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.143 [2024-11-27 17:18:44.916695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.143 [2024-11-27 17:18:44.916711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.916860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 he state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with t[2024-11-27 17:18:44.916880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:1he state(5) to be set 00:25:48.144 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.916952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.916965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.916990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with t[2024-11-27 17:18:44.917065] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1057e90 was disconnected and frhe state(5) to be set 00:25:48.144 eed. reset controller. 00:25:48.144 [2024-11-27 17:18:44.917086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.917238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.917263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:12[2024-11-27 17:18:44.917305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 he state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.917336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.917378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.917392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 he state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.917420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 [2024-11-27 17:18:44.917432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.144 [2024-11-27 17:18:44.917445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with the state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.917458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a2a50 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.144 he state(5) to be set 00:25:48.144 [2024-11-27 17:18:44.917474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.917975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.917989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 [2024-11-27 17:18:44.918753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.145 [2024-11-27 17:18:44.918767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.918761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.145 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:1[2024-11-27 17:18:44.918787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.918803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.918837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.918850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:1[2024-11-27 17:18:44.918863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.918903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.918916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.918929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t[2024-11-27 17:18:44.918941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38272 len:12he state(5) to be set 00:25:48.146 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.918956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.918969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.918981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.918991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.918994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:38656 len:1[2024-11-27 17:18:44.919044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t[2024-11-27 17:18:44.919059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:48.146 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t[2024-11-27 17:18:44.919128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38912 len:1he state(5) to be set 00:25:48.146 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.919241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39680 len:1[2024-11-27 17:18:44.919322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 he state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t[2024-11-27 17:18:44.919386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39936 len:1he state(5) to be set 00:25:48.146 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.146 [2024-11-27 17:18:44.919399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.146 [2024-11-27 17:18:44.919402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.146 [2024-11-27 17:18:44.919411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.147 [2024-11-27 17:18:44.919424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.919436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with t[2024-11-27 17:18:44.919449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:1he state(5) to be set 00:25:48.147 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.147 [2024-11-27 17:18:44.919468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 17:18:44.919470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 he state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919599] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xed0300 was disconnected and freed. reset controller. 00:25:48.147 [2024-11-27 17:18:44.919614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.919650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a3390 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.920179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:48.147 [2024-11-27 17:18:44.920244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedffe0 (9): Bad file descriptor 00:25:48.147 [2024-11-27 17:18:44.920325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2b190 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.920503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920623] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.920637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.920651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ade80 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.920697] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf31c00 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.935682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a7240 (9): Bad file descriptor 00:25:48.147 [2024-11-27 17:18:44.935776] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935851] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935880] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.935921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf374f0 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.935974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.935997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7960 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.936127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0c200 (9): Bad file descriptor 00:25:48.147 [2024-11-27 17:18:44.936172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936207] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.147 [2024-11-27 17:18:44.936277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.147 [2024-11-27 17:18:44.936291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1089980 is same with the state(5) to be set 00:25:48.147 [2024-11-27 17:18:44.936319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0a710 (9): Bad file descriptor 00:25:48.147 [2024-11-27 17:18:44.938887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.147 [2024-11-27 17:18:44.938916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.938943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.938960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.938984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.939976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.939992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.940010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.940024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.148 [2024-11-27 17:18:44.940040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.148 [2024-11-27 17:18:44.940055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.940934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.940951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941066] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xed18e0 was disconnected and freed. reset controller. 00:25:48.149 [2024-11-27 17:18:44.941126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.149 [2024-11-27 17:18:44.941472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.149 [2024-11-27 17:18:44.941488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.941970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.941987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.150 [2024-11-27 17:18:44.942768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.150 [2024-11-27 17:18:44.942786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.942974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.942990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.943197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.943295] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xed2ec0 was disconnected and freed. reset controller. 00:25:48.151 [2024-11-27 17:18:44.943579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:48.151 [2024-11-27 17:18:44.943632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:48.151 [2024-11-27 17:18:44.943689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf2b190 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.943800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10ade80 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.943832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf31c00 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.943871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf374f0 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.943898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a7960 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.943923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1089980 (9): Bad file descriptor 00:25:48.151 [2024-11-27 17:18:44.947618] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:48.151 [2024-11-27 17:18:44.947835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.151 [2024-11-27 17:18:44.947946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.151 [2024-11-27 17:18:44.947973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xedffe0 with addr=10.0.0.2, port=4420 00:25:48.151 [2024-11-27 17:18:44.947991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xedffe0 is same with the state(5) to be set 00:25:48.151 [2024-11-27 17:18:44.948089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.151 [2024-11-27 17:18:44.948217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.151 [2024-11-27 17:18:44.948241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf0c200 with addr=10.0.0.2, port=4420 00:25:48.151 [2024-11-27 17:18:44.948258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0c200 is same with the state(5) to be set 00:25:48.151 [2024-11-27 17:18:44.948624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.948972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.948987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.151 [2024-11-27 17:18:44.949230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.151 [2024-11-27 17:18:44.949246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.949974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.949993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.152 [2024-11-27 17:18:44.950516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.152 [2024-11-27 17:18:44.950542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.950560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.950575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.950591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.950606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.950623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.950637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.950654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.950669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.950685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.950700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.951969] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:48.153 [2024-11-27 17:18:44.952411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.952976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.952993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xed44a0 is same with the state(5) to be set 00:25:48.153 [2024-11-27 17:18:44.953192] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xed44a0 was disconnected and freed. reset controller. 00:25:48.153 [2024-11-27 17:18:44.953332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.153 [2024-11-27 17:18:44.953577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.153 [2024-11-27 17:18:44.953593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.953974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.953989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.154 [2024-11-27 17:18:44.954854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.154 [2024-11-27 17:18:44.954871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.954885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.954902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.954916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.954932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.954947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.954964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.954979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.954995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.955389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.955404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xed7060 is same with the state(5) to be set 00:25:48.155 [2024-11-27 17:18:44.957066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:48.155 [2024-11-27 17:18:44.957110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:48.155 [2024-11-27 17:18:44.957131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:48.155 [2024-11-27 17:18:44.957335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.957434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.957461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf2b190 with addr=10.0.0.2, port=4420 00:25:48.155 [2024-11-27 17:18:44.957478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2b190 is same with the state(5) to be set 00:25:48.155 [2024-11-27 17:18:44.957506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedffe0 (9): Bad file descriptor 00:25:48.155 [2024-11-27 17:18:44.957536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0c200 (9): Bad file descriptor 00:25:48.155 [2024-11-27 17:18:44.957610] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.155 [2024-11-27 17:18:44.957639] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.155 [2024-11-27 17:18:44.957668] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.155 [2024-11-27 17:18:44.957689] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.155 [2024-11-27 17:18:44.959869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:48.155 [2024-11-27 17:18:44.959911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:48.155 [2024-11-27 17:18:44.960044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf374f0 with addr=10.0.0.2, port=4420 00:25:48.155 [2024-11-27 17:18:44.960218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf374f0 is same with the state(5) to be set 00:25:48.155 [2024-11-27 17:18:44.960309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf0a710 with addr=10.0.0.2, port=4420 00:25:48.155 [2024-11-27 17:18:44.960448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0a710 is same with the state(5) to be set 00:25:48.155 [2024-11-27 17:18:44.960535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.155 [2024-11-27 17:18:44.960652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10ade80 with addr=10.0.0.2, port=4420 00:25:48.155 [2024-11-27 17:18:44.960667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ade80 is same with the state(5) to be set 00:25:48.155 [2024-11-27 17:18:44.960687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf2b190 (9): Bad file descriptor 00:25:48.155 [2024-11-27 17:18:44.960707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:48.155 [2024-11-27 17:18:44.960721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:48.155 [2024-11-27 17:18:44.960740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:48.155 [2024-11-27 17:18:44.960762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:48.155 [2024-11-27 17:18:44.960777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:48.155 [2024-11-27 17:18:44.960792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:48.155 [2024-11-27 17:18:44.960815] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.155 [2024-11-27 17:18:44.961151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.155 [2024-11-27 17:18:44.961387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.155 [2024-11-27 17:18:44.961403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.961974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.961990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.156 [2024-11-27 17:18:44.962709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.156 [2024-11-27 17:18:44.962725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.962980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.962995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.963246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.963261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeced20 is same with the state(5) to be set 00:25:48.157 [2024-11-27 17:18:44.964543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.964979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.964994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.965011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.965026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.965043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.965058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.965075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.965089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.157 [2024-11-27 17:18:44.965106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.157 [2024-11-27 17:18:44.965121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.965619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.158 [2024-11-27 17:18:44.965635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.158 [2024-11-27 17:18:44.967403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.158 [2024-11-27 17:18:44.967428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.158 [2024-11-27 17:18:44.967445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:48.158 task offset: 34816 on job bdev=Nvme1n1 fails 00:25:48.158 00:25:48.158 Latency(us) 00:25:48.158 [2024-11-27T16:18:45.109Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme1n1 ended in about 0.74 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme1n1 : 0.74 339.82 21.24 86.65 0.00 149058.07 63302.92 157674.76 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme2n1 ended in about 0.76 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme2n1 : 0.76 329.69 20.61 84.07 0.00 152050.61 49516.09 135149.80 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme3n1 ended in about 0.78 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme3n1 : 0.78 323.64 20.23 82.52 0.00 153393.54 91653.31 120392.06 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme4n1 ended in about 0.79 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme4n1 : 0.79 318.49 19.91 81.21 0.00 154429.17 95148.56 121168.78 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme5n1 ended in about 0.76 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme5n1 : 0.76 329.13 20.57 83.92 0.00 147684.01 62137.84 121945.51 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme6n1 ended in about 0.77 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme6n1 : 0.77 326.26 20.39 83.19 0.00 147545.31 36117.62 123498.95 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme7n1 ended in about 0.77 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme7n1 : 0.77 325.81 20.36 83.07 0.00 146273.27 49516.09 124275.67 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme8n1 ended in about 0.78 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme8n1 : 0.78 320.57 20.04 26.82 0.00 168913.42 11165.39 156121.32 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme9n1 ended in about 0.79 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme9n1 : 0.79 307.47 19.22 43.02 0.00 166933.75 6165.24 160781.65 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:48.158 [2024-11-27T16:18:45.109Z] Job: Nvme10n1 ended in about 0.78 seconds with error 00:25:48.158 Verification LBA range: start 0x0 length 0x400 00:25:48.158 Nvme10n1 : 0.78 266.58 16.66 82.02 0.00 166564.24 103304.15 135149.80 00:25:48.158 [2024-11-27T16:18:45.109Z] =================================================================================================================== 00:25:48.158 [2024-11-27T16:18:45.109Z] Total : 3187.45 199.22 736.49 0.00 154784.29 6165.24 160781.65 00:25:48.158 [2024-11-27 17:18:44.997537] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:48.158 [2024-11-27 17:18:44.997648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:48.158 [2024-11-27 17:18:44.997930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.158 [2024-11-27 17:18:44.998057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.158 [2024-11-27 17:18:44.998085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10a7240 with addr=10.0.0.2, port=4420 00:25:48.158 [2024-11-27 17:18:44.998107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7240 is same with the state(5) to be set 00:25:48.158 [2024-11-27 17:18:44.998209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.158 [2024-11-27 17:18:44.998321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.158 [2024-11-27 17:18:44.998347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10a7960 with addr=10.0.0.2, port=4420 00:25:48.158 [2024-11-27 17:18:44.998363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7960 is same with the state(5) to be set 00:25:48.158 [2024-11-27 17:18:44.998392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf374f0 (9): Bad file descriptor 00:25:48.158 [2024-11-27 17:18:44.998417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0a710 (9): Bad file descriptor 00:25:48.158 [2024-11-27 17:18:44.998451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10ade80 (9): Bad file descriptor 00:25:48.158 [2024-11-27 17:18:44.998471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:48.158 [2024-11-27 17:18:44.998485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:48.158 [2024-11-27 17:18:44.998503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:48.159 [2024-11-27 17:18:44.998608] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.998635] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.998655] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:44.999245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:44.999350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:44.999379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1089980 with addr=10.0.0.2, port=4420 00:25:48.159 [2024-11-27 17:18:44.999396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1089980 is same with the state(5) to be set 00:25:48.159 [2024-11-27 17:18:44.999486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:44.999585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:44.999612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf31c00 with addr=10.0.0.2, port=4420 00:25:48.159 [2024-11-27 17:18:44.999629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf31c00 is same with the state(5) to be set 00:25:48.159 [2024-11-27 17:18:44.999648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a7240 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:44.999669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a7960 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:44.999686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:44.999699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:44.999714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:48.159 [2024-11-27 17:18:44.999733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:44.999748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:44.999762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:48.159 [2024-11-27 17:18:44.999781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:44.999794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:44.999808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:48.159 [2024-11-27 17:18:44.999839] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999861] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999896] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999923] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999944] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999962] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:44.999980] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:48.159 [2024-11-27 17:18:45.000552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:48.159 [2024-11-27 17:18:45.000582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:48.159 [2024-11-27 17:18:45.000632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.000649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.000661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.000697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1089980 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:45.000721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf31c00 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:45.000738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.000752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.000765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:48.159 [2024-11-27 17:18:45.000783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.000801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.000815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:48.159 [2024-11-27 17:18:45.000887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:48.159 [2024-11-27 17:18:45.000912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.000926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.001032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf0c200 with addr=10.0.0.2, port=4420 00:25:48.159 [2024-11-27 17:18:45.001176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0c200 is same with the state(5) to be set 00:25:48.159 [2024-11-27 17:18:45.001272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xedffe0 with addr=10.0.0.2, port=4420 00:25:48.159 [2024-11-27 17:18:45.001404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xedffe0 is same with the state(5) to be set 00:25:48.159 [2024-11-27 17:18:45.001419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.001431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.001445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:48.159 [2024-11-27 17:18:45.001469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.001484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.001498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:48.159 [2024-11-27 17:18:45.001559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.001589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.001671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.159 [2024-11-27 17:18:45.001780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf2b190 with addr=10.0.0.2, port=4420 00:25:48.159 [2024-11-27 17:18:45.001797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2b190 is same with the state(5) to be set 00:25:48.159 [2024-11-27 17:18:45.001816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0c200 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:45.001837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedffe0 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:45.001882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf2b190 (9): Bad file descriptor 00:25:48.159 [2024-11-27 17:18:45.001905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.001919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.001933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:48.159 [2024-11-27 17:18:45.001950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.001964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.001977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:48.159 [2024-11-27 17:18:45.002014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.002031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.159 [2024-11-27 17:18:45.002045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:48.159 [2024-11-27 17:18:45.002058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:48.159 [2024-11-27 17:18:45.002072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:48.159 [2024-11-27 17:18:45.002113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.726 17:18:45 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:48.726 17:18:45 -- target/shutdown.sh@138 -- # sleep 1 00:25:49.663 17:18:46 -- target/shutdown.sh@141 -- # kill -9 1820351 00:25:49.663 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1820351) - No such process 00:25:49.663 17:18:46 -- target/shutdown.sh@141 -- # true 00:25:49.663 17:18:46 -- target/shutdown.sh@143 -- # stoptarget 00:25:49.663 17:18:46 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:49.663 17:18:46 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:49.663 17:18:46 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:49.663 17:18:46 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:49.663 17:18:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:49.663 17:18:46 -- nvmf/common.sh@116 -- # sync 00:25:49.663 17:18:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:49.663 17:18:46 -- nvmf/common.sh@119 -- # set +e 00:25:49.663 17:18:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:49.663 17:18:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:49.663 rmmod nvme_tcp 00:25:49.663 rmmod nvme_fabrics 00:25:49.663 rmmod nvme_keyring 00:25:49.663 17:18:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:49.663 17:18:46 -- nvmf/common.sh@123 -- # set -e 00:25:49.663 17:18:46 -- nvmf/common.sh@124 -- # return 0 00:25:49.663 17:18:46 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:49.663 17:18:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:49.663 17:18:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:49.663 17:18:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:49.663 17:18:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:49.663 17:18:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:49.663 17:18:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:49.663 17:18:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:49.663 17:18:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:52.197 17:18:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:52.197 00:25:52.197 real 0m8.123s 00:25:52.197 user 0m21.682s 00:25:52.197 sys 0m1.517s 00:25:52.197 17:18:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:52.197 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:52.197 ************************************ 00:25:52.197 END TEST nvmf_shutdown_tc3 00:25:52.197 ************************************ 00:25:52.197 17:18:48 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:52.197 00:25:52.197 real 0m28.364s 00:25:52.197 user 1m21.533s 00:25:52.197 sys 0m6.330s 00:25:52.197 17:18:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:52.197 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:52.197 ************************************ 00:25:52.197 END TEST nvmf_shutdown 00:25:52.197 ************************************ 00:25:52.197 17:18:48 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:52.197 17:18:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:52.197 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:52.197 17:18:48 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:52.197 17:18:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:52.197 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:52.197 17:18:48 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:52.197 17:18:48 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:52.197 17:18:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:52.197 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:52.197 ************************************ 00:25:52.197 START TEST nvmf_multicontroller 00:25:52.197 ************************************ 00:25:52.197 17:18:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:52.197 * Looking for test storage... 00:25:52.197 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:52.197 17:18:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:52.197 17:18:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:52.197 17:18:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:52.197 17:18:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:52.197 17:18:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:52.197 17:18:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:52.197 17:18:48 -- scripts/common.sh@335 -- # IFS=.-: 00:25:52.197 17:18:48 -- scripts/common.sh@335 -- # read -ra ver1 00:25:52.197 17:18:48 -- scripts/common.sh@336 -- # IFS=.-: 00:25:52.197 17:18:48 -- scripts/common.sh@336 -- # read -ra ver2 00:25:52.197 17:18:48 -- scripts/common.sh@337 -- # local 'op=<' 00:25:52.197 17:18:48 -- scripts/common.sh@339 -- # ver1_l=2 00:25:52.197 17:18:48 -- scripts/common.sh@340 -- # ver2_l=1 00:25:52.197 17:18:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:52.197 17:18:48 -- scripts/common.sh@343 -- # case "$op" in 00:25:52.197 17:18:48 -- scripts/common.sh@344 -- # : 1 00:25:52.197 17:18:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:52.197 17:18:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:52.197 17:18:48 -- scripts/common.sh@364 -- # decimal 1 00:25:52.197 17:18:48 -- scripts/common.sh@352 -- # local d=1 00:25:52.197 17:18:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:52.197 17:18:48 -- scripts/common.sh@354 -- # echo 1 00:25:52.197 17:18:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:52.197 17:18:48 -- scripts/common.sh@365 -- # decimal 2 00:25:52.197 17:18:48 -- scripts/common.sh@352 -- # local d=2 00:25:52.197 17:18:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:52.197 17:18:48 -- scripts/common.sh@354 -- # echo 2 00:25:52.197 17:18:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:52.197 17:18:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:52.197 17:18:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:52.197 17:18:48 -- scripts/common.sh@367 -- # return 0 00:25:52.197 17:18:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:52.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:52.197 --rc genhtml_branch_coverage=1 00:25:52.197 --rc genhtml_function_coverage=1 00:25:52.197 --rc genhtml_legend=1 00:25:52.197 --rc geninfo_all_blocks=1 00:25:52.197 --rc geninfo_unexecuted_blocks=1 00:25:52.197 00:25:52.197 ' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:52.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:52.197 --rc genhtml_branch_coverage=1 00:25:52.197 --rc genhtml_function_coverage=1 00:25:52.197 --rc genhtml_legend=1 00:25:52.197 --rc geninfo_all_blocks=1 00:25:52.197 --rc geninfo_unexecuted_blocks=1 00:25:52.197 00:25:52.197 ' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:52.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:52.197 --rc genhtml_branch_coverage=1 00:25:52.197 --rc genhtml_function_coverage=1 00:25:52.197 --rc genhtml_legend=1 00:25:52.197 --rc geninfo_all_blocks=1 00:25:52.197 --rc geninfo_unexecuted_blocks=1 00:25:52.197 00:25:52.197 ' 00:25:52.197 17:18:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:52.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:52.197 --rc genhtml_branch_coverage=1 00:25:52.197 --rc genhtml_function_coverage=1 00:25:52.197 --rc genhtml_legend=1 00:25:52.197 --rc geninfo_all_blocks=1 00:25:52.197 --rc geninfo_unexecuted_blocks=1 00:25:52.197 00:25:52.197 ' 00:25:52.198 17:18:48 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:52.198 17:18:48 -- nvmf/common.sh@7 -- # uname -s 00:25:52.198 17:18:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:52.198 17:18:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:52.198 17:18:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:52.198 17:18:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:52.198 17:18:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:52.198 17:18:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:52.198 17:18:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:52.198 17:18:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:52.198 17:18:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:52.198 17:18:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:52.198 17:18:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:52.198 17:18:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:52.198 17:18:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:52.198 17:18:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:52.198 17:18:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:52.198 17:18:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:52.198 17:18:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:52.198 17:18:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:52.198 17:18:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:52.198 17:18:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:52.198 17:18:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:52.198 17:18:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:52.198 17:18:48 -- paths/export.sh@5 -- # export PATH 00:25:52.198 17:18:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:52.198 17:18:48 -- nvmf/common.sh@46 -- # : 0 00:25:52.198 17:18:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:52.198 17:18:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:52.198 17:18:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:52.198 17:18:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:52.198 17:18:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:52.198 17:18:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:52.198 17:18:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:52.198 17:18:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:52.198 17:18:48 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:52.198 17:18:48 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:52.198 17:18:48 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:52.198 17:18:48 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:52.198 17:18:48 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:52.198 17:18:48 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:52.198 17:18:48 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:52.198 17:18:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:52.198 17:18:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:52.198 17:18:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:52.198 17:18:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:52.198 17:18:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:52.198 17:18:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:52.198 17:18:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:52.198 17:18:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:52.198 17:18:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:52.198 17:18:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:52.198 17:18:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:52.198 17:18:48 -- common/autotest_common.sh@10 -- # set +x 00:25:54.099 17:18:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:54.099 17:18:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:54.099 17:18:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:54.099 17:18:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:54.099 17:18:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:54.099 17:18:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:54.099 17:18:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:54.099 17:18:50 -- nvmf/common.sh@294 -- # net_devs=() 00:25:54.099 17:18:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:54.099 17:18:50 -- nvmf/common.sh@295 -- # e810=() 00:25:54.099 17:18:50 -- nvmf/common.sh@295 -- # local -ga e810 00:25:54.099 17:18:50 -- nvmf/common.sh@296 -- # x722=() 00:25:54.099 17:18:50 -- nvmf/common.sh@296 -- # local -ga x722 00:25:54.099 17:18:50 -- nvmf/common.sh@297 -- # mlx=() 00:25:54.099 17:18:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:54.099 17:18:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:54.099 17:18:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:54.099 17:18:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:54.099 17:18:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:54.099 17:18:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:54.099 17:18:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:54.100 17:18:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.100 17:18:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:54.100 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:54.100 17:18:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.100 17:18:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:54.100 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:54.100 17:18:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.100 17:18:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.100 17:18:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.100 17:18:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:54.100 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:54.100 17:18:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.100 17:18:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.100 17:18:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.100 17:18:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.100 17:18:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:54.100 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:54.100 17:18:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.100 17:18:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:54.100 17:18:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:54.100 17:18:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:54.100 17:18:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:54.100 17:18:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:54.100 17:18:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:54.100 17:18:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:54.100 17:18:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:54.100 17:18:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:54.100 17:18:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:54.100 17:18:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:54.100 17:18:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:54.100 17:18:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:54.100 17:18:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:54.100 17:18:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:54.100 17:18:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:54.100 17:18:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:54.100 17:18:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:54.100 17:18:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:54.100 17:18:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:54.100 17:18:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:54.100 17:18:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:54.100 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:54.100 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:25:54.100 00:25:54.100 --- 10.0.0.2 ping statistics --- 00:25:54.100 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.100 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:25:54.100 17:18:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:54.100 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:54.100 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:25:54.100 00:25:54.100 --- 10.0.0.1 ping statistics --- 00:25:54.100 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.100 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:25:54.100 17:18:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:54.100 17:18:50 -- nvmf/common.sh@410 -- # return 0 00:25:54.100 17:18:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:54.100 17:18:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:54.100 17:18:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:54.100 17:18:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:54.100 17:18:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:54.100 17:18:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:54.100 17:18:50 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:54.100 17:18:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:54.100 17:18:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:54.100 17:18:50 -- common/autotest_common.sh@10 -- # set +x 00:25:54.100 17:18:50 -- nvmf/common.sh@469 -- # nvmfpid=1822904 00:25:54.100 17:18:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:54.100 17:18:50 -- nvmf/common.sh@470 -- # waitforlisten 1822904 00:25:54.100 17:18:50 -- common/autotest_common.sh@829 -- # '[' -z 1822904 ']' 00:25:54.100 17:18:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:54.100 17:18:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:54.100 17:18:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:54.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:54.100 17:18:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:54.100 17:18:50 -- common/autotest_common.sh@10 -- # set +x 00:25:54.100 [2024-11-27 17:18:50.962409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:54.100 [2024-11-27 17:18:50.962489] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:54.100 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.100 [2024-11-27 17:18:51.035225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:54.359 [2024-11-27 17:18:51.124418] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:54.359 [2024-11-27 17:18:51.124608] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:54.359 [2024-11-27 17:18:51.124629] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:54.359 [2024-11-27 17:18:51.124643] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:54.359 [2024-11-27 17:18:51.124751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:54.359 [2024-11-27 17:18:51.124837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:54.359 [2024-11-27 17:18:51.124840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:55.293 17:18:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:55.293 17:18:51 -- common/autotest_common.sh@862 -- # return 0 00:25:55.293 17:18:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:55.293 17:18:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:55.293 17:18:51 -- common/autotest_common.sh@10 -- # set +x 00:25:55.293 17:18:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:55.293 17:18:51 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:55.293 17:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.293 17:18:51 -- common/autotest_common.sh@10 -- # set +x 00:25:55.293 [2024-11-27 17:18:51.973713] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:55.293 17:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.293 17:18:51 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:55.293 17:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:51 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 Malloc0 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 [2024-11-27 17:18:52.035684] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 [2024-11-27 17:18:52.043536] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 Malloc1 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:55.294 17:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:55.294 17:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.294 17:18:52 -- host/multicontroller.sh@44 -- # bdevperf_pid=1823060 00:25:55.294 17:18:52 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:55.294 17:18:52 -- host/multicontroller.sh@47 -- # waitforlisten 1823060 /var/tmp/bdevperf.sock 00:25:55.294 17:18:52 -- common/autotest_common.sh@829 -- # '[' -z 1823060 ']' 00:25:55.294 17:18:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:55.294 17:18:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:55.294 17:18:52 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:55.294 17:18:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:55.294 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:55.294 17:18:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:55.294 17:18:52 -- common/autotest_common.sh@10 -- # set +x 00:25:56.227 17:18:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:56.227 17:18:53 -- common/autotest_common.sh@862 -- # return 0 00:25:56.227 17:18:53 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:56.227 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.227 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.486 NVMe0n1 00:25:56.486 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.486 17:18:53 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:56.486 17:18:53 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:56.486 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.486 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.486 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.486 1 00:25:56.486 17:18:53 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:56.486 17:18:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:56.486 17:18:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:56.486 17:18:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.486 17:18:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:56.486 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.486 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.486 request: 00:25:56.486 { 00:25:56.486 "name": "NVMe0", 00:25:56.486 "trtype": "tcp", 00:25:56.486 "traddr": "10.0.0.2", 00:25:56.486 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:56.486 "hostaddr": "10.0.0.2", 00:25:56.486 "hostsvcid": "60000", 00:25:56.486 "adrfam": "ipv4", 00:25:56.486 "trsvcid": "4420", 00:25:56.486 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:56.486 "method": "bdev_nvme_attach_controller", 00:25:56.486 "req_id": 1 00:25:56.486 } 00:25:56.486 Got JSON-RPC error response 00:25:56.486 response: 00:25:56.486 { 00:25:56.486 "code": -114, 00:25:56.486 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:56.486 } 00:25:56.486 17:18:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:56.486 17:18:53 -- common/autotest_common.sh@653 -- # es=1 00:25:56.486 17:18:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:56.486 17:18:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:56.486 17:18:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:56.486 17:18:53 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:56.486 17:18:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:56.486 17:18:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:56.486 17:18:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:56.486 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.486 17:18:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:56.486 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.486 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.486 request: 00:25:56.486 { 00:25:56.486 "name": "NVMe0", 00:25:56.486 "trtype": "tcp", 00:25:56.486 "traddr": "10.0.0.2", 00:25:56.486 "hostaddr": "10.0.0.2", 00:25:56.486 "hostsvcid": "60000", 00:25:56.486 "adrfam": "ipv4", 00:25:56.486 "trsvcid": "4420", 00:25:56.486 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:56.486 "method": "bdev_nvme_attach_controller", 00:25:56.486 "req_id": 1 00:25:56.486 } 00:25:56.486 Got JSON-RPC error response 00:25:56.486 response: 00:25:56.486 { 00:25:56.486 "code": -114, 00:25:56.486 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:56.486 } 00:25:56.486 17:18:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:56.486 17:18:53 -- common/autotest_common.sh@653 -- # es=1 00:25:56.486 17:18:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:56.486 17:18:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:56.486 17:18:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:56.486 17:18:53 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:56.486 17:18:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:56.487 17:18:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.487 17:18:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.487 request: 00:25:56.487 { 00:25:56.487 "name": "NVMe0", 00:25:56.487 "trtype": "tcp", 00:25:56.487 "traddr": "10.0.0.2", 00:25:56.487 "hostaddr": "10.0.0.2", 00:25:56.487 "hostsvcid": "60000", 00:25:56.487 "adrfam": "ipv4", 00:25:56.487 "trsvcid": "4420", 00:25:56.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:56.487 "multipath": "disable", 00:25:56.487 "method": "bdev_nvme_attach_controller", 00:25:56.487 "req_id": 1 00:25:56.487 } 00:25:56.487 Got JSON-RPC error response 00:25:56.487 response: 00:25:56.487 { 00:25:56.487 "code": -114, 00:25:56.487 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:56.487 } 00:25:56.487 17:18:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:56.487 17:18:53 -- common/autotest_common.sh@653 -- # es=1 00:25:56.487 17:18:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:56.487 17:18:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:56.487 17:18:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:56.487 17:18:53 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:56.487 17:18:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:56.487 17:18:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:56.487 17:18:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:56.487 17:18:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:56.487 17:18:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:56.487 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.487 request: 00:25:56.487 { 00:25:56.487 "name": "NVMe0", 00:25:56.487 "trtype": "tcp", 00:25:56.487 "traddr": "10.0.0.2", 00:25:56.487 "hostaddr": "10.0.0.2", 00:25:56.487 "hostsvcid": "60000", 00:25:56.487 "adrfam": "ipv4", 00:25:56.487 "trsvcid": "4420", 00:25:56.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:56.487 "multipath": "failover", 00:25:56.487 "method": "bdev_nvme_attach_controller", 00:25:56.487 "req_id": 1 00:25:56.487 } 00:25:56.487 Got JSON-RPC error response 00:25:56.487 response: 00:25:56.487 { 00:25:56.487 "code": -114, 00:25:56.487 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:56.487 } 00:25:56.487 17:18:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:56.487 17:18:53 -- common/autotest_common.sh@653 -- # es=1 00:25:56.487 17:18:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:56.487 17:18:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:56.487 17:18:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:56.487 17:18:53 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:56.487 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.487 00:25:56.487 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.487 17:18:53 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:56.487 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.487 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.487 17:18:53 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:56.487 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.487 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.745 00:25:56.745 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.745 17:18:53 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:56.745 17:18:53 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:56.745 17:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.745 17:18:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.745 17:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.745 17:18:53 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:56.745 17:18:53 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:58.119 0 00:25:58.119 17:18:54 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:58.119 17:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.119 17:18:54 -- common/autotest_common.sh@10 -- # set +x 00:25:58.119 17:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.119 17:18:54 -- host/multicontroller.sh@100 -- # killprocess 1823060 00:25:58.119 17:18:54 -- common/autotest_common.sh@936 -- # '[' -z 1823060 ']' 00:25:58.119 17:18:54 -- common/autotest_common.sh@940 -- # kill -0 1823060 00:25:58.119 17:18:54 -- common/autotest_common.sh@941 -- # uname 00:25:58.119 17:18:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.119 17:18:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1823060 00:25:58.119 17:18:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:58.119 17:18:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:58.119 17:18:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1823060' 00:25:58.119 killing process with pid 1823060 00:25:58.119 17:18:54 -- common/autotest_common.sh@955 -- # kill 1823060 00:25:58.119 17:18:54 -- common/autotest_common.sh@960 -- # wait 1823060 00:25:58.119 17:18:54 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:58.119 17:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.119 17:18:54 -- common/autotest_common.sh@10 -- # set +x 00:25:58.119 17:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.119 17:18:54 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:58.119 17:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.119 17:18:54 -- common/autotest_common.sh@10 -- # set +x 00:25:58.119 17:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.119 17:18:54 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:58.119 17:18:54 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:58.119 17:18:54 -- common/autotest_common.sh@1607 -- # read -r file 00:25:58.119 17:18:54 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:58.119 17:18:54 -- common/autotest_common.sh@1606 -- # sort -u 00:25:58.120 17:18:54 -- common/autotest_common.sh@1608 -- # cat 00:25:58.120 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:58.120 [2024-11-27 17:18:52.145822] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:58.120 [2024-11-27 17:18:52.145921] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1823060 ] 00:25:58.120 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.120 [2024-11-27 17:18:52.204765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.120 [2024-11-27 17:18:52.290683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:58.120 [2024-11-27 17:18:53.486707] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name df18cf8b-943d-426d-b74a-2f3f11910e09 already exists 00:25:58.120 [2024-11-27 17:18:53.486751] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:df18cf8b-943d-426d-b74a-2f3f11910e09 alias for bdev NVMe1n1 00:25:58.120 [2024-11-27 17:18:53.486770] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:58.120 Running I/O for 1 seconds... 00:25:58.120 00:25:58.120 Latency(us) 00:25:58.120 [2024-11-27T16:18:55.071Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:58.120 [2024-11-27T16:18:55.071Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:58.120 NVMe0n1 : 1.01 19808.20 77.38 0.00 0.00 6435.70 2245.21 12621.75 00:25:58.120 [2024-11-27T16:18:55.071Z] =================================================================================================================== 00:25:58.120 [2024-11-27T16:18:55.071Z] Total : 19808.20 77.38 0.00 0.00 6435.70 2245.21 12621.75 00:25:58.120 Received shutdown signal, test time was about 1.000000 seconds 00:25:58.120 00:25:58.120 Latency(us) 00:25:58.120 [2024-11-27T16:18:55.071Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:58.120 [2024-11-27T16:18:55.071Z] =================================================================================================================== 00:25:58.120 [2024-11-27T16:18:55.071Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:58.120 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:58.120 17:18:54 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:58.120 17:18:54 -- common/autotest_common.sh@1607 -- # read -r file 00:25:58.120 17:18:54 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:58.120 17:18:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:58.120 17:18:54 -- nvmf/common.sh@116 -- # sync 00:25:58.120 17:18:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:58.120 17:18:54 -- nvmf/common.sh@119 -- # set +e 00:25:58.120 17:18:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:58.120 17:18:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:58.120 rmmod nvme_tcp 00:25:58.120 rmmod nvme_fabrics 00:25:58.120 rmmod nvme_keyring 00:25:58.120 17:18:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:58.120 17:18:55 -- nvmf/common.sh@123 -- # set -e 00:25:58.120 17:18:55 -- nvmf/common.sh@124 -- # return 0 00:25:58.120 17:18:55 -- nvmf/common.sh@477 -- # '[' -n 1822904 ']' 00:25:58.120 17:18:55 -- nvmf/common.sh@478 -- # killprocess 1822904 00:25:58.120 17:18:55 -- common/autotest_common.sh@936 -- # '[' -z 1822904 ']' 00:25:58.120 17:18:55 -- common/autotest_common.sh@940 -- # kill -0 1822904 00:25:58.120 17:18:55 -- common/autotest_common.sh@941 -- # uname 00:25:58.120 17:18:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.120 17:18:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1822904 00:25:58.120 17:18:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:58.120 17:18:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:58.120 17:18:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1822904' 00:25:58.120 killing process with pid 1822904 00:25:58.120 17:18:55 -- common/autotest_common.sh@955 -- # kill 1822904 00:25:58.120 17:18:55 -- common/autotest_common.sh@960 -- # wait 1822904 00:25:58.687 17:18:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:58.687 17:18:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:58.687 17:18:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:58.687 17:18:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:58.687 17:18:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:58.687 17:18:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.687 17:18:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.687 17:18:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.589 17:18:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:00.589 00:26:00.589 real 0m8.756s 00:26:00.589 user 0m16.558s 00:26:00.589 sys 0m2.387s 00:26:00.589 17:18:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:00.589 17:18:57 -- common/autotest_common.sh@10 -- # set +x 00:26:00.590 ************************************ 00:26:00.590 END TEST nvmf_multicontroller 00:26:00.590 ************************************ 00:26:00.590 17:18:57 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:00.590 17:18:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:00.590 17:18:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:00.590 17:18:57 -- common/autotest_common.sh@10 -- # set +x 00:26:00.590 ************************************ 00:26:00.590 START TEST nvmf_aer 00:26:00.590 ************************************ 00:26:00.590 17:18:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:00.590 * Looking for test storage... 00:26:00.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:00.590 17:18:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:00.590 17:18:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:00.590 17:18:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:00.848 17:18:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:00.848 17:18:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:00.848 17:18:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:00.848 17:18:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:00.848 17:18:57 -- scripts/common.sh@335 -- # IFS=.-: 00:26:00.848 17:18:57 -- scripts/common.sh@335 -- # read -ra ver1 00:26:00.848 17:18:57 -- scripts/common.sh@336 -- # IFS=.-: 00:26:00.848 17:18:57 -- scripts/common.sh@336 -- # read -ra ver2 00:26:00.848 17:18:57 -- scripts/common.sh@337 -- # local 'op=<' 00:26:00.848 17:18:57 -- scripts/common.sh@339 -- # ver1_l=2 00:26:00.848 17:18:57 -- scripts/common.sh@340 -- # ver2_l=1 00:26:00.848 17:18:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:00.848 17:18:57 -- scripts/common.sh@343 -- # case "$op" in 00:26:00.848 17:18:57 -- scripts/common.sh@344 -- # : 1 00:26:00.848 17:18:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:00.848 17:18:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:00.848 17:18:57 -- scripts/common.sh@364 -- # decimal 1 00:26:00.848 17:18:57 -- scripts/common.sh@352 -- # local d=1 00:26:00.848 17:18:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:00.848 17:18:57 -- scripts/common.sh@354 -- # echo 1 00:26:00.848 17:18:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:00.848 17:18:57 -- scripts/common.sh@365 -- # decimal 2 00:26:00.848 17:18:57 -- scripts/common.sh@352 -- # local d=2 00:26:00.848 17:18:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:00.848 17:18:57 -- scripts/common.sh@354 -- # echo 2 00:26:00.848 17:18:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:00.848 17:18:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:00.848 17:18:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:00.848 17:18:57 -- scripts/common.sh@367 -- # return 0 00:26:00.848 17:18:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:00.848 17:18:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:00.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.848 --rc genhtml_branch_coverage=1 00:26:00.848 --rc genhtml_function_coverage=1 00:26:00.848 --rc genhtml_legend=1 00:26:00.848 --rc geninfo_all_blocks=1 00:26:00.848 --rc geninfo_unexecuted_blocks=1 00:26:00.848 00:26:00.848 ' 00:26:00.848 17:18:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:00.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.848 --rc genhtml_branch_coverage=1 00:26:00.848 --rc genhtml_function_coverage=1 00:26:00.848 --rc genhtml_legend=1 00:26:00.848 --rc geninfo_all_blocks=1 00:26:00.848 --rc geninfo_unexecuted_blocks=1 00:26:00.848 00:26:00.848 ' 00:26:00.848 17:18:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:00.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.848 --rc genhtml_branch_coverage=1 00:26:00.848 --rc genhtml_function_coverage=1 00:26:00.848 --rc genhtml_legend=1 00:26:00.848 --rc geninfo_all_blocks=1 00:26:00.848 --rc geninfo_unexecuted_blocks=1 00:26:00.848 00:26:00.848 ' 00:26:00.848 17:18:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:00.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.848 --rc genhtml_branch_coverage=1 00:26:00.848 --rc genhtml_function_coverage=1 00:26:00.848 --rc genhtml_legend=1 00:26:00.848 --rc geninfo_all_blocks=1 00:26:00.848 --rc geninfo_unexecuted_blocks=1 00:26:00.848 00:26:00.848 ' 00:26:00.848 17:18:57 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:00.848 17:18:57 -- nvmf/common.sh@7 -- # uname -s 00:26:00.848 17:18:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:00.848 17:18:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:00.848 17:18:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:00.848 17:18:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:00.848 17:18:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:00.848 17:18:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:00.848 17:18:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:00.848 17:18:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:00.848 17:18:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:00.849 17:18:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:00.849 17:18:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.849 17:18:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.849 17:18:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:00.849 17:18:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:00.849 17:18:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:00.849 17:18:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:00.849 17:18:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:00.849 17:18:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:00.849 17:18:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:00.849 17:18:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.849 17:18:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.849 17:18:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.849 17:18:57 -- paths/export.sh@5 -- # export PATH 00:26:00.849 17:18:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.849 17:18:57 -- nvmf/common.sh@46 -- # : 0 00:26:00.849 17:18:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:00.849 17:18:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:00.849 17:18:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:00.849 17:18:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:00.849 17:18:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:00.849 17:18:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:00.849 17:18:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:00.849 17:18:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:00.849 17:18:57 -- host/aer.sh@11 -- # nvmftestinit 00:26:00.849 17:18:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:00.849 17:18:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:00.849 17:18:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:00.849 17:18:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:00.849 17:18:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:00.849 17:18:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.849 17:18:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.849 17:18:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.849 17:18:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:00.849 17:18:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:00.849 17:18:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:00.849 17:18:57 -- common/autotest_common.sh@10 -- # set +x 00:26:02.749 17:18:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:02.749 17:18:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:02.749 17:18:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:02.749 17:18:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:02.749 17:18:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:02.749 17:18:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:02.749 17:18:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:02.749 17:18:59 -- nvmf/common.sh@294 -- # net_devs=() 00:26:02.749 17:18:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:02.749 17:18:59 -- nvmf/common.sh@295 -- # e810=() 00:26:02.749 17:18:59 -- nvmf/common.sh@295 -- # local -ga e810 00:26:02.749 17:18:59 -- nvmf/common.sh@296 -- # x722=() 00:26:02.749 17:18:59 -- nvmf/common.sh@296 -- # local -ga x722 00:26:02.749 17:18:59 -- nvmf/common.sh@297 -- # mlx=() 00:26:02.749 17:18:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:02.749 17:18:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:02.749 17:18:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:02.749 17:18:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:02.749 17:18:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:02.749 17:18:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.749 17:18:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:02.749 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:02.749 17:18:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.749 17:18:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:02.749 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:02.749 17:18:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:02.749 17:18:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:02.749 17:18:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.749 17:18:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.749 17:18:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.749 17:18:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.749 17:18:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:02.749 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:02.749 17:18:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.749 17:18:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.749 17:18:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.749 17:18:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.749 17:18:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.749 17:18:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:02.749 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:02.750 17:18:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.750 17:18:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:02.750 17:18:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:02.750 17:18:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:02.750 17:18:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:02.750 17:18:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:02.750 17:18:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:02.750 17:18:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:02.750 17:18:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:02.750 17:18:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:02.750 17:18:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:02.750 17:18:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:02.750 17:18:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:02.750 17:18:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:02.750 17:18:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:02.750 17:18:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:02.750 17:18:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:02.750 17:18:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:02.750 17:18:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:02.750 17:18:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:02.750 17:18:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:03.008 17:18:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:03.008 17:18:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:03.008 17:18:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:03.008 17:18:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:03.008 17:18:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:03.008 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:03.008 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:26:03.008 00:26:03.008 --- 10.0.0.2 ping statistics --- 00:26:03.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.008 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:26:03.008 17:18:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:03.008 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:03.008 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:26:03.008 00:26:03.008 --- 10.0.0.1 ping statistics --- 00:26:03.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.008 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:26:03.008 17:18:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:03.008 17:18:59 -- nvmf/common.sh@410 -- # return 0 00:26:03.008 17:18:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:03.008 17:18:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:03.008 17:18:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:03.008 17:18:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:03.008 17:18:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:03.008 17:18:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:03.008 17:18:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:03.008 17:18:59 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:03.008 17:18:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:03.008 17:18:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:03.008 17:18:59 -- common/autotest_common.sh@10 -- # set +x 00:26:03.008 17:18:59 -- nvmf/common.sh@469 -- # nvmfpid=1825322 00:26:03.008 17:18:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:03.008 17:18:59 -- nvmf/common.sh@470 -- # waitforlisten 1825322 00:26:03.008 17:18:59 -- common/autotest_common.sh@829 -- # '[' -z 1825322 ']' 00:26:03.008 17:18:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.008 17:18:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.008 17:18:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.008 17:18:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.008 17:18:59 -- common/autotest_common.sh@10 -- # set +x 00:26:03.008 [2024-11-27 17:18:59.827464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:03.008 [2024-11-27 17:18:59.827575] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:03.008 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.008 [2024-11-27 17:18:59.896737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:03.267 [2024-11-27 17:18:59.983148] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:03.267 [2024-11-27 17:18:59.983297] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:03.267 [2024-11-27 17:18:59.983314] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:03.267 [2024-11-27 17:18:59.983328] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:03.267 [2024-11-27 17:18:59.983390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:03.267 [2024-11-27 17:18:59.983451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:03.267 [2024-11-27 17:18:59.983518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:03.267 [2024-11-27 17:18:59.983521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:04.201 17:19:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.201 17:19:00 -- common/autotest_common.sh@862 -- # return 0 00:26:04.201 17:19:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:04.201 17:19:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 17:19:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:04.201 17:19:00 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 [2024-11-27 17:19:00.872303] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 Malloc0 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 [2024-11-27 17:19:00.925306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:04.201 17:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.201 17:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:04.201 [2024-11-27 17:19:00.933072] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:04.201 [ 00:26:04.201 { 00:26:04.201 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:04.201 "subtype": "Discovery", 00:26:04.201 "listen_addresses": [], 00:26:04.201 "allow_any_host": true, 00:26:04.201 "hosts": [] 00:26:04.201 }, 00:26:04.201 { 00:26:04.201 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:04.201 "subtype": "NVMe", 00:26:04.201 "listen_addresses": [ 00:26:04.201 { 00:26:04.201 "transport": "TCP", 00:26:04.201 "trtype": "TCP", 00:26:04.201 "adrfam": "IPv4", 00:26:04.201 "traddr": "10.0.0.2", 00:26:04.201 "trsvcid": "4420" 00:26:04.201 } 00:26:04.201 ], 00:26:04.201 "allow_any_host": true, 00:26:04.201 "hosts": [], 00:26:04.201 "serial_number": "SPDK00000000000001", 00:26:04.201 "model_number": "SPDK bdev Controller", 00:26:04.201 "max_namespaces": 2, 00:26:04.201 "min_cntlid": 1, 00:26:04.201 "max_cntlid": 65519, 00:26:04.201 "namespaces": [ 00:26:04.201 { 00:26:04.201 "nsid": 1, 00:26:04.201 "bdev_name": "Malloc0", 00:26:04.201 "name": "Malloc0", 00:26:04.201 "nguid": "66A56ACB5F9C4381A34EEBE88BB2B6B5", 00:26:04.201 "uuid": "66a56acb-5f9c-4381-a34e-ebe88bb2b6b5" 00:26:04.201 } 00:26:04.201 ] 00:26:04.201 } 00:26:04.201 ] 00:26:04.201 17:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.201 17:19:00 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:04.201 17:19:00 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:04.201 17:19:00 -- host/aer.sh@33 -- # aerpid=1825504 00:26:04.201 17:19:00 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:04.201 17:19:00 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:04.201 17:19:00 -- common/autotest_common.sh@1254 -- # local i=0 00:26:04.201 17:19:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:04.201 17:19:00 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:26:04.201 17:19:00 -- common/autotest_common.sh@1257 -- # i=1 00:26:04.201 17:19:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:04.201 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.201 17:19:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:04.201 17:19:01 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:26:04.201 17:19:01 -- common/autotest_common.sh@1257 -- # i=2 00:26:04.201 17:19:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:04.201 17:19:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:04.201 17:19:01 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:26:04.201 17:19:01 -- common/autotest_common.sh@1257 -- # i=3 00:26:04.201 17:19:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:04.460 17:19:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:04.460 17:19:01 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:04.460 17:19:01 -- common/autotest_common.sh@1265 -- # return 0 00:26:04.460 17:19:01 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 Malloc1 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 Asynchronous Event Request test 00:26:04.460 Attaching to 10.0.0.2 00:26:04.460 Attached to 10.0.0.2 00:26:04.460 Registering asynchronous event callbacks... 00:26:04.460 Starting namespace attribute notice tests for all controllers... 00:26:04.460 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:04.460 aer_cb - Changed Namespace 00:26:04.460 Cleaning up... 00:26:04.460 [ 00:26:04.460 { 00:26:04.460 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:04.460 "subtype": "Discovery", 00:26:04.460 "listen_addresses": [], 00:26:04.460 "allow_any_host": true, 00:26:04.460 "hosts": [] 00:26:04.460 }, 00:26:04.460 { 00:26:04.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:04.460 "subtype": "NVMe", 00:26:04.460 "listen_addresses": [ 00:26:04.460 { 00:26:04.460 "transport": "TCP", 00:26:04.460 "trtype": "TCP", 00:26:04.460 "adrfam": "IPv4", 00:26:04.460 "traddr": "10.0.0.2", 00:26:04.460 "trsvcid": "4420" 00:26:04.460 } 00:26:04.460 ], 00:26:04.460 "allow_any_host": true, 00:26:04.460 "hosts": [], 00:26:04.460 "serial_number": "SPDK00000000000001", 00:26:04.460 "model_number": "SPDK bdev Controller", 00:26:04.460 "max_namespaces": 2, 00:26:04.460 "min_cntlid": 1, 00:26:04.460 "max_cntlid": 65519, 00:26:04.460 "namespaces": [ 00:26:04.460 { 00:26:04.460 "nsid": 1, 00:26:04.460 "bdev_name": "Malloc0", 00:26:04.460 "name": "Malloc0", 00:26:04.460 "nguid": "66A56ACB5F9C4381A34EEBE88BB2B6B5", 00:26:04.460 "uuid": "66a56acb-5f9c-4381-a34e-ebe88bb2b6b5" 00:26:04.460 }, 00:26:04.460 { 00:26:04.460 "nsid": 2, 00:26:04.460 "bdev_name": "Malloc1", 00:26:04.460 "name": "Malloc1", 00:26:04.460 "nguid": "9F0E4C2CB8954852BE62C026582975CD", 00:26:04.460 "uuid": "9f0e4c2c-b895-4852-be62-c026582975cd" 00:26:04.460 } 00:26:04.460 ] 00:26:04.460 } 00:26:04.460 ] 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@43 -- # wait 1825504 00:26:04.460 17:19:01 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:04.460 17:19:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.460 17:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.460 17:19:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.460 17:19:01 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:04.460 17:19:01 -- host/aer.sh@51 -- # nvmftestfini 00:26:04.460 17:19:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:04.460 17:19:01 -- nvmf/common.sh@116 -- # sync 00:26:04.460 17:19:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:04.460 17:19:01 -- nvmf/common.sh@119 -- # set +e 00:26:04.460 17:19:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:04.460 17:19:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:04.460 rmmod nvme_tcp 00:26:04.719 rmmod nvme_fabrics 00:26:04.719 rmmod nvme_keyring 00:26:04.719 17:19:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:04.719 17:19:01 -- nvmf/common.sh@123 -- # set -e 00:26:04.719 17:19:01 -- nvmf/common.sh@124 -- # return 0 00:26:04.719 17:19:01 -- nvmf/common.sh@477 -- # '[' -n 1825322 ']' 00:26:04.719 17:19:01 -- nvmf/common.sh@478 -- # killprocess 1825322 00:26:04.719 17:19:01 -- common/autotest_common.sh@936 -- # '[' -z 1825322 ']' 00:26:04.719 17:19:01 -- common/autotest_common.sh@940 -- # kill -0 1825322 00:26:04.719 17:19:01 -- common/autotest_common.sh@941 -- # uname 00:26:04.719 17:19:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:04.719 17:19:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1825322 00:26:04.719 17:19:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:04.719 17:19:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:04.719 17:19:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1825322' 00:26:04.719 killing process with pid 1825322 00:26:04.719 17:19:01 -- common/autotest_common.sh@955 -- # kill 1825322 00:26:04.719 [2024-11-27 17:19:01.482554] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:04.719 17:19:01 -- common/autotest_common.sh@960 -- # wait 1825322 00:26:04.978 17:19:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:04.978 17:19:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:04.978 17:19:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:04.978 17:19:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:04.978 17:19:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:04.978 17:19:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.978 17:19:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.978 17:19:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.990 17:19:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:06.990 00:26:06.990 real 0m6.328s 00:26:06.990 user 0m7.783s 00:26:06.990 sys 0m2.033s 00:26:06.990 17:19:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:06.990 17:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:06.990 ************************************ 00:26:06.990 END TEST nvmf_aer 00:26:06.990 ************************************ 00:26:06.990 17:19:03 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:06.990 17:19:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:06.990 17:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:06.990 ************************************ 00:26:06.990 START TEST nvmf_async_init 00:26:06.990 ************************************ 00:26:06.990 17:19:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:06.990 * Looking for test storage... 00:26:06.990 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:06.990 17:19:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:06.990 17:19:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:06.990 17:19:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:06.990 17:19:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:06.990 17:19:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:06.990 17:19:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:06.990 17:19:03 -- scripts/common.sh@335 -- # IFS=.-: 00:26:06.990 17:19:03 -- scripts/common.sh@335 -- # read -ra ver1 00:26:06.990 17:19:03 -- scripts/common.sh@336 -- # IFS=.-: 00:26:06.990 17:19:03 -- scripts/common.sh@336 -- # read -ra ver2 00:26:06.990 17:19:03 -- scripts/common.sh@337 -- # local 'op=<' 00:26:06.990 17:19:03 -- scripts/common.sh@339 -- # ver1_l=2 00:26:06.990 17:19:03 -- scripts/common.sh@340 -- # ver2_l=1 00:26:06.990 17:19:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:06.990 17:19:03 -- scripts/common.sh@343 -- # case "$op" in 00:26:06.990 17:19:03 -- scripts/common.sh@344 -- # : 1 00:26:06.990 17:19:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:06.990 17:19:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:06.990 17:19:03 -- scripts/common.sh@364 -- # decimal 1 00:26:06.990 17:19:03 -- scripts/common.sh@352 -- # local d=1 00:26:06.990 17:19:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:06.990 17:19:03 -- scripts/common.sh@354 -- # echo 1 00:26:06.990 17:19:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:06.990 17:19:03 -- scripts/common.sh@365 -- # decimal 2 00:26:06.990 17:19:03 -- scripts/common.sh@352 -- # local d=2 00:26:06.990 17:19:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:06.990 17:19:03 -- scripts/common.sh@354 -- # echo 2 00:26:06.990 17:19:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:06.990 17:19:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:06.990 17:19:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:06.990 17:19:03 -- scripts/common.sh@367 -- # return 0 00:26:06.990 17:19:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:06.990 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.990 --rc genhtml_branch_coverage=1 00:26:06.990 --rc genhtml_function_coverage=1 00:26:06.990 --rc genhtml_legend=1 00:26:06.990 --rc geninfo_all_blocks=1 00:26:06.990 --rc geninfo_unexecuted_blocks=1 00:26:06.990 00:26:06.990 ' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:06.990 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.990 --rc genhtml_branch_coverage=1 00:26:06.990 --rc genhtml_function_coverage=1 00:26:06.990 --rc genhtml_legend=1 00:26:06.990 --rc geninfo_all_blocks=1 00:26:06.990 --rc geninfo_unexecuted_blocks=1 00:26:06.990 00:26:06.990 ' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:06.990 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.990 --rc genhtml_branch_coverage=1 00:26:06.990 --rc genhtml_function_coverage=1 00:26:06.990 --rc genhtml_legend=1 00:26:06.990 --rc geninfo_all_blocks=1 00:26:06.990 --rc geninfo_unexecuted_blocks=1 00:26:06.990 00:26:06.990 ' 00:26:06.990 17:19:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:06.990 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.990 --rc genhtml_branch_coverage=1 00:26:06.990 --rc genhtml_function_coverage=1 00:26:06.990 --rc genhtml_legend=1 00:26:06.990 --rc geninfo_all_blocks=1 00:26:06.990 --rc geninfo_unexecuted_blocks=1 00:26:06.990 00:26:06.990 ' 00:26:06.990 17:19:03 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:06.990 17:19:03 -- nvmf/common.sh@7 -- # uname -s 00:26:06.990 17:19:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:06.990 17:19:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:06.990 17:19:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:06.990 17:19:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:06.990 17:19:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:06.990 17:19:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:06.990 17:19:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:06.990 17:19:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:06.990 17:19:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:06.990 17:19:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:06.990 17:19:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:06.990 17:19:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:06.990 17:19:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:06.990 17:19:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:06.990 17:19:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:06.990 17:19:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:06.990 17:19:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:06.990 17:19:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:06.991 17:19:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:06.991 17:19:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.991 17:19:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.991 17:19:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.991 17:19:03 -- paths/export.sh@5 -- # export PATH 00:26:06.991 17:19:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.991 17:19:03 -- nvmf/common.sh@46 -- # : 0 00:26:06.991 17:19:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:06.991 17:19:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:06.991 17:19:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:06.991 17:19:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:06.991 17:19:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:06.991 17:19:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:06.991 17:19:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:06.991 17:19:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:06.991 17:19:03 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:06.991 17:19:03 -- host/async_init.sh@14 -- # null_block_size=512 00:26:06.991 17:19:03 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:06.991 17:19:03 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:06.991 17:19:03 -- host/async_init.sh@20 -- # uuidgen 00:26:06.991 17:19:03 -- host/async_init.sh@20 -- # tr -d - 00:26:06.991 17:19:03 -- host/async_init.sh@20 -- # nguid=b5c0e2bcc4ab442cbb854ac0ad746118 00:26:06.991 17:19:03 -- host/async_init.sh@22 -- # nvmftestinit 00:26:06.991 17:19:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:06.991 17:19:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:06.991 17:19:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:06.991 17:19:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:06.991 17:19:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:06.991 17:19:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:06.991 17:19:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:06.991 17:19:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.991 17:19:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:06.991 17:19:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:06.991 17:19:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:06.991 17:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:09.522 17:19:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:09.522 17:19:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:09.522 17:19:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:09.522 17:19:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:09.522 17:19:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:09.522 17:19:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:09.522 17:19:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:09.522 17:19:05 -- nvmf/common.sh@294 -- # net_devs=() 00:26:09.522 17:19:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:09.522 17:19:05 -- nvmf/common.sh@295 -- # e810=() 00:26:09.522 17:19:05 -- nvmf/common.sh@295 -- # local -ga e810 00:26:09.522 17:19:05 -- nvmf/common.sh@296 -- # x722=() 00:26:09.522 17:19:05 -- nvmf/common.sh@296 -- # local -ga x722 00:26:09.522 17:19:05 -- nvmf/common.sh@297 -- # mlx=() 00:26:09.522 17:19:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:09.522 17:19:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:09.522 17:19:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:09.522 17:19:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:09.522 17:19:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:09.522 17:19:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:09.522 17:19:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:09.522 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:09.522 17:19:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:09.522 17:19:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:09.522 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:09.522 17:19:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:09.522 17:19:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:09.522 17:19:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:09.522 17:19:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:09.522 17:19:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:09.522 17:19:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:09.522 17:19:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:09.522 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:09.522 17:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:09.522 17:19:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:09.522 17:19:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:09.522 17:19:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:09.522 17:19:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:09.523 17:19:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:09.523 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:09.523 17:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:09.523 17:19:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:09.523 17:19:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:09.523 17:19:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:09.523 17:19:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:09.523 17:19:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:09.523 17:19:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:09.523 17:19:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:09.523 17:19:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:09.523 17:19:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:09.523 17:19:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:09.523 17:19:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:09.523 17:19:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:09.523 17:19:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:09.523 17:19:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:09.523 17:19:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:09.523 17:19:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:09.523 17:19:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:09.523 17:19:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:09.523 17:19:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:09.523 17:19:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:09.523 17:19:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:09.523 17:19:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:09.523 17:19:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:09.523 17:19:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:09.523 17:19:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:09.523 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:09.523 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:26:09.523 00:26:09.523 --- 10.0.0.2 ping statistics --- 00:26:09.523 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:09.523 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:26:09.523 17:19:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:09.523 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:09.523 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:26:09.523 00:26:09.523 --- 10.0.0.1 ping statistics --- 00:26:09.523 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:09.523 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:26:09.523 17:19:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:09.523 17:19:06 -- nvmf/common.sh@410 -- # return 0 00:26:09.523 17:19:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:09.523 17:19:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:09.523 17:19:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:09.523 17:19:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:09.523 17:19:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:09.523 17:19:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:09.523 17:19:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:09.523 17:19:06 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:09.523 17:19:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:09.523 17:19:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:09.523 17:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:09.523 17:19:06 -- nvmf/common.sh@469 -- # nvmfpid=1827549 00:26:09.523 17:19:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:09.523 17:19:06 -- nvmf/common.sh@470 -- # waitforlisten 1827549 00:26:09.523 17:19:06 -- common/autotest_common.sh@829 -- # '[' -z 1827549 ']' 00:26:09.523 17:19:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:09.523 17:19:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:09.523 17:19:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:09.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:09.523 17:19:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:09.523 17:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:09.523 [2024-11-27 17:19:06.130186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:09.523 [2024-11-27 17:19:06.130264] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:09.523 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.523 [2024-11-27 17:19:06.204392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.523 [2024-11-27 17:19:06.300781] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:09.523 [2024-11-27 17:19:06.300951] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:09.523 [2024-11-27 17:19:06.300969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:09.523 [2024-11-27 17:19:06.300981] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:09.523 [2024-11-27 17:19:06.301010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:10.457 17:19:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:10.457 17:19:07 -- common/autotest_common.sh@862 -- # return 0 00:26:10.457 17:19:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:10.457 17:19:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:10.457 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 17:19:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:10.458 17:19:07 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 [2024-11-27 17:19:07.148912] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 null0 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g b5c0e2bcc4ab442cbb854ac0ad746118 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.458 [2024-11-27 17:19:07.189158] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:10.458 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.458 17:19:07 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:10.458 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.458 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 nvme0n1 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 [ 00:26:10.716 { 00:26:10.716 "name": "nvme0n1", 00:26:10.716 "aliases": [ 00:26:10.716 "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118" 00:26:10.716 ], 00:26:10.716 "product_name": "NVMe disk", 00:26:10.716 "block_size": 512, 00:26:10.716 "num_blocks": 2097152, 00:26:10.716 "uuid": "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118", 00:26:10.716 "assigned_rate_limits": { 00:26:10.716 "rw_ios_per_sec": 0, 00:26:10.716 "rw_mbytes_per_sec": 0, 00:26:10.716 "r_mbytes_per_sec": 0, 00:26:10.716 "w_mbytes_per_sec": 0 00:26:10.716 }, 00:26:10.716 "claimed": false, 00:26:10.716 "zoned": false, 00:26:10.716 "supported_io_types": { 00:26:10.716 "read": true, 00:26:10.716 "write": true, 00:26:10.716 "unmap": false, 00:26:10.716 "write_zeroes": true, 00:26:10.716 "flush": true, 00:26:10.716 "reset": true, 00:26:10.716 "compare": true, 00:26:10.716 "compare_and_write": true, 00:26:10.716 "abort": true, 00:26:10.716 "nvme_admin": true, 00:26:10.716 "nvme_io": true 00:26:10.716 }, 00:26:10.716 "driver_specific": { 00:26:10.716 "nvme": [ 00:26:10.716 { 00:26:10.716 "trid": { 00:26:10.716 "trtype": "TCP", 00:26:10.716 "adrfam": "IPv4", 00:26:10.716 "traddr": "10.0.0.2", 00:26:10.716 "trsvcid": "4420", 00:26:10.716 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:10.716 }, 00:26:10.716 "ctrlr_data": { 00:26:10.716 "cntlid": 1, 00:26:10.716 "vendor_id": "0x8086", 00:26:10.716 "model_number": "SPDK bdev Controller", 00:26:10.716 "serial_number": "00000000000000000000", 00:26:10.716 "firmware_revision": "24.01.1", 00:26:10.716 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:10.716 "oacs": { 00:26:10.716 "security": 0, 00:26:10.716 "format": 0, 00:26:10.716 "firmware": 0, 00:26:10.716 "ns_manage": 0 00:26:10.716 }, 00:26:10.716 "multi_ctrlr": true, 00:26:10.716 "ana_reporting": false 00:26:10.716 }, 00:26:10.716 "vs": { 00:26:10.716 "nvme_version": "1.3" 00:26:10.716 }, 00:26:10.716 "ns_data": { 00:26:10.716 "id": 1, 00:26:10.716 "can_share": true 00:26:10.716 } 00:26:10.716 } 00:26:10.716 ], 00:26:10.716 "mp_policy": "active_passive" 00:26:10.716 } 00:26:10.716 } 00:26:10.716 ] 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 [2024-11-27 17:19:07.437884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.716 [2024-11-27 17:19:07.437975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2368ba0 (9): Bad file descriptor 00:26:10.716 [2024-11-27 17:19:07.569677] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 [ 00:26:10.716 { 00:26:10.716 "name": "nvme0n1", 00:26:10.716 "aliases": [ 00:26:10.716 "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118" 00:26:10.716 ], 00:26:10.716 "product_name": "NVMe disk", 00:26:10.716 "block_size": 512, 00:26:10.716 "num_blocks": 2097152, 00:26:10.716 "uuid": "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118", 00:26:10.716 "assigned_rate_limits": { 00:26:10.716 "rw_ios_per_sec": 0, 00:26:10.716 "rw_mbytes_per_sec": 0, 00:26:10.716 "r_mbytes_per_sec": 0, 00:26:10.716 "w_mbytes_per_sec": 0 00:26:10.716 }, 00:26:10.716 "claimed": false, 00:26:10.716 "zoned": false, 00:26:10.716 "supported_io_types": { 00:26:10.716 "read": true, 00:26:10.716 "write": true, 00:26:10.716 "unmap": false, 00:26:10.716 "write_zeroes": true, 00:26:10.716 "flush": true, 00:26:10.716 "reset": true, 00:26:10.716 "compare": true, 00:26:10.716 "compare_and_write": true, 00:26:10.716 "abort": true, 00:26:10.716 "nvme_admin": true, 00:26:10.716 "nvme_io": true 00:26:10.716 }, 00:26:10.716 "driver_specific": { 00:26:10.716 "nvme": [ 00:26:10.716 { 00:26:10.716 "trid": { 00:26:10.716 "trtype": "TCP", 00:26:10.716 "adrfam": "IPv4", 00:26:10.716 "traddr": "10.0.0.2", 00:26:10.716 "trsvcid": "4420", 00:26:10.716 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:10.716 }, 00:26:10.716 "ctrlr_data": { 00:26:10.716 "cntlid": 2, 00:26:10.716 "vendor_id": "0x8086", 00:26:10.716 "model_number": "SPDK bdev Controller", 00:26:10.716 "serial_number": "00000000000000000000", 00:26:10.716 "firmware_revision": "24.01.1", 00:26:10.716 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:10.716 "oacs": { 00:26:10.716 "security": 0, 00:26:10.716 "format": 0, 00:26:10.716 "firmware": 0, 00:26:10.716 "ns_manage": 0 00:26:10.716 }, 00:26:10.716 "multi_ctrlr": true, 00:26:10.716 "ana_reporting": false 00:26:10.716 }, 00:26:10.716 "vs": { 00:26:10.716 "nvme_version": "1.3" 00:26:10.716 }, 00:26:10.716 "ns_data": { 00:26:10.716 "id": 1, 00:26:10.716 "can_share": true 00:26:10.716 } 00:26:10.716 } 00:26:10.716 ], 00:26:10.716 "mp_policy": "active_passive" 00:26:10.716 } 00:26:10.716 } 00:26:10.716 ] 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@53 -- # mktemp 00:26:10.716 17:19:07 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.FHu60aHWyy 00:26:10.716 17:19:07 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:10.716 17:19:07 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.FHu60aHWyy 00:26:10.716 17:19:07 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 [2024-11-27 17:19:07.614464] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:10.716 [2024-11-27 17:19:07.614622] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.FHu60aHWyy 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.716 17:19:07 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.FHu60aHWyy 00:26:10.716 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.716 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.716 [2024-11-27 17:19:07.630503] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:10.974 nvme0n1 00:26:10.974 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.974 17:19:07 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:10.974 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.974 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.974 [ 00:26:10.974 { 00:26:10.974 "name": "nvme0n1", 00:26:10.974 "aliases": [ 00:26:10.974 "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118" 00:26:10.974 ], 00:26:10.974 "product_name": "NVMe disk", 00:26:10.974 "block_size": 512, 00:26:10.974 "num_blocks": 2097152, 00:26:10.974 "uuid": "b5c0e2bc-c4ab-442c-bb85-4ac0ad746118", 00:26:10.974 "assigned_rate_limits": { 00:26:10.974 "rw_ios_per_sec": 0, 00:26:10.974 "rw_mbytes_per_sec": 0, 00:26:10.974 "r_mbytes_per_sec": 0, 00:26:10.974 "w_mbytes_per_sec": 0 00:26:10.974 }, 00:26:10.974 "claimed": false, 00:26:10.974 "zoned": false, 00:26:10.974 "supported_io_types": { 00:26:10.974 "read": true, 00:26:10.974 "write": true, 00:26:10.974 "unmap": false, 00:26:10.974 "write_zeroes": true, 00:26:10.974 "flush": true, 00:26:10.974 "reset": true, 00:26:10.974 "compare": true, 00:26:10.974 "compare_and_write": true, 00:26:10.974 "abort": true, 00:26:10.974 "nvme_admin": true, 00:26:10.974 "nvme_io": true 00:26:10.974 }, 00:26:10.974 "driver_specific": { 00:26:10.974 "nvme": [ 00:26:10.974 { 00:26:10.974 "trid": { 00:26:10.974 "trtype": "TCP", 00:26:10.974 "adrfam": "IPv4", 00:26:10.974 "traddr": "10.0.0.2", 00:26:10.974 "trsvcid": "4421", 00:26:10.974 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:10.974 }, 00:26:10.974 "ctrlr_data": { 00:26:10.974 "cntlid": 3, 00:26:10.975 "vendor_id": "0x8086", 00:26:10.975 "model_number": "SPDK bdev Controller", 00:26:10.975 "serial_number": "00000000000000000000", 00:26:10.975 "firmware_revision": "24.01.1", 00:26:10.975 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:10.975 "oacs": { 00:26:10.975 "security": 0, 00:26:10.975 "format": 0, 00:26:10.975 "firmware": 0, 00:26:10.975 "ns_manage": 0 00:26:10.975 }, 00:26:10.975 "multi_ctrlr": true, 00:26:10.975 "ana_reporting": false 00:26:10.975 }, 00:26:10.975 "vs": { 00:26:10.975 "nvme_version": "1.3" 00:26:10.975 }, 00:26:10.975 "ns_data": { 00:26:10.975 "id": 1, 00:26:10.975 "can_share": true 00:26:10.975 } 00:26:10.975 } 00:26:10.975 ], 00:26:10.975 "mp_policy": "active_passive" 00:26:10.975 } 00:26:10.975 } 00:26:10.975 ] 00:26:10.975 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.975 17:19:07 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:10.975 17:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.975 17:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.975 17:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.975 17:19:07 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.FHu60aHWyy 00:26:10.975 17:19:07 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:10.975 17:19:07 -- host/async_init.sh@78 -- # nvmftestfini 00:26:10.975 17:19:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:10.975 17:19:07 -- nvmf/common.sh@116 -- # sync 00:26:10.975 17:19:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:10.975 17:19:07 -- nvmf/common.sh@119 -- # set +e 00:26:10.975 17:19:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:10.975 17:19:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:10.975 rmmod nvme_tcp 00:26:10.975 rmmod nvme_fabrics 00:26:10.975 rmmod nvme_keyring 00:26:10.975 17:19:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:10.975 17:19:07 -- nvmf/common.sh@123 -- # set -e 00:26:10.975 17:19:07 -- nvmf/common.sh@124 -- # return 0 00:26:10.975 17:19:07 -- nvmf/common.sh@477 -- # '[' -n 1827549 ']' 00:26:10.975 17:19:07 -- nvmf/common.sh@478 -- # killprocess 1827549 00:26:10.975 17:19:07 -- common/autotest_common.sh@936 -- # '[' -z 1827549 ']' 00:26:10.975 17:19:07 -- common/autotest_common.sh@940 -- # kill -0 1827549 00:26:10.975 17:19:07 -- common/autotest_common.sh@941 -- # uname 00:26:10.975 17:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:10.975 17:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1827549 00:26:10.975 17:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:10.975 17:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:10.975 17:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1827549' 00:26:10.975 killing process with pid 1827549 00:26:10.975 17:19:07 -- common/autotest_common.sh@955 -- # kill 1827549 00:26:10.975 17:19:07 -- common/autotest_common.sh@960 -- # wait 1827549 00:26:11.233 17:19:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:11.233 17:19:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:11.233 17:19:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:11.233 17:19:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:11.233 17:19:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:11.233 17:19:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.233 17:19:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.233 17:19:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:13.136 17:19:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:13.395 00:26:13.395 real 0m6.321s 00:26:13.395 user 0m3.073s 00:26:13.395 sys 0m1.908s 00:26:13.395 17:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:13.395 17:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:13.395 ************************************ 00:26:13.395 END TEST nvmf_async_init 00:26:13.395 ************************************ 00:26:13.395 17:19:10 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:13.395 17:19:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:13.395 17:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:13.395 ************************************ 00:26:13.395 START TEST dma 00:26:13.395 ************************************ 00:26:13.395 17:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:13.395 * Looking for test storage... 00:26:13.395 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:13.395 17:19:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:13.395 17:19:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:13.395 17:19:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:13.395 17:19:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:13.395 17:19:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:13.395 17:19:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:13.395 17:19:10 -- scripts/common.sh@335 -- # IFS=.-: 00:26:13.395 17:19:10 -- scripts/common.sh@335 -- # read -ra ver1 00:26:13.395 17:19:10 -- scripts/common.sh@336 -- # IFS=.-: 00:26:13.395 17:19:10 -- scripts/common.sh@336 -- # read -ra ver2 00:26:13.395 17:19:10 -- scripts/common.sh@337 -- # local 'op=<' 00:26:13.395 17:19:10 -- scripts/common.sh@339 -- # ver1_l=2 00:26:13.395 17:19:10 -- scripts/common.sh@340 -- # ver2_l=1 00:26:13.395 17:19:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:13.395 17:19:10 -- scripts/common.sh@343 -- # case "$op" in 00:26:13.395 17:19:10 -- scripts/common.sh@344 -- # : 1 00:26:13.395 17:19:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:13.395 17:19:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:13.395 17:19:10 -- scripts/common.sh@364 -- # decimal 1 00:26:13.395 17:19:10 -- scripts/common.sh@352 -- # local d=1 00:26:13.395 17:19:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:13.395 17:19:10 -- scripts/common.sh@354 -- # echo 1 00:26:13.395 17:19:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:13.395 17:19:10 -- scripts/common.sh@365 -- # decimal 2 00:26:13.395 17:19:10 -- scripts/common.sh@352 -- # local d=2 00:26:13.395 17:19:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:13.395 17:19:10 -- scripts/common.sh@354 -- # echo 2 00:26:13.395 17:19:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:13.395 17:19:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:13.395 17:19:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:13.395 17:19:10 -- scripts/common.sh@367 -- # return 0 00:26:13.395 17:19:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:13.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.395 --rc genhtml_branch_coverage=1 00:26:13.395 --rc genhtml_function_coverage=1 00:26:13.395 --rc genhtml_legend=1 00:26:13.395 --rc geninfo_all_blocks=1 00:26:13.395 --rc geninfo_unexecuted_blocks=1 00:26:13.395 00:26:13.395 ' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:13.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.395 --rc genhtml_branch_coverage=1 00:26:13.395 --rc genhtml_function_coverage=1 00:26:13.395 --rc genhtml_legend=1 00:26:13.395 --rc geninfo_all_blocks=1 00:26:13.395 --rc geninfo_unexecuted_blocks=1 00:26:13.395 00:26:13.395 ' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:13.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.395 --rc genhtml_branch_coverage=1 00:26:13.395 --rc genhtml_function_coverage=1 00:26:13.395 --rc genhtml_legend=1 00:26:13.395 --rc geninfo_all_blocks=1 00:26:13.395 --rc geninfo_unexecuted_blocks=1 00:26:13.395 00:26:13.395 ' 00:26:13.395 17:19:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:13.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.395 --rc genhtml_branch_coverage=1 00:26:13.395 --rc genhtml_function_coverage=1 00:26:13.395 --rc genhtml_legend=1 00:26:13.395 --rc geninfo_all_blocks=1 00:26:13.395 --rc geninfo_unexecuted_blocks=1 00:26:13.395 00:26:13.395 ' 00:26:13.395 17:19:10 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:13.395 17:19:10 -- nvmf/common.sh@7 -- # uname -s 00:26:13.395 17:19:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:13.395 17:19:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:13.395 17:19:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:13.395 17:19:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:13.395 17:19:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:13.395 17:19:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:13.395 17:19:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:13.395 17:19:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:13.395 17:19:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:13.395 17:19:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:13.395 17:19:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.395 17:19:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.395 17:19:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:13.395 17:19:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:13.395 17:19:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:13.395 17:19:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:13.395 17:19:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:13.395 17:19:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:13.395 17:19:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:13.396 17:19:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.396 17:19:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.396 17:19:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.396 17:19:10 -- paths/export.sh@5 -- # export PATH 00:26:13.396 17:19:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.396 17:19:10 -- nvmf/common.sh@46 -- # : 0 00:26:13.396 17:19:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:13.396 17:19:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:13.396 17:19:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:13.396 17:19:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:13.396 17:19:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:13.396 17:19:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:13.396 17:19:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:13.396 17:19:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:13.396 17:19:10 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:13.396 17:19:10 -- host/dma.sh@13 -- # exit 0 00:26:13.396 00:26:13.396 real 0m0.148s 00:26:13.396 user 0m0.095s 00:26:13.396 sys 0m0.062s 00:26:13.396 17:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:13.396 17:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:13.396 ************************************ 00:26:13.396 END TEST dma 00:26:13.396 ************************************ 00:26:13.396 17:19:10 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:13.396 17:19:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:13.396 17:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:13.396 17:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:13.396 ************************************ 00:26:13.396 START TEST nvmf_identify 00:26:13.396 ************************************ 00:26:13.396 17:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:13.396 * Looking for test storage... 00:26:13.396 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:13.396 17:19:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:13.396 17:19:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:13.396 17:19:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:13.654 17:19:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:13.654 17:19:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:13.654 17:19:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:13.654 17:19:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:13.654 17:19:10 -- scripts/common.sh@335 -- # IFS=.-: 00:26:13.654 17:19:10 -- scripts/common.sh@335 -- # read -ra ver1 00:26:13.654 17:19:10 -- scripts/common.sh@336 -- # IFS=.-: 00:26:13.654 17:19:10 -- scripts/common.sh@336 -- # read -ra ver2 00:26:13.654 17:19:10 -- scripts/common.sh@337 -- # local 'op=<' 00:26:13.654 17:19:10 -- scripts/common.sh@339 -- # ver1_l=2 00:26:13.654 17:19:10 -- scripts/common.sh@340 -- # ver2_l=1 00:26:13.654 17:19:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:13.654 17:19:10 -- scripts/common.sh@343 -- # case "$op" in 00:26:13.654 17:19:10 -- scripts/common.sh@344 -- # : 1 00:26:13.654 17:19:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:13.654 17:19:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:13.655 17:19:10 -- scripts/common.sh@364 -- # decimal 1 00:26:13.655 17:19:10 -- scripts/common.sh@352 -- # local d=1 00:26:13.655 17:19:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:13.655 17:19:10 -- scripts/common.sh@354 -- # echo 1 00:26:13.655 17:19:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:13.655 17:19:10 -- scripts/common.sh@365 -- # decimal 2 00:26:13.655 17:19:10 -- scripts/common.sh@352 -- # local d=2 00:26:13.655 17:19:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:13.655 17:19:10 -- scripts/common.sh@354 -- # echo 2 00:26:13.655 17:19:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:13.655 17:19:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:13.655 17:19:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:13.655 17:19:10 -- scripts/common.sh@367 -- # return 0 00:26:13.655 17:19:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:13.655 17:19:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:13.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.655 --rc genhtml_branch_coverage=1 00:26:13.655 --rc genhtml_function_coverage=1 00:26:13.655 --rc genhtml_legend=1 00:26:13.655 --rc geninfo_all_blocks=1 00:26:13.655 --rc geninfo_unexecuted_blocks=1 00:26:13.655 00:26:13.655 ' 00:26:13.655 17:19:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:13.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.655 --rc genhtml_branch_coverage=1 00:26:13.655 --rc genhtml_function_coverage=1 00:26:13.655 --rc genhtml_legend=1 00:26:13.655 --rc geninfo_all_blocks=1 00:26:13.655 --rc geninfo_unexecuted_blocks=1 00:26:13.655 00:26:13.655 ' 00:26:13.655 17:19:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:13.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.655 --rc genhtml_branch_coverage=1 00:26:13.655 --rc genhtml_function_coverage=1 00:26:13.655 --rc genhtml_legend=1 00:26:13.655 --rc geninfo_all_blocks=1 00:26:13.655 --rc geninfo_unexecuted_blocks=1 00:26:13.655 00:26:13.655 ' 00:26:13.655 17:19:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:13.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.655 --rc genhtml_branch_coverage=1 00:26:13.655 --rc genhtml_function_coverage=1 00:26:13.655 --rc genhtml_legend=1 00:26:13.655 --rc geninfo_all_blocks=1 00:26:13.655 --rc geninfo_unexecuted_blocks=1 00:26:13.655 00:26:13.655 ' 00:26:13.655 17:19:10 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:13.655 17:19:10 -- nvmf/common.sh@7 -- # uname -s 00:26:13.655 17:19:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:13.655 17:19:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:13.655 17:19:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:13.655 17:19:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:13.655 17:19:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:13.655 17:19:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:13.655 17:19:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:13.655 17:19:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:13.655 17:19:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:13.655 17:19:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:13.655 17:19:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.655 17:19:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.655 17:19:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:13.655 17:19:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:13.655 17:19:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:13.655 17:19:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:13.655 17:19:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:13.655 17:19:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:13.655 17:19:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:13.655 17:19:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.655 17:19:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.655 17:19:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.655 17:19:10 -- paths/export.sh@5 -- # export PATH 00:26:13.655 17:19:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.655 17:19:10 -- nvmf/common.sh@46 -- # : 0 00:26:13.655 17:19:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:13.655 17:19:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:13.655 17:19:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:13.655 17:19:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:13.655 17:19:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:13.655 17:19:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:13.655 17:19:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:13.655 17:19:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:13.655 17:19:10 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:13.655 17:19:10 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:13.655 17:19:10 -- host/identify.sh@14 -- # nvmftestinit 00:26:13.655 17:19:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:13.655 17:19:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:13.655 17:19:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:13.655 17:19:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:13.655 17:19:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:13.655 17:19:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:13.655 17:19:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:13.655 17:19:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:13.655 17:19:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:13.655 17:19:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:13.655 17:19:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:13.655 17:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:15.555 17:19:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:15.555 17:19:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:15.555 17:19:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:15.555 17:19:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:15.555 17:19:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:15.555 17:19:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:15.555 17:19:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:15.555 17:19:12 -- nvmf/common.sh@294 -- # net_devs=() 00:26:15.555 17:19:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:15.555 17:19:12 -- nvmf/common.sh@295 -- # e810=() 00:26:15.555 17:19:12 -- nvmf/common.sh@295 -- # local -ga e810 00:26:15.555 17:19:12 -- nvmf/common.sh@296 -- # x722=() 00:26:15.555 17:19:12 -- nvmf/common.sh@296 -- # local -ga x722 00:26:15.555 17:19:12 -- nvmf/common.sh@297 -- # mlx=() 00:26:15.555 17:19:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:15.555 17:19:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:15.555 17:19:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:15.555 17:19:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:15.555 17:19:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:15.555 17:19:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:15.555 17:19:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:15.555 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:15.555 17:19:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:15.555 17:19:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:15.555 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:15.555 17:19:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:15.555 17:19:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:15.555 17:19:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:15.555 17:19:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:15.555 17:19:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:15.555 17:19:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:15.555 17:19:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:15.555 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:15.555 17:19:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:15.555 17:19:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:15.556 17:19:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:15.556 17:19:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:15.556 17:19:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:15.556 17:19:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:15.556 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:15.556 17:19:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:15.556 17:19:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:15.556 17:19:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:15.556 17:19:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:15.556 17:19:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:15.556 17:19:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:15.556 17:19:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:15.556 17:19:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:15.556 17:19:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:15.556 17:19:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:15.556 17:19:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:15.556 17:19:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:15.556 17:19:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:15.556 17:19:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:15.556 17:19:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:15.556 17:19:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:15.556 17:19:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:15.556 17:19:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:15.556 17:19:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:15.556 17:19:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:15.556 17:19:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:15.556 17:19:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:15.556 17:19:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:15.556 17:19:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:15.556 17:19:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:15.556 17:19:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:15.556 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:15.556 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:26:15.556 00:26:15.556 --- 10.0.0.2 ping statistics --- 00:26:15.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.556 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:26:15.556 17:19:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:15.556 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:15.556 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:26:15.556 00:26:15.556 --- 10.0.0.1 ping statistics --- 00:26:15.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.556 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:26:15.556 17:19:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:15.556 17:19:12 -- nvmf/common.sh@410 -- # return 0 00:26:15.556 17:19:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:15.556 17:19:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:15.556 17:19:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:15.556 17:19:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:15.556 17:19:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:15.556 17:19:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:15.556 17:19:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:15.556 17:19:12 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:15.556 17:19:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:15.556 17:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:15.556 17:19:12 -- host/identify.sh@19 -- # nvmfpid=1829833 00:26:15.556 17:19:12 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:15.556 17:19:12 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:15.556 17:19:12 -- host/identify.sh@23 -- # waitforlisten 1829833 00:26:15.556 17:19:12 -- common/autotest_common.sh@829 -- # '[' -z 1829833 ']' 00:26:15.556 17:19:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:15.556 17:19:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:15.556 17:19:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:15.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:15.556 17:19:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:15.556 17:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:15.814 [2024-11-27 17:19:12.537107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:15.814 [2024-11-27 17:19:12.537178] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:15.814 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.814 [2024-11-27 17:19:12.611028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:15.814 [2024-11-27 17:19:12.710004] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:15.814 [2024-11-27 17:19:12.710160] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:15.814 [2024-11-27 17:19:12.710177] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:15.814 [2024-11-27 17:19:12.710189] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:15.814 [2024-11-27 17:19:12.710256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:15.814 [2024-11-27 17:19:12.710283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:15.814 [2024-11-27 17:19:12.710344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:15.814 [2024-11-27 17:19:12.710346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.747 17:19:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:16.747 17:19:13 -- common/autotest_common.sh@862 -- # return 0 00:26:16.747 17:19:13 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 [2024-11-27 17:19:13.597402] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:16.747 17:19:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 17:19:13 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 Malloc0 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 [2024-11-27 17:19:13.668514] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:16.747 17:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.747 17:19:13 -- common/autotest_common.sh@10 -- # set +x 00:26:16.747 [2024-11-27 17:19:13.684285] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:16.747 [ 00:26:16.747 { 00:26:16.747 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:16.747 "subtype": "Discovery", 00:26:16.747 "listen_addresses": [ 00:26:16.747 { 00:26:16.747 "transport": "TCP", 00:26:16.747 "trtype": "TCP", 00:26:16.747 "adrfam": "IPv4", 00:26:16.747 "traddr": "10.0.0.2", 00:26:16.747 "trsvcid": "4420" 00:26:16.747 } 00:26:16.747 ], 00:26:16.747 "allow_any_host": true, 00:26:16.747 "hosts": [] 00:26:16.747 }, 00:26:16.747 { 00:26:16.747 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:16.747 "subtype": "NVMe", 00:26:16.747 "listen_addresses": [ 00:26:16.747 { 00:26:16.747 "transport": "TCP", 00:26:16.747 "trtype": "TCP", 00:26:16.747 "adrfam": "IPv4", 00:26:16.747 "traddr": "10.0.0.2", 00:26:16.747 "trsvcid": "4420" 00:26:16.747 } 00:26:16.747 ], 00:26:16.747 "allow_any_host": true, 00:26:16.747 "hosts": [], 00:26:16.747 "serial_number": "SPDK00000000000001", 00:26:16.747 "model_number": "SPDK bdev Controller", 00:26:16.747 "max_namespaces": 32, 00:26:16.747 "min_cntlid": 1, 00:26:16.747 "max_cntlid": 65519, 00:26:16.747 "namespaces": [ 00:26:16.747 { 00:26:16.747 "nsid": 1, 00:26:16.747 "bdev_name": "Malloc0", 00:26:16.747 "name": "Malloc0", 00:26:16.747 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:16.747 "eui64": "ABCDEF0123456789", 00:26:16.747 "uuid": "d60f2775-378f-49cb-8657-04ca7bca2d7d" 00:26:16.747 } 00:26:16.747 ] 00:26:16.747 } 00:26:16.747 ] 00:26:16.747 17:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.747 17:19:13 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:17.006 [2024-11-27 17:19:13.705549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:17.006 [2024-11-27 17:19:13.705591] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1830003 ] 00:26:17.006 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.006 [2024-11-27 17:19:13.737761] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:17.006 [2024-11-27 17:19:13.737827] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:17.006 [2024-11-27 17:19:13.737838] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:17.006 [2024-11-27 17:19:13.737854] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:17.006 [2024-11-27 17:19:13.737867] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:17.006 [2024-11-27 17:19:13.738104] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:17.006 [2024-11-27 17:19:13.738159] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x20732f0 0 00:26:17.006 [2024-11-27 17:19:13.748539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:17.006 [2024-11-27 17:19:13.748561] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:17.006 [2024-11-27 17:19:13.748570] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:17.006 [2024-11-27 17:19:13.748576] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:17.006 [2024-11-27 17:19:13.748627] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.006 [2024-11-27 17:19:13.748640] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.006 [2024-11-27 17:19:13.748647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.006 [2024-11-27 17:19:13.748666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:17.006 [2024-11-27 17:19:13.748693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.006 [2024-11-27 17:19:13.756541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.006 [2024-11-27 17:19:13.756559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.756570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.756599] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:17.007 [2024-11-27 17:19:13.756610] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:17.007 [2024-11-27 17:19:13.756619] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:17.007 [2024-11-27 17:19:13.756638] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756646] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756652] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.756663] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.756686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.756814] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.756830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.756836] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756843] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.756854] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:17.007 [2024-11-27 17:19:13.756867] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:17.007 [2024-11-27 17:19:13.756879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756886] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.756892] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.756903] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.756924] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.757012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.757024] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.757030] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757036] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.757046] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:17.007 [2024-11-27 17:19:13.757059] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757071] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757077] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757084] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.757094] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.757114] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.757202] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.757213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.757223] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757230] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.757240] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757256] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757265] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757271] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.757281] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.757301] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.757387] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.757398] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.757404] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757411] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.757420] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:17.007 [2024-11-27 17:19:13.757429] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757550] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:17.007 [2024-11-27 17:19:13.757561] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757576] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757583] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757589] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.757600] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.757620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.757713] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.757725] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.757731] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757737] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.757747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:17.007 [2024-11-27 17:19:13.757762] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757770] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757776] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.757786] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.757806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.757896] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.757914] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.757922] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.757928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.757938] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:17.007 [2024-11-27 17:19:13.757946] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:17.007 [2024-11-27 17:19:13.757959] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:17.007 [2024-11-27 17:19:13.757978] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:17.007 [2024-11-27 17:19:13.757993] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.758001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.758007] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.007 [2024-11-27 17:19:13.758018] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.007 [2024-11-27 17:19:13.758039] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.007 [2024-11-27 17:19:13.758198] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.007 [2024-11-27 17:19:13.758226] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.007 [2024-11-27 17:19:13.758233] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.758239] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20732f0): datao=0, datal=4096, cccid=0 00:26:17.007 [2024-11-27 17:19:13.758247] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20cbec0) on tqpair(0x20732f0): expected_datao=0, payload_size=4096 00:26:17.007 [2024-11-27 17:19:13.758265] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.758275] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.798629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.007 [2024-11-27 17:19:13.798647] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.007 [2024-11-27 17:19:13.798654] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.007 [2024-11-27 17:19:13.798661] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.007 [2024-11-27 17:19:13.798674] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:17.007 [2024-11-27 17:19:13.798683] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:17.007 [2024-11-27 17:19:13.798691] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:17.007 [2024-11-27 17:19:13.798699] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:17.007 [2024-11-27 17:19:13.798706] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:17.007 [2024-11-27 17:19:13.798714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:17.008 [2024-11-27 17:19:13.798734] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:17.008 [2024-11-27 17:19:13.798748] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798766] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.798778] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:17.008 [2024-11-27 17:19:13.798802] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.008 [2024-11-27 17:19:13.798901] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.798916] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.798922] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cbec0) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.798943] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798950] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798956] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.798965] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.008 [2024-11-27 17:19:13.798975] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.798988] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.798996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.008 [2024-11-27 17:19:13.799005] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799012] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799017] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.008 [2024-11-27 17:19:13.799035] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799041] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799047] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.008 [2024-11-27 17:19:13.799064] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:17.008 [2024-11-27 17:19:13.799083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:17.008 [2024-11-27 17:19:13.799095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799117] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799124] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799134] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.008 [2024-11-27 17:19:13.799157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cbec0, cid 0, qid 0 00:26:17.008 [2024-11-27 17:19:13.799182] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc020, cid 1, qid 0 00:26:17.008 [2024-11-27 17:19:13.799189] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc180, cid 2, qid 0 00:26:17.008 [2024-11-27 17:19:13.799196] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.008 [2024-11-27 17:19:13.799206] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc440, cid 4, qid 0 00:26:17.008 [2024-11-27 17:19:13.799351] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.799366] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.799373] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799379] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc440) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.799390] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:17.008 [2024-11-27 17:19:13.799398] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:17.008 [2024-11-27 17:19:13.799415] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799425] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.008 [2024-11-27 17:19:13.799462] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc440, cid 4, qid 0 00:26:17.008 [2024-11-27 17:19:13.799577] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.008 [2024-11-27 17:19:13.799591] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.008 [2024-11-27 17:19:13.799598] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799604] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20732f0): datao=0, datal=4096, cccid=4 00:26:17.008 [2024-11-27 17:19:13.799611] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20cc440) on tqpair(0x20732f0): expected_datao=0, payload_size=4096 00:26:17.008 [2024-11-27 17:19:13.799622] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799629] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.799650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.799656] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799662] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc440) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.799681] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:17.008 [2024-11-27 17:19:13.799718] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799735] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.008 [2024-11-27 17:19:13.799756] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799763] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.799769] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.799778] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.008 [2024-11-27 17:19:13.799803] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc440, cid 4, qid 0 00:26:17.008 [2024-11-27 17:19:13.799815] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc5a0, cid 5, qid 0 00:26:17.008 [2024-11-27 17:19:13.799980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.008 [2024-11-27 17:19:13.799999] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.008 [2024-11-27 17:19:13.800006] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.800012] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20732f0): datao=0, datal=1024, cccid=4 00:26:17.008 [2024-11-27 17:19:13.800019] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20cc440) on tqpair(0x20732f0): expected_datao=0, payload_size=1024 00:26:17.008 [2024-11-27 17:19:13.800029] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.800036] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.800045] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.800053] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.800059] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.800065] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc5a0) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.840618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.840636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.840644] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.840650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc440) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.840669] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.840678] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.840684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20732f0) 00:26:17.008 [2024-11-27 17:19:13.840695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.008 [2024-11-27 17:19:13.840726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc440, cid 4, qid 0 00:26:17.008 [2024-11-27 17:19:13.840840] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.008 [2024-11-27 17:19:13.840855] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.008 [2024-11-27 17:19:13.840862] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.840868] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20732f0): datao=0, datal=3072, cccid=4 00:26:17.008 [2024-11-27 17:19:13.840876] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20cc440) on tqpair(0x20732f0): expected_datao=0, payload_size=3072 00:26:17.008 [2024-11-27 17:19:13.840897] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.840907] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.884542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.008 [2024-11-27 17:19:13.884560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.008 [2024-11-27 17:19:13.884567] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.008 [2024-11-27 17:19:13.884589] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc440) on tqpair=0x20732f0 00:26:17.008 [2024-11-27 17:19:13.884606] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.884615] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.884621] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20732f0) 00:26:17.009 [2024-11-27 17:19:13.884633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.009 [2024-11-27 17:19:13.884662] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc440, cid 4, qid 0 00:26:17.009 [2024-11-27 17:19:13.884788] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.009 [2024-11-27 17:19:13.884805] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.009 [2024-11-27 17:19:13.884813] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.884819] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20732f0): datao=0, datal=8, cccid=4 00:26:17.009 [2024-11-27 17:19:13.884826] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20cc440) on tqpair(0x20732f0): expected_datao=0, payload_size=8 00:26:17.009 [2024-11-27 17:19:13.884837] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.884844] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.926624] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.009 [2024-11-27 17:19:13.926643] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.009 [2024-11-27 17:19:13.926650] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.009 [2024-11-27 17:19:13.926657] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc440) on tqpair=0x20732f0 00:26:17.009 ===================================================== 00:26:17.009 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:17.009 ===================================================== 00:26:17.009 Controller Capabilities/Features 00:26:17.009 ================================ 00:26:17.009 Vendor ID: 0000 00:26:17.009 Subsystem Vendor ID: 0000 00:26:17.009 Serial Number: .................... 00:26:17.009 Model Number: ........................................ 00:26:17.009 Firmware Version: 24.01.1 00:26:17.009 Recommended Arb Burst: 0 00:26:17.009 IEEE OUI Identifier: 00 00 00 00:26:17.009 Multi-path I/O 00:26:17.009 May have multiple subsystem ports: No 00:26:17.009 May have multiple controllers: No 00:26:17.009 Associated with SR-IOV VF: No 00:26:17.009 Max Data Transfer Size: 131072 00:26:17.009 Max Number of Namespaces: 0 00:26:17.009 Max Number of I/O Queues: 1024 00:26:17.009 NVMe Specification Version (VS): 1.3 00:26:17.009 NVMe Specification Version (Identify): 1.3 00:26:17.009 Maximum Queue Entries: 128 00:26:17.009 Contiguous Queues Required: Yes 00:26:17.009 Arbitration Mechanisms Supported 00:26:17.009 Weighted Round Robin: Not Supported 00:26:17.009 Vendor Specific: Not Supported 00:26:17.009 Reset Timeout: 15000 ms 00:26:17.009 Doorbell Stride: 4 bytes 00:26:17.009 NVM Subsystem Reset: Not Supported 00:26:17.009 Command Sets Supported 00:26:17.009 NVM Command Set: Supported 00:26:17.009 Boot Partition: Not Supported 00:26:17.009 Memory Page Size Minimum: 4096 bytes 00:26:17.009 Memory Page Size Maximum: 4096 bytes 00:26:17.009 Persistent Memory Region: Not Supported 00:26:17.009 Optional Asynchronous Events Supported 00:26:17.009 Namespace Attribute Notices: Not Supported 00:26:17.009 Firmware Activation Notices: Not Supported 00:26:17.009 ANA Change Notices: Not Supported 00:26:17.009 PLE Aggregate Log Change Notices: Not Supported 00:26:17.009 LBA Status Info Alert Notices: Not Supported 00:26:17.009 EGE Aggregate Log Change Notices: Not Supported 00:26:17.009 Normal NVM Subsystem Shutdown event: Not Supported 00:26:17.009 Zone Descriptor Change Notices: Not Supported 00:26:17.009 Discovery Log Change Notices: Supported 00:26:17.009 Controller Attributes 00:26:17.009 128-bit Host Identifier: Not Supported 00:26:17.009 Non-Operational Permissive Mode: Not Supported 00:26:17.009 NVM Sets: Not Supported 00:26:17.009 Read Recovery Levels: Not Supported 00:26:17.009 Endurance Groups: Not Supported 00:26:17.009 Predictable Latency Mode: Not Supported 00:26:17.009 Traffic Based Keep ALive: Not Supported 00:26:17.009 Namespace Granularity: Not Supported 00:26:17.009 SQ Associations: Not Supported 00:26:17.009 UUID List: Not Supported 00:26:17.009 Multi-Domain Subsystem: Not Supported 00:26:17.009 Fixed Capacity Management: Not Supported 00:26:17.009 Variable Capacity Management: Not Supported 00:26:17.009 Delete Endurance Group: Not Supported 00:26:17.009 Delete NVM Set: Not Supported 00:26:17.009 Extended LBA Formats Supported: Not Supported 00:26:17.009 Flexible Data Placement Supported: Not Supported 00:26:17.009 00:26:17.009 Controller Memory Buffer Support 00:26:17.009 ================================ 00:26:17.009 Supported: No 00:26:17.009 00:26:17.009 Persistent Memory Region Support 00:26:17.009 ================================ 00:26:17.009 Supported: No 00:26:17.009 00:26:17.009 Admin Command Set Attributes 00:26:17.009 ============================ 00:26:17.009 Security Send/Receive: Not Supported 00:26:17.009 Format NVM: Not Supported 00:26:17.009 Firmware Activate/Download: Not Supported 00:26:17.009 Namespace Management: Not Supported 00:26:17.009 Device Self-Test: Not Supported 00:26:17.009 Directives: Not Supported 00:26:17.009 NVMe-MI: Not Supported 00:26:17.009 Virtualization Management: Not Supported 00:26:17.009 Doorbell Buffer Config: Not Supported 00:26:17.009 Get LBA Status Capability: Not Supported 00:26:17.009 Command & Feature Lockdown Capability: Not Supported 00:26:17.009 Abort Command Limit: 1 00:26:17.009 Async Event Request Limit: 4 00:26:17.009 Number of Firmware Slots: N/A 00:26:17.009 Firmware Slot 1 Read-Only: N/A 00:26:17.009 Firmware Activation Without Reset: N/A 00:26:17.009 Multiple Update Detection Support: N/A 00:26:17.009 Firmware Update Granularity: No Information Provided 00:26:17.009 Per-Namespace SMART Log: No 00:26:17.009 Asymmetric Namespace Access Log Page: Not Supported 00:26:17.009 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:17.009 Command Effects Log Page: Not Supported 00:26:17.009 Get Log Page Extended Data: Supported 00:26:17.009 Telemetry Log Pages: Not Supported 00:26:17.009 Persistent Event Log Pages: Not Supported 00:26:17.009 Supported Log Pages Log Page: May Support 00:26:17.009 Commands Supported & Effects Log Page: Not Supported 00:26:17.009 Feature Identifiers & Effects Log Page:May Support 00:26:17.009 NVMe-MI Commands & Effects Log Page: May Support 00:26:17.009 Data Area 4 for Telemetry Log: Not Supported 00:26:17.009 Error Log Page Entries Supported: 128 00:26:17.009 Keep Alive: Not Supported 00:26:17.009 00:26:17.009 NVM Command Set Attributes 00:26:17.009 ========================== 00:26:17.009 Submission Queue Entry Size 00:26:17.009 Max: 1 00:26:17.009 Min: 1 00:26:17.009 Completion Queue Entry Size 00:26:17.009 Max: 1 00:26:17.009 Min: 1 00:26:17.009 Number of Namespaces: 0 00:26:17.009 Compare Command: Not Supported 00:26:17.009 Write Uncorrectable Command: Not Supported 00:26:17.009 Dataset Management Command: Not Supported 00:26:17.009 Write Zeroes Command: Not Supported 00:26:17.009 Set Features Save Field: Not Supported 00:26:17.009 Reservations: Not Supported 00:26:17.009 Timestamp: Not Supported 00:26:17.009 Copy: Not Supported 00:26:17.009 Volatile Write Cache: Not Present 00:26:17.009 Atomic Write Unit (Normal): 1 00:26:17.009 Atomic Write Unit (PFail): 1 00:26:17.009 Atomic Compare & Write Unit: 1 00:26:17.009 Fused Compare & Write: Supported 00:26:17.009 Scatter-Gather List 00:26:17.009 SGL Command Set: Supported 00:26:17.009 SGL Keyed: Supported 00:26:17.009 SGL Bit Bucket Descriptor: Not Supported 00:26:17.009 SGL Metadata Pointer: Not Supported 00:26:17.009 Oversized SGL: Not Supported 00:26:17.009 SGL Metadata Address: Not Supported 00:26:17.009 SGL Offset: Supported 00:26:17.009 Transport SGL Data Block: Not Supported 00:26:17.009 Replay Protected Memory Block: Not Supported 00:26:17.009 00:26:17.009 Firmware Slot Information 00:26:17.009 ========================= 00:26:17.009 Active slot: 0 00:26:17.009 00:26:17.009 00:26:17.009 Error Log 00:26:17.009 ========= 00:26:17.009 00:26:17.009 Active Namespaces 00:26:17.009 ================= 00:26:17.009 Discovery Log Page 00:26:17.009 ================== 00:26:17.009 Generation Counter: 2 00:26:17.009 Number of Records: 2 00:26:17.009 Record Format: 0 00:26:17.009 00:26:17.009 Discovery Log Entry 0 00:26:17.009 ---------------------- 00:26:17.009 Transport Type: 3 (TCP) 00:26:17.009 Address Family: 1 (IPv4) 00:26:17.009 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:17.009 Entry Flags: 00:26:17.009 Duplicate Returned Information: 1 00:26:17.009 Explicit Persistent Connection Support for Discovery: 1 00:26:17.010 Transport Requirements: 00:26:17.010 Secure Channel: Not Required 00:26:17.010 Port ID: 0 (0x0000) 00:26:17.010 Controller ID: 65535 (0xffff) 00:26:17.010 Admin Max SQ Size: 128 00:26:17.010 Transport Service Identifier: 4420 00:26:17.010 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:17.010 Transport Address: 10.0.0.2 00:26:17.010 Discovery Log Entry 1 00:26:17.010 ---------------------- 00:26:17.010 Transport Type: 3 (TCP) 00:26:17.010 Address Family: 1 (IPv4) 00:26:17.010 Subsystem Type: 2 (NVM Subsystem) 00:26:17.010 Entry Flags: 00:26:17.010 Duplicate Returned Information: 0 00:26:17.010 Explicit Persistent Connection Support for Discovery: 0 00:26:17.010 Transport Requirements: 00:26:17.010 Secure Channel: Not Required 00:26:17.010 Port ID: 0 (0x0000) 00:26:17.010 Controller ID: 65535 (0xffff) 00:26:17.010 Admin Max SQ Size: 128 00:26:17.010 Transport Service Identifier: 4420 00:26:17.010 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:17.010 Transport Address: 10.0.0.2 [2024-11-27 17:19:13.926775] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:17.010 [2024-11-27 17:19:13.926802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.010 [2024-11-27 17:19:13.926814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.010 [2024-11-27 17:19:13.926823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.010 [2024-11-27 17:19:13.926833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.010 [2024-11-27 17:19:13.926848] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.926856] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.926862] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.926873] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.926915] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.927013] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.927028] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.927035] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927041] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.927055] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927062] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927068] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.927078] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.927104] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.927233] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.927245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.927251] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927257] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.927267] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:17.010 [2024-11-27 17:19:13.927275] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:17.010 [2024-11-27 17:19:13.927295] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927310] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.927320] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.927340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.927449] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.927463] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.927469] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927476] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.927494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927503] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927509] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.927519] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.927550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.927639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.927651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.927657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927663] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.927680] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927688] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927695] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.927705] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.927724] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.927827] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.927842] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.927848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927855] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.927872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927881] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.927887] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.927897] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.927917] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.928000] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.928012] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.928019] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.928045] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928055] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928061] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.928071] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.928090] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.928193] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.928205] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.928211] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928217] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.928234] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928243] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928249] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.928259] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.928278] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.928367] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.928381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.928388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928394] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.010 [2024-11-27 17:19:13.928411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928420] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.928426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.010 [2024-11-27 17:19:13.928436] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.010 [2024-11-27 17:19:13.928456] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.010 [2024-11-27 17:19:13.932552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.010 [2024-11-27 17:19:13.932568] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.010 [2024-11-27 17:19:13.932575] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.010 [2024-11-27 17:19:13.932581] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.011 [2024-11-27 17:19:13.932600] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.011 [2024-11-27 17:19:13.932608] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.011 [2024-11-27 17:19:13.932614] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20732f0) 00:26:17.011 [2024-11-27 17:19:13.932624] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.011 [2024-11-27 17:19:13.932646] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20cc2e0, cid 3, qid 0 00:26:17.011 [2024-11-27 17:19:13.932766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.011 [2024-11-27 17:19:13.932778] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.011 [2024-11-27 17:19:13.932785] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.011 [2024-11-27 17:19:13.932791] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20cc2e0) on tqpair=0x20732f0 00:26:17.011 [2024-11-27 17:19:13.932805] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:26:17.011 00:26:17.011 17:19:13 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:17.272 [2024-11-27 17:19:13.962398] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:17.272 [2024-11-27 17:19:13.962437] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1830005 ] 00:26:17.272 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.272 [2024-11-27 17:19:13.994255] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:17.272 [2024-11-27 17:19:13.994304] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:17.272 [2024-11-27 17:19:13.994314] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:17.272 [2024-11-27 17:19:13.994327] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:17.272 [2024-11-27 17:19:13.994338] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:17.272 [2024-11-27 17:19:13.994550] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:17.272 [2024-11-27 17:19:13.994593] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x7812f0 0 00:26:17.272 [2024-11-27 17:19:14.007552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:17.272 [2024-11-27 17:19:14.007572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:17.272 [2024-11-27 17:19:14.007580] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:17.272 [2024-11-27 17:19:14.007586] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:17.272 [2024-11-27 17:19:14.007638] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.007650] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.007657] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.007670] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:17.272 [2024-11-27 17:19:14.007697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.015558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.015575] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.015583] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015589] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.015603] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:17.272 [2024-11-27 17:19:14.015613] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:17.272 [2024-11-27 17:19:14.015622] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:17.272 [2024-11-27 17:19:14.015639] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015648] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015654] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.015665] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.015693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.015813] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.015826] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.015832] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015839] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.015847] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:17.272 [2024-11-27 17:19:14.015860] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:17.272 [2024-11-27 17:19:14.015872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.015885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.015895] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.015916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.016003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.016017] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.016024] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016030] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.016039] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:17.272 [2024-11-27 17:19:14.016053] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016065] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016072] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016078] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.016089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.016110] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.016197] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.016211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.016218] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.016233] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016250] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016258] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016264] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.016275] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.016295] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.016382] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.016397] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.016407] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016415] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.016422] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:17.272 [2024-11-27 17:19:14.016430] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016444] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016553] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:17.272 [2024-11-27 17:19:14.016563] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016575] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016582] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016588] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.016598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.016620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.016740] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.016755] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.016762] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016768] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.272 [2024-11-27 17:19:14.016776] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:17.272 [2024-11-27 17:19:14.016792] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016801] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016807] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.272 [2024-11-27 17:19:14.016817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.272 [2024-11-27 17:19:14.016837] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.272 [2024-11-27 17:19:14.016924] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.272 [2024-11-27 17:19:14.016938] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.272 [2024-11-27 17:19:14.016945] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.272 [2024-11-27 17:19:14.016951] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.273 [2024-11-27 17:19:14.016959] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:17.273 [2024-11-27 17:19:14.016967] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.016980] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:17.273 [2024-11-27 17:19:14.016997] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017011] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017039] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.273 [2024-11-27 17:19:14.017061] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.273 [2024-11-27 17:19:14.017182] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.273 [2024-11-27 17:19:14.017194] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.273 [2024-11-27 17:19:14.017201] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017207] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=4096, cccid=0 00:26:17.273 [2024-11-27 17:19:14.017214] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7d9ec0) on tqpair(0x7812f0): expected_datao=0, payload_size=4096 00:26:17.273 [2024-11-27 17:19:14.017225] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017233] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.273 [2024-11-27 17:19:14.017254] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.273 [2024-11-27 17:19:14.017261] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017267] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.273 [2024-11-27 17:19:14.017278] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:17.273 [2024-11-27 17:19:14.017286] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:17.273 [2024-11-27 17:19:14.017294] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:17.273 [2024-11-27 17:19:14.017300] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:17.273 [2024-11-27 17:19:14.017307] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:17.273 [2024-11-27 17:19:14.017315] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017347] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017360] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017371] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:17.273 [2024-11-27 17:19:14.017392] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.273 [2024-11-27 17:19:14.017486] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.273 [2024-11-27 17:19:14.017500] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.273 [2024-11-27 17:19:14.017507] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017513] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7d9ec0) on tqpair=0x7812f0 00:26:17.273 [2024-11-27 17:19:14.017523] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017539] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017545] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.273 [2024-11-27 17:19:14.017569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.273 [2024-11-27 17:19:14.017601] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017607] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017613] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.273 [2024-11-27 17:19:14.017631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.273 [2024-11-27 17:19:14.017660] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017678] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017690] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017697] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017703] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.017713] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.273 [2024-11-27 17:19:14.017736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7d9ec0, cid 0, qid 0 00:26:17.273 [2024-11-27 17:19:14.017747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da020, cid 1, qid 0 00:26:17.273 [2024-11-27 17:19:14.017754] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da180, cid 2, qid 0 00:26:17.273 [2024-11-27 17:19:14.017762] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.273 [2024-11-27 17:19:14.017769] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.273 [2024-11-27 17:19:14.017912] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.273 [2024-11-27 17:19:14.017924] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.273 [2024-11-27 17:19:14.017931] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.017937] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.273 [2024-11-27 17:19:14.017945] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:17.273 [2024-11-27 17:19:14.017953] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017967] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017982] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.017994] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.018021] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:17.273 [2024-11-27 17:19:14.018041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.273 [2024-11-27 17:19:14.018161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.273 [2024-11-27 17:19:14.018176] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.273 [2024-11-27 17:19:14.018183] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018189] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.273 [2024-11-27 17:19:14.018254] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.018271] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:17.273 [2024-11-27 17:19:14.018285] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018292] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018298] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.273 [2024-11-27 17:19:14.018308] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.273 [2024-11-27 17:19:14.018329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.273 [2024-11-27 17:19:14.018442] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.273 [2024-11-27 17:19:14.018456] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.273 [2024-11-27 17:19:14.018463] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018469] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=4096, cccid=4 00:26:17.273 [2024-11-27 17:19:14.018476] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da440) on tqpair(0x7812f0): expected_datao=0, payload_size=4096 00:26:17.273 [2024-11-27 17:19:14.018497] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018517] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018559] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.273 [2024-11-27 17:19:14.018574] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.273 [2024-11-27 17:19:14.018580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.273 [2024-11-27 17:19:14.018587] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.018607] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:17.274 [2024-11-27 17:19:14.018623] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.018640] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.018653] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018660] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018666] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.018676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.018698] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.274 [2024-11-27 17:19:14.018803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.274 [2024-11-27 17:19:14.018818] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.274 [2024-11-27 17:19:14.018826] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018832] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=4096, cccid=4 00:26:17.274 [2024-11-27 17:19:14.018839] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da440) on tqpair(0x7812f0): expected_datao=0, payload_size=4096 00:26:17.274 [2024-11-27 17:19:14.018856] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018865] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018880] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.018890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.018897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.018926] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.018945] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.018958] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018966] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.018972] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.018982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.019003] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.274 [2024-11-27 17:19:14.019119] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.274 [2024-11-27 17:19:14.019134] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.274 [2024-11-27 17:19:14.019141] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019148] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=4096, cccid=4 00:26:17.274 [2024-11-27 17:19:14.019155] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da440) on tqpair(0x7812f0): expected_datao=0, payload_size=4096 00:26:17.274 [2024-11-27 17:19:14.019166] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019173] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019185] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.019194] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.019201] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019207] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.019220] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019234] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019250] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019261] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019270] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019281] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:17.274 [2024-11-27 17:19:14.019290] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:17.274 [2024-11-27 17:19:14.019298] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:17.274 [2024-11-27 17:19:14.019316] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019324] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019331] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.019341] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.019351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019358] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.019364] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.019373] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:17.274 [2024-11-27 17:19:14.019397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.274 [2024-11-27 17:19:14.019409] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da5a0, cid 5, qid 0 00:26:17.274 [2024-11-27 17:19:14.023555] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.023571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.023578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023585] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.023596] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.023605] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.023611] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023617] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da5a0) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.023634] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023643] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023649] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.023659] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.023681] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da5a0, cid 5, qid 0 00:26:17.274 [2024-11-27 17:19:14.023783] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.023795] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.023802] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023808] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da5a0) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.023823] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023831] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023838] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.023847] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.023867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da5a0, cid 5, qid 0 00:26:17.274 [2024-11-27 17:19:14.023955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.023969] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.023976] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.023983] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da5a0) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.023998] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024007] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024013] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.024023] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.024042] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da5a0, cid 5, qid 0 00:26:17.274 [2024-11-27 17:19:14.024129] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.274 [2024-11-27 17:19:14.024143] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.274 [2024-11-27 17:19:14.024150] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024156] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da5a0) on tqpair=0x7812f0 00:26:17.274 [2024-11-27 17:19:14.024175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024184] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024190] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.024201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.024212] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7812f0) 00:26:17.274 [2024-11-27 17:19:14.024234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.274 [2024-11-27 17:19:14.024245] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024252] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.274 [2024-11-27 17:19:14.024258] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x7812f0) 00:26:17.275 [2024-11-27 17:19:14.024267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.275 [2024-11-27 17:19:14.024278] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024285] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024291] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x7812f0) 00:26:17.275 [2024-11-27 17:19:14.024300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.275 [2024-11-27 17:19:14.024321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da5a0, cid 5, qid 0 00:26:17.275 [2024-11-27 17:19:14.024332] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da440, cid 4, qid 0 00:26:17.275 [2024-11-27 17:19:14.024339] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da700, cid 6, qid 0 00:26:17.275 [2024-11-27 17:19:14.024346] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da860, cid 7, qid 0 00:26:17.275 [2024-11-27 17:19:14.024574] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.275 [2024-11-27 17:19:14.024593] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.275 [2024-11-27 17:19:14.024601] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024607] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=8192, cccid=5 00:26:17.275 [2024-11-27 17:19:14.024614] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da5a0) on tqpair(0x7812f0): expected_datao=0, payload_size=8192 00:26:17.275 [2024-11-27 17:19:14.024625] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024633] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.275 [2024-11-27 17:19:14.024650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.275 [2024-11-27 17:19:14.024656] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024662] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=512, cccid=4 00:26:17.275 [2024-11-27 17:19:14.024669] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da440) on tqpair(0x7812f0): expected_datao=0, payload_size=512 00:26:17.275 [2024-11-27 17:19:14.024679] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024686] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024694] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.275 [2024-11-27 17:19:14.024703] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.275 [2024-11-27 17:19:14.024709] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024715] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=512, cccid=6 00:26:17.275 [2024-11-27 17:19:14.024722] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da700) on tqpair(0x7812f0): expected_datao=0, payload_size=512 00:26:17.275 [2024-11-27 17:19:14.024732] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024739] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:17.275 [2024-11-27 17:19:14.024755] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:17.275 [2024-11-27 17:19:14.024761] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024767] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7812f0): datao=0, datal=4096, cccid=7 00:26:17.275 [2024-11-27 17:19:14.024775] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x7da860) on tqpair(0x7812f0): expected_datao=0, payload_size=4096 00:26:17.275 [2024-11-27 17:19:14.024785] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024792] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.275 [2024-11-27 17:19:14.024813] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.275 [2024-11-27 17:19:14.024819] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024826] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da5a0) on tqpair=0x7812f0 00:26:17.275 [2024-11-27 17:19:14.024845] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.275 [2024-11-27 17:19:14.024856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.275 [2024-11-27 17:19:14.024863] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024869] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da440) on tqpair=0x7812f0 00:26:17.275 [2024-11-27 17:19:14.024898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.275 [2024-11-27 17:19:14.024908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.275 [2024-11-27 17:19:14.024915] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024921] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da700) on tqpair=0x7812f0 00:26:17.275 [2024-11-27 17:19:14.024934] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.275 [2024-11-27 17:19:14.024958] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.275 [2024-11-27 17:19:14.024964] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.275 [2024-11-27 17:19:14.024970] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da860) on tqpair=0x7812f0 00:26:17.275 ===================================================== 00:26:17.275 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:17.275 ===================================================== 00:26:17.275 Controller Capabilities/Features 00:26:17.275 ================================ 00:26:17.275 Vendor ID: 8086 00:26:17.275 Subsystem Vendor ID: 8086 00:26:17.275 Serial Number: SPDK00000000000001 00:26:17.275 Model Number: SPDK bdev Controller 00:26:17.275 Firmware Version: 24.01.1 00:26:17.275 Recommended Arb Burst: 6 00:26:17.275 IEEE OUI Identifier: e4 d2 5c 00:26:17.275 Multi-path I/O 00:26:17.275 May have multiple subsystem ports: Yes 00:26:17.275 May have multiple controllers: Yes 00:26:17.275 Associated with SR-IOV VF: No 00:26:17.275 Max Data Transfer Size: 131072 00:26:17.275 Max Number of Namespaces: 32 00:26:17.275 Max Number of I/O Queues: 127 00:26:17.275 NVMe Specification Version (VS): 1.3 00:26:17.275 NVMe Specification Version (Identify): 1.3 00:26:17.275 Maximum Queue Entries: 128 00:26:17.275 Contiguous Queues Required: Yes 00:26:17.275 Arbitration Mechanisms Supported 00:26:17.275 Weighted Round Robin: Not Supported 00:26:17.275 Vendor Specific: Not Supported 00:26:17.275 Reset Timeout: 15000 ms 00:26:17.275 Doorbell Stride: 4 bytes 00:26:17.275 NVM Subsystem Reset: Not Supported 00:26:17.275 Command Sets Supported 00:26:17.275 NVM Command Set: Supported 00:26:17.275 Boot Partition: Not Supported 00:26:17.275 Memory Page Size Minimum: 4096 bytes 00:26:17.275 Memory Page Size Maximum: 4096 bytes 00:26:17.275 Persistent Memory Region: Not Supported 00:26:17.275 Optional Asynchronous Events Supported 00:26:17.275 Namespace Attribute Notices: Supported 00:26:17.275 Firmware Activation Notices: Not Supported 00:26:17.275 ANA Change Notices: Not Supported 00:26:17.275 PLE Aggregate Log Change Notices: Not Supported 00:26:17.275 LBA Status Info Alert Notices: Not Supported 00:26:17.275 EGE Aggregate Log Change Notices: Not Supported 00:26:17.275 Normal NVM Subsystem Shutdown event: Not Supported 00:26:17.275 Zone Descriptor Change Notices: Not Supported 00:26:17.275 Discovery Log Change Notices: Not Supported 00:26:17.275 Controller Attributes 00:26:17.275 128-bit Host Identifier: Supported 00:26:17.275 Non-Operational Permissive Mode: Not Supported 00:26:17.275 NVM Sets: Not Supported 00:26:17.275 Read Recovery Levels: Not Supported 00:26:17.275 Endurance Groups: Not Supported 00:26:17.275 Predictable Latency Mode: Not Supported 00:26:17.275 Traffic Based Keep ALive: Not Supported 00:26:17.275 Namespace Granularity: Not Supported 00:26:17.275 SQ Associations: Not Supported 00:26:17.275 UUID List: Not Supported 00:26:17.275 Multi-Domain Subsystem: Not Supported 00:26:17.275 Fixed Capacity Management: Not Supported 00:26:17.275 Variable Capacity Management: Not Supported 00:26:17.275 Delete Endurance Group: Not Supported 00:26:17.275 Delete NVM Set: Not Supported 00:26:17.275 Extended LBA Formats Supported: Not Supported 00:26:17.275 Flexible Data Placement Supported: Not Supported 00:26:17.275 00:26:17.275 Controller Memory Buffer Support 00:26:17.275 ================================ 00:26:17.275 Supported: No 00:26:17.275 00:26:17.275 Persistent Memory Region Support 00:26:17.275 ================================ 00:26:17.275 Supported: No 00:26:17.275 00:26:17.275 Admin Command Set Attributes 00:26:17.275 ============================ 00:26:17.275 Security Send/Receive: Not Supported 00:26:17.275 Format NVM: Not Supported 00:26:17.275 Firmware Activate/Download: Not Supported 00:26:17.275 Namespace Management: Not Supported 00:26:17.275 Device Self-Test: Not Supported 00:26:17.275 Directives: Not Supported 00:26:17.275 NVMe-MI: Not Supported 00:26:17.275 Virtualization Management: Not Supported 00:26:17.275 Doorbell Buffer Config: Not Supported 00:26:17.275 Get LBA Status Capability: Not Supported 00:26:17.275 Command & Feature Lockdown Capability: Not Supported 00:26:17.275 Abort Command Limit: 4 00:26:17.275 Async Event Request Limit: 4 00:26:17.275 Number of Firmware Slots: N/A 00:26:17.275 Firmware Slot 1 Read-Only: N/A 00:26:17.275 Firmware Activation Without Reset: N/A 00:26:17.275 Multiple Update Detection Support: N/A 00:26:17.275 Firmware Update Granularity: No Information Provided 00:26:17.275 Per-Namespace SMART Log: No 00:26:17.275 Asymmetric Namespace Access Log Page: Not Supported 00:26:17.275 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:17.275 Command Effects Log Page: Supported 00:26:17.275 Get Log Page Extended Data: Supported 00:26:17.276 Telemetry Log Pages: Not Supported 00:26:17.276 Persistent Event Log Pages: Not Supported 00:26:17.276 Supported Log Pages Log Page: May Support 00:26:17.276 Commands Supported & Effects Log Page: Not Supported 00:26:17.276 Feature Identifiers & Effects Log Page:May Support 00:26:17.276 NVMe-MI Commands & Effects Log Page: May Support 00:26:17.276 Data Area 4 for Telemetry Log: Not Supported 00:26:17.276 Error Log Page Entries Supported: 128 00:26:17.276 Keep Alive: Supported 00:26:17.276 Keep Alive Granularity: 10000 ms 00:26:17.276 00:26:17.276 NVM Command Set Attributes 00:26:17.276 ========================== 00:26:17.276 Submission Queue Entry Size 00:26:17.276 Max: 64 00:26:17.276 Min: 64 00:26:17.276 Completion Queue Entry Size 00:26:17.276 Max: 16 00:26:17.276 Min: 16 00:26:17.276 Number of Namespaces: 32 00:26:17.276 Compare Command: Supported 00:26:17.276 Write Uncorrectable Command: Not Supported 00:26:17.276 Dataset Management Command: Supported 00:26:17.276 Write Zeroes Command: Supported 00:26:17.276 Set Features Save Field: Not Supported 00:26:17.276 Reservations: Supported 00:26:17.276 Timestamp: Not Supported 00:26:17.276 Copy: Supported 00:26:17.276 Volatile Write Cache: Present 00:26:17.276 Atomic Write Unit (Normal): 1 00:26:17.276 Atomic Write Unit (PFail): 1 00:26:17.276 Atomic Compare & Write Unit: 1 00:26:17.276 Fused Compare & Write: Supported 00:26:17.276 Scatter-Gather List 00:26:17.276 SGL Command Set: Supported 00:26:17.276 SGL Keyed: Supported 00:26:17.276 SGL Bit Bucket Descriptor: Not Supported 00:26:17.276 SGL Metadata Pointer: Not Supported 00:26:17.276 Oversized SGL: Not Supported 00:26:17.276 SGL Metadata Address: Not Supported 00:26:17.276 SGL Offset: Supported 00:26:17.276 Transport SGL Data Block: Not Supported 00:26:17.276 Replay Protected Memory Block: Not Supported 00:26:17.276 00:26:17.276 Firmware Slot Information 00:26:17.276 ========================= 00:26:17.276 Active slot: 1 00:26:17.276 Slot 1 Firmware Revision: 24.01.1 00:26:17.276 00:26:17.276 00:26:17.276 Commands Supported and Effects 00:26:17.276 ============================== 00:26:17.276 Admin Commands 00:26:17.276 -------------- 00:26:17.276 Get Log Page (02h): Supported 00:26:17.276 Identify (06h): Supported 00:26:17.276 Abort (08h): Supported 00:26:17.276 Set Features (09h): Supported 00:26:17.276 Get Features (0Ah): Supported 00:26:17.276 Asynchronous Event Request (0Ch): Supported 00:26:17.276 Keep Alive (18h): Supported 00:26:17.276 I/O Commands 00:26:17.276 ------------ 00:26:17.276 Flush (00h): Supported LBA-Change 00:26:17.276 Write (01h): Supported LBA-Change 00:26:17.276 Read (02h): Supported 00:26:17.276 Compare (05h): Supported 00:26:17.276 Write Zeroes (08h): Supported LBA-Change 00:26:17.276 Dataset Management (09h): Supported LBA-Change 00:26:17.276 Copy (19h): Supported LBA-Change 00:26:17.276 Unknown (79h): Supported LBA-Change 00:26:17.276 Unknown (7Ah): Supported 00:26:17.276 00:26:17.276 Error Log 00:26:17.276 ========= 00:26:17.276 00:26:17.276 Arbitration 00:26:17.276 =========== 00:26:17.276 Arbitration Burst: 1 00:26:17.276 00:26:17.276 Power Management 00:26:17.276 ================ 00:26:17.276 Number of Power States: 1 00:26:17.276 Current Power State: Power State #0 00:26:17.276 Power State #0: 00:26:17.276 Max Power: 0.00 W 00:26:17.276 Non-Operational State: Operational 00:26:17.276 Entry Latency: Not Reported 00:26:17.276 Exit Latency: Not Reported 00:26:17.276 Relative Read Throughput: 0 00:26:17.276 Relative Read Latency: 0 00:26:17.276 Relative Write Throughput: 0 00:26:17.276 Relative Write Latency: 0 00:26:17.276 Idle Power: Not Reported 00:26:17.276 Active Power: Not Reported 00:26:17.276 Non-Operational Permissive Mode: Not Supported 00:26:17.276 00:26:17.276 Health Information 00:26:17.276 ================== 00:26:17.276 Critical Warnings: 00:26:17.276 Available Spare Space: OK 00:26:17.276 Temperature: OK 00:26:17.276 Device Reliability: OK 00:26:17.276 Read Only: No 00:26:17.276 Volatile Memory Backup: OK 00:26:17.276 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:17.276 Temperature Threshold: [2024-11-27 17:19:14.025102] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025114] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025120] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x7812f0) 00:26:17.276 [2024-11-27 17:19:14.025131] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.276 [2024-11-27 17:19:14.025152] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da860, cid 7, qid 0 00:26:17.276 [2024-11-27 17:19:14.025291] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.276 [2024-11-27 17:19:14.025304] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.276 [2024-11-27 17:19:14.025311] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025317] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da860) on tqpair=0x7812f0 00:26:17.276 [2024-11-27 17:19:14.025356] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:17.276 [2024-11-27 17:19:14.025377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.276 [2024-11-27 17:19:14.025389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.276 [2024-11-27 17:19:14.025398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.276 [2024-11-27 17:19:14.025407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:17.276 [2024-11-27 17:19:14.025419] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025427] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025433] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.276 [2024-11-27 17:19:14.025443] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.276 [2024-11-27 17:19:14.025465] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.276 [2024-11-27 17:19:14.025586] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.276 [2024-11-27 17:19:14.025600] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.276 [2024-11-27 17:19:14.025607] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025613] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.276 [2024-11-27 17:19:14.025624] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025638] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.276 [2024-11-27 17:19:14.025648] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.276 [2024-11-27 17:19:14.025673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.276 [2024-11-27 17:19:14.025767] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.276 [2024-11-27 17:19:14.025779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.276 [2024-11-27 17:19:14.025789] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025796] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.276 [2024-11-27 17:19:14.025804] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:17.276 [2024-11-27 17:19:14.025811] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:17.276 [2024-11-27 17:19:14.025827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025835] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.276 [2024-11-27 17:19:14.025841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.025851] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.025871] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.025963] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.025978] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.025984] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.025991] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026007] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026022] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026132] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.026144] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.026150] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026157] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026172] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026181] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026187] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026197] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026216] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026293] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.026305] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.026311] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026333] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026341] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026358] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026377] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026465] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.026483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.026490] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026512] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026521] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026536] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026546] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026567] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.026670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.026677] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026683] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026700] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026708] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026714] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026745] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026825] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.026836] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.026843] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026849] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.026865] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026873] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.026879] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.026890] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.026909] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.026988] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.027000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.027007] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027013] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.027028] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027037] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027043] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.027053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.027072] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.027150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.027161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.027171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027178] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.027194] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027203] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.027219] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.027238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.027322] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.027333] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.027340] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.027362] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027370] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027376] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.027386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.027405] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.027485] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.027496] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.027503] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.027509] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.031546] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.031561] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.031567] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7812f0) 00:26:17.277 [2024-11-27 17:19:14.031578] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:17.277 [2024-11-27 17:19:14.031599] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7da2e0, cid 3, qid 0 00:26:17.277 [2024-11-27 17:19:14.031735] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:17.277 [2024-11-27 17:19:14.031748] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:17.277 [2024-11-27 17:19:14.031755] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:17.277 [2024-11-27 17:19:14.031761] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7da2e0) on tqpair=0x7812f0 00:26:17.277 [2024-11-27 17:19:14.031774] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:26:17.277 0 Kelvin (-273 Celsius) 00:26:17.277 Available Spare: 0% 00:26:17.277 Available Spare Threshold: 0% 00:26:17.277 Life Percentage Used: 0% 00:26:17.277 Data Units Read: 0 00:26:17.277 Data Units Written: 0 00:26:17.277 Host Read Commands: 0 00:26:17.277 Host Write Commands: 0 00:26:17.277 Controller Busy Time: 0 minutes 00:26:17.277 Power Cycles: 0 00:26:17.277 Power On Hours: 0 hours 00:26:17.277 Unsafe Shutdowns: 0 00:26:17.277 Unrecoverable Media Errors: 0 00:26:17.277 Lifetime Error Log Entries: 0 00:26:17.277 Warning Temperature Time: 0 minutes 00:26:17.277 Critical Temperature Time: 0 minutes 00:26:17.277 00:26:17.277 Number of Queues 00:26:17.277 ================ 00:26:17.277 Number of I/O Submission Queues: 127 00:26:17.278 Number of I/O Completion Queues: 127 00:26:17.278 00:26:17.278 Active Namespaces 00:26:17.278 ================= 00:26:17.278 Namespace ID:1 00:26:17.278 Error Recovery Timeout: Unlimited 00:26:17.278 Command Set Identifier: NVM (00h) 00:26:17.278 Deallocate: Supported 00:26:17.278 Deallocated/Unwritten Error: Not Supported 00:26:17.278 Deallocated Read Value: Unknown 00:26:17.278 Deallocate in Write Zeroes: Not Supported 00:26:17.278 Deallocated Guard Field: 0xFFFF 00:26:17.278 Flush: Supported 00:26:17.278 Reservation: Supported 00:26:17.278 Namespace Sharing Capabilities: Multiple Controllers 00:26:17.278 Size (in LBAs): 131072 (0GiB) 00:26:17.278 Capacity (in LBAs): 131072 (0GiB) 00:26:17.278 Utilization (in LBAs): 131072 (0GiB) 00:26:17.278 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:17.278 EUI64: ABCDEF0123456789 00:26:17.278 UUID: d60f2775-378f-49cb-8657-04ca7bca2d7d 00:26:17.278 Thin Provisioning: Not Supported 00:26:17.278 Per-NS Atomic Units: Yes 00:26:17.278 Atomic Boundary Size (Normal): 0 00:26:17.278 Atomic Boundary Size (PFail): 0 00:26:17.278 Atomic Boundary Offset: 0 00:26:17.278 Maximum Single Source Range Length: 65535 00:26:17.278 Maximum Copy Length: 65535 00:26:17.278 Maximum Source Range Count: 1 00:26:17.278 NGUID/EUI64 Never Reused: No 00:26:17.278 Namespace Write Protected: No 00:26:17.278 Number of LBA Formats: 1 00:26:17.278 Current LBA Format: LBA Format #00 00:26:17.278 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:17.278 00:26:17.278 17:19:14 -- host/identify.sh@51 -- # sync 00:26:17.278 17:19:14 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:17.278 17:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.278 17:19:14 -- common/autotest_common.sh@10 -- # set +x 00:26:17.278 17:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.278 17:19:14 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:17.278 17:19:14 -- host/identify.sh@56 -- # nvmftestfini 00:26:17.278 17:19:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:17.278 17:19:14 -- nvmf/common.sh@116 -- # sync 00:26:17.278 17:19:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:17.278 17:19:14 -- nvmf/common.sh@119 -- # set +e 00:26:17.278 17:19:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:17.278 17:19:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:17.278 rmmod nvme_tcp 00:26:17.278 rmmod nvme_fabrics 00:26:17.278 rmmod nvme_keyring 00:26:17.278 17:19:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:17.278 17:19:14 -- nvmf/common.sh@123 -- # set -e 00:26:17.278 17:19:14 -- nvmf/common.sh@124 -- # return 0 00:26:17.278 17:19:14 -- nvmf/common.sh@477 -- # '[' -n 1829833 ']' 00:26:17.278 17:19:14 -- nvmf/common.sh@478 -- # killprocess 1829833 00:26:17.278 17:19:14 -- common/autotest_common.sh@936 -- # '[' -z 1829833 ']' 00:26:17.278 17:19:14 -- common/autotest_common.sh@940 -- # kill -0 1829833 00:26:17.278 17:19:14 -- common/autotest_common.sh@941 -- # uname 00:26:17.278 17:19:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:17.278 17:19:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1829833 00:26:17.278 17:19:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:17.278 17:19:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:17.278 17:19:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1829833' 00:26:17.278 killing process with pid 1829833 00:26:17.278 17:19:14 -- common/autotest_common.sh@955 -- # kill 1829833 00:26:17.278 [2024-11-27 17:19:14.133655] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:17.278 17:19:14 -- common/autotest_common.sh@960 -- # wait 1829833 00:26:17.536 17:19:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:17.536 17:19:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:17.536 17:19:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:17.536 17:19:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:17.536 17:19:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:17.536 17:19:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:17.536 17:19:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:17.536 17:19:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:20.067 17:19:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:20.067 00:26:20.067 real 0m6.137s 00:26:20.067 user 0m7.592s 00:26:20.067 sys 0m1.893s 00:26:20.067 17:19:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:20.067 17:19:16 -- common/autotest_common.sh@10 -- # set +x 00:26:20.067 ************************************ 00:26:20.067 END TEST nvmf_identify 00:26:20.067 ************************************ 00:26:20.067 17:19:16 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:20.067 17:19:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:20.067 17:19:16 -- common/autotest_common.sh@10 -- # set +x 00:26:20.067 ************************************ 00:26:20.067 START TEST nvmf_perf 00:26:20.067 ************************************ 00:26:20.067 17:19:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:20.067 * Looking for test storage... 00:26:20.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:20.067 17:19:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:20.067 17:19:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:20.067 17:19:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:20.067 17:19:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:20.067 17:19:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:20.067 17:19:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:20.067 17:19:16 -- scripts/common.sh@335 -- # IFS=.-: 00:26:20.067 17:19:16 -- scripts/common.sh@335 -- # read -ra ver1 00:26:20.067 17:19:16 -- scripts/common.sh@336 -- # IFS=.-: 00:26:20.067 17:19:16 -- scripts/common.sh@336 -- # read -ra ver2 00:26:20.067 17:19:16 -- scripts/common.sh@337 -- # local 'op=<' 00:26:20.067 17:19:16 -- scripts/common.sh@339 -- # ver1_l=2 00:26:20.067 17:19:16 -- scripts/common.sh@340 -- # ver2_l=1 00:26:20.067 17:19:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:20.067 17:19:16 -- scripts/common.sh@343 -- # case "$op" in 00:26:20.067 17:19:16 -- scripts/common.sh@344 -- # : 1 00:26:20.067 17:19:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:20.067 17:19:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:20.067 17:19:16 -- scripts/common.sh@364 -- # decimal 1 00:26:20.067 17:19:16 -- scripts/common.sh@352 -- # local d=1 00:26:20.067 17:19:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:20.067 17:19:16 -- scripts/common.sh@354 -- # echo 1 00:26:20.067 17:19:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:20.067 17:19:16 -- scripts/common.sh@365 -- # decimal 2 00:26:20.067 17:19:16 -- scripts/common.sh@352 -- # local d=2 00:26:20.067 17:19:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:20.067 17:19:16 -- scripts/common.sh@354 -- # echo 2 00:26:20.067 17:19:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:20.067 17:19:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:20.067 17:19:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:20.067 17:19:16 -- scripts/common.sh@367 -- # return 0 00:26:20.067 17:19:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.067 --rc genhtml_branch_coverage=1 00:26:20.067 --rc genhtml_function_coverage=1 00:26:20.067 --rc genhtml_legend=1 00:26:20.067 --rc geninfo_all_blocks=1 00:26:20.067 --rc geninfo_unexecuted_blocks=1 00:26:20.067 00:26:20.067 ' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.067 --rc genhtml_branch_coverage=1 00:26:20.067 --rc genhtml_function_coverage=1 00:26:20.067 --rc genhtml_legend=1 00:26:20.067 --rc geninfo_all_blocks=1 00:26:20.067 --rc geninfo_unexecuted_blocks=1 00:26:20.067 00:26:20.067 ' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.067 --rc genhtml_branch_coverage=1 00:26:20.067 --rc genhtml_function_coverage=1 00:26:20.067 --rc genhtml_legend=1 00:26:20.067 --rc geninfo_all_blocks=1 00:26:20.067 --rc geninfo_unexecuted_blocks=1 00:26:20.067 00:26:20.067 ' 00:26:20.067 17:19:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.067 --rc genhtml_branch_coverage=1 00:26:20.067 --rc genhtml_function_coverage=1 00:26:20.067 --rc genhtml_legend=1 00:26:20.067 --rc geninfo_all_blocks=1 00:26:20.067 --rc geninfo_unexecuted_blocks=1 00:26:20.068 00:26:20.068 ' 00:26:20.068 17:19:16 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:20.068 17:19:16 -- nvmf/common.sh@7 -- # uname -s 00:26:20.068 17:19:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:20.068 17:19:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:20.068 17:19:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:20.068 17:19:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:20.068 17:19:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:20.068 17:19:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:20.068 17:19:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:20.068 17:19:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:20.068 17:19:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:20.068 17:19:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:20.068 17:19:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:20.068 17:19:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:20.068 17:19:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:20.068 17:19:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:20.068 17:19:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:20.068 17:19:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:20.068 17:19:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:20.068 17:19:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:20.068 17:19:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:20.068 17:19:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.068 17:19:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.068 17:19:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.068 17:19:16 -- paths/export.sh@5 -- # export PATH 00:26:20.068 17:19:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.068 17:19:16 -- nvmf/common.sh@46 -- # : 0 00:26:20.068 17:19:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:20.068 17:19:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:20.068 17:19:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:20.068 17:19:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:20.068 17:19:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:20.068 17:19:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:20.068 17:19:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:20.068 17:19:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:20.068 17:19:16 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:20.068 17:19:16 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:20.068 17:19:16 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:20.068 17:19:16 -- host/perf.sh@17 -- # nvmftestinit 00:26:20.068 17:19:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:20.068 17:19:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:20.068 17:19:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:20.068 17:19:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:20.068 17:19:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:20.068 17:19:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:20.068 17:19:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:20.068 17:19:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:20.068 17:19:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:20.068 17:19:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:20.068 17:19:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:20.068 17:19:16 -- common/autotest_common.sh@10 -- # set +x 00:26:21.971 17:19:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.971 17:19:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.971 17:19:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.971 17:19:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.971 17:19:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.971 17:19:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.971 17:19:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.971 17:19:18 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.971 17:19:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.971 17:19:18 -- nvmf/common.sh@295 -- # e810=() 00:26:21.971 17:19:18 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.971 17:19:18 -- nvmf/common.sh@296 -- # x722=() 00:26:21.971 17:19:18 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.971 17:19:18 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.971 17:19:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.971 17:19:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.971 17:19:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.971 17:19:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.971 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.971 17:19:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.971 17:19:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.971 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.971 17:19:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.971 17:19:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.971 17:19:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.971 17:19:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.971 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.971 17:19:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.971 17:19:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.971 17:19:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.971 17:19:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.971 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.971 17:19:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.971 17:19:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.971 17:19:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.971 17:19:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.971 17:19:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.971 17:19:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.971 17:19:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.971 17:19:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.971 17:19:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.971 17:19:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.971 17:19:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.971 17:19:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.971 17:19:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.971 17:19:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.971 17:19:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.971 17:19:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.971 17:19:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.971 17:19:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.971 17:19:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.971 17:19:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.971 17:19:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.971 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.971 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.330 ms 00:26:21.971 00:26:21.971 --- 10.0.0.2 ping statistics --- 00:26:21.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.971 rtt min/avg/max/mdev = 0.330/0.330/0.330/0.000 ms 00:26:21.971 17:19:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.971 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.971 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:26:21.971 00:26:21.971 --- 10.0.0.1 ping statistics --- 00:26:21.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.971 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:26:21.971 17:19:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.971 17:19:18 -- nvmf/common.sh@410 -- # return 0 00:26:21.971 17:19:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.971 17:19:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.971 17:19:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.971 17:19:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.971 17:19:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.971 17:19:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.971 17:19:18 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:21.971 17:19:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:21.971 17:19:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.971 17:19:18 -- common/autotest_common.sh@10 -- # set +x 00:26:21.971 17:19:18 -- nvmf/common.sh@469 -- # nvmfpid=1831952 00:26:21.971 17:19:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:21.971 17:19:18 -- nvmf/common.sh@470 -- # waitforlisten 1831952 00:26:21.971 17:19:18 -- common/autotest_common.sh@829 -- # '[' -z 1831952 ']' 00:26:21.971 17:19:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.971 17:19:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.971 17:19:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.971 17:19:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.971 17:19:18 -- common/autotest_common.sh@10 -- # set +x 00:26:21.971 [2024-11-27 17:19:18.896774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:21.971 [2024-11-27 17:19:18.896857] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:22.230 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.230 [2024-11-27 17:19:18.974040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:22.230 [2024-11-27 17:19:19.073275] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.230 [2024-11-27 17:19:19.073440] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:22.230 [2024-11-27 17:19:19.073460] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:22.230 [2024-11-27 17:19:19.073473] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:22.230 [2024-11-27 17:19:19.073548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.230 [2024-11-27 17:19:19.073606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:22.230 [2024-11-27 17:19:19.073645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:22.230 [2024-11-27 17:19:19.073648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:23.165 17:19:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:23.165 17:19:19 -- common/autotest_common.sh@862 -- # return 0 00:26:23.165 17:19:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:23.165 17:19:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:23.165 17:19:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.166 17:19:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:23.166 17:19:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:23.166 17:19:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:26.447 17:19:23 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:26.447 17:19:23 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:26.447 17:19:23 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:26.447 17:19:23 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:26.705 17:19:23 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:26.705 17:19:23 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:26.705 17:19:23 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:26.962 17:19:23 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:26.962 17:19:23 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:26.962 [2024-11-27 17:19:23.894979] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:27.220 17:19:23 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:27.220 17:19:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:27.220 17:19:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:27.478 17:19:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:27.478 17:19:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:27.737 17:19:24 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:27.994 [2024-11-27 17:19:24.926854] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:28.251 17:19:24 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:28.509 17:19:25 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:28.509 17:19:25 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:28.509 17:19:25 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:28.509 17:19:25 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:29.881 Initializing NVMe Controllers 00:26:29.881 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:29.881 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:29.881 Initialization complete. Launching workers. 00:26:29.881 ======================================================== 00:26:29.881 Latency(us) 00:26:29.881 Device Information : IOPS MiB/s Average min max 00:26:29.881 PCIE (0000:88:00.0) NSID 1 from core 0: 85311.23 333.25 374.59 32.42 5315.53 00:26:29.881 ======================================================== 00:26:29.881 Total : 85311.23 333.25 374.59 32.42 5315.53 00:26:29.881 00:26:29.881 17:19:26 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:29.881 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.813 Initializing NVMe Controllers 00:26:30.813 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:30.813 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:30.813 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:30.813 Initialization complete. Launching workers. 00:26:30.813 ======================================================== 00:26:30.813 Latency(us) 00:26:30.813 Device Information : IOPS MiB/s Average min max 00:26:30.813 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 62.00 0.24 16605.49 148.89 46928.09 00:26:30.813 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 71.00 0.28 14147.60 5367.98 47899.50 00:26:30.813 ======================================================== 00:26:30.813 Total : 133.00 0.52 15293.39 148.89 47899.50 00:26:30.813 00:26:30.813 17:19:27 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:30.813 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.187 Initializing NVMe Controllers 00:26:32.187 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:32.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:32.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:32.187 Initialization complete. Launching workers. 00:26:32.187 ======================================================== 00:26:32.187 Latency(us) 00:26:32.187 Device Information : IOPS MiB/s Average min max 00:26:32.187 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8447.09 33.00 3788.25 551.28 11076.32 00:26:32.187 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3900.42 15.24 8263.87 5697.74 19001.63 00:26:32.187 ======================================================== 00:26:32.187 Total : 12347.52 48.23 5202.04 551.28 19001.63 00:26:32.187 00:26:32.187 17:19:28 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:32.187 17:19:28 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:32.187 17:19:28 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:32.187 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.723 Initializing NVMe Controllers 00:26:34.723 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:34.723 Controller IO queue size 128, less than required. 00:26:34.723 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:34.723 Controller IO queue size 128, less than required. 00:26:34.723 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:34.723 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:34.723 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:34.723 Initialization complete. Launching workers. 00:26:34.723 ======================================================== 00:26:34.723 Latency(us) 00:26:34.723 Device Information : IOPS MiB/s Average min max 00:26:34.723 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1688.10 422.03 77441.22 48023.29 122979.23 00:26:34.723 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 541.39 135.35 240890.93 98400.48 360698.94 00:26:34.723 ======================================================== 00:26:34.723 Total : 2229.49 557.37 117131.97 48023.29 360698.94 00:26:34.723 00:26:34.723 17:19:31 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:34.723 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.723 No valid NVMe controllers or AIO or URING devices found 00:26:34.723 Initializing NVMe Controllers 00:26:34.723 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:34.723 Controller IO queue size 128, less than required. 00:26:34.723 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:34.723 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:34.723 Controller IO queue size 128, less than required. 00:26:34.723 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:34.723 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:34.723 WARNING: Some requested NVMe devices were skipped 00:26:34.723 17:19:31 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:34.723 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.253 Initializing NVMe Controllers 00:26:37.253 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:37.253 Controller IO queue size 128, less than required. 00:26:37.253 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:37.253 Controller IO queue size 128, less than required. 00:26:37.253 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:37.253 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:37.253 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:37.253 Initialization complete. Launching workers. 00:26:37.253 00:26:37.253 ==================== 00:26:37.253 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:37.253 TCP transport: 00:26:37.253 polls: 8885 00:26:37.253 idle_polls: 5874 00:26:37.253 sock_completions: 3011 00:26:37.253 nvme_completions: 5892 00:26:37.253 submitted_requests: 9084 00:26:37.253 queued_requests: 1 00:26:37.253 00:26:37.253 ==================== 00:26:37.253 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:37.253 TCP transport: 00:26:37.253 polls: 8721 00:26:37.253 idle_polls: 5267 00:26:37.253 sock_completions: 3454 00:26:37.253 nvme_completions: 5920 00:26:37.253 submitted_requests: 9000 00:26:37.253 queued_requests: 1 00:26:37.253 ======================================================== 00:26:37.253 Latency(us) 00:26:37.253 Device Information : IOPS MiB/s Average min max 00:26:37.253 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1534.72 383.68 85248.98 55524.22 137008.64 00:26:37.253 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1541.72 385.43 84332.71 47063.92 139656.79 00:26:37.253 ======================================================== 00:26:37.253 Total : 3076.44 769.11 84789.81 47063.92 139656.79 00:26:37.253 00:26:37.253 17:19:34 -- host/perf.sh@66 -- # sync 00:26:37.253 17:19:34 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:37.511 17:19:34 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:37.511 17:19:34 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:37.511 17:19:34 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:40.788 17:19:37 -- host/perf.sh@72 -- # ls_guid=ee9206c2-adeb-498d-8d51-1cb084fb445c 00:26:40.788 17:19:37 -- host/perf.sh@73 -- # get_lvs_free_mb ee9206c2-adeb-498d-8d51-1cb084fb445c 00:26:40.788 17:19:37 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ee9206c2-adeb-498d-8d51-1cb084fb445c 00:26:40.788 17:19:37 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:40.788 17:19:37 -- common/autotest_common.sh@1355 -- # local fc 00:26:40.788 17:19:37 -- common/autotest_common.sh@1356 -- # local cs 00:26:40.788 17:19:37 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:41.045 17:19:37 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:41.045 { 00:26:41.045 "uuid": "ee9206c2-adeb-498d-8d51-1cb084fb445c", 00:26:41.045 "name": "lvs_0", 00:26:41.045 "base_bdev": "Nvme0n1", 00:26:41.045 "total_data_clusters": 238234, 00:26:41.045 "free_clusters": 238234, 00:26:41.045 "block_size": 512, 00:26:41.045 "cluster_size": 4194304 00:26:41.045 } 00:26:41.045 ]' 00:26:41.045 17:19:37 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ee9206c2-adeb-498d-8d51-1cb084fb445c") .free_clusters' 00:26:41.045 17:19:37 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:41.045 17:19:37 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ee9206c2-adeb-498d-8d51-1cb084fb445c") .cluster_size' 00:26:41.045 17:19:37 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:41.045 17:19:37 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:41.045 17:19:37 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:41.045 952936 00:26:41.045 17:19:37 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:41.045 17:19:37 -- host/perf.sh@78 -- # free_mb=20480 00:26:41.045 17:19:37 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ee9206c2-adeb-498d-8d51-1cb084fb445c lbd_0 20480 00:26:41.609 17:19:38 -- host/perf.sh@80 -- # lb_guid=4921b1db-a867-4e7f-a1e0-aa21080d45ac 00:26:41.609 17:19:38 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 4921b1db-a867-4e7f-a1e0-aa21080d45ac lvs_n_0 00:26:42.538 17:19:39 -- host/perf.sh@83 -- # ls_nested_guid=e1836a16-9718-4042-a26d-20a72c1fcf72 00:26:42.538 17:19:39 -- host/perf.sh@84 -- # get_lvs_free_mb e1836a16-9718-4042-a26d-20a72c1fcf72 00:26:42.538 17:19:39 -- common/autotest_common.sh@1353 -- # local lvs_uuid=e1836a16-9718-4042-a26d-20a72c1fcf72 00:26:42.538 17:19:39 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:42.538 17:19:39 -- common/autotest_common.sh@1355 -- # local fc 00:26:42.538 17:19:39 -- common/autotest_common.sh@1356 -- # local cs 00:26:42.538 17:19:39 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:42.795 17:19:39 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:42.795 { 00:26:42.795 "uuid": "ee9206c2-adeb-498d-8d51-1cb084fb445c", 00:26:42.795 "name": "lvs_0", 00:26:42.795 "base_bdev": "Nvme0n1", 00:26:42.795 "total_data_clusters": 238234, 00:26:42.795 "free_clusters": 233114, 00:26:42.795 "block_size": 512, 00:26:42.795 "cluster_size": 4194304 00:26:42.795 }, 00:26:42.795 { 00:26:42.795 "uuid": "e1836a16-9718-4042-a26d-20a72c1fcf72", 00:26:42.795 "name": "lvs_n_0", 00:26:42.795 "base_bdev": "4921b1db-a867-4e7f-a1e0-aa21080d45ac", 00:26:42.795 "total_data_clusters": 5114, 00:26:42.795 "free_clusters": 5114, 00:26:42.795 "block_size": 512, 00:26:42.795 "cluster_size": 4194304 00:26:42.795 } 00:26:42.795 ]' 00:26:42.795 17:19:39 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="e1836a16-9718-4042-a26d-20a72c1fcf72") .free_clusters' 00:26:42.795 17:19:39 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:42.795 17:19:39 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="e1836a16-9718-4042-a26d-20a72c1fcf72") .cluster_size' 00:26:42.795 17:19:39 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:42.795 17:19:39 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:42.795 17:19:39 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:42.795 20456 00:26:42.795 17:19:39 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:42.795 17:19:39 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e1836a16-9718-4042-a26d-20a72c1fcf72 lbd_nest_0 20456 00:26:43.059 17:19:39 -- host/perf.sh@88 -- # lb_nested_guid=437a8333-e9ef-4a68-8869-86c3ee884d00 00:26:43.059 17:19:39 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:43.393 17:19:40 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:43.393 17:19:40 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 437a8333-e9ef-4a68-8869-86c3ee884d00 00:26:43.672 17:19:40 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:43.930 17:19:40 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:43.930 17:19:40 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:43.930 17:19:40 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:43.930 17:19:40 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:43.930 17:19:40 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:43.930 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.121 Initializing NVMe Controllers 00:26:56.121 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:56.121 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:56.121 Initialization complete. Launching workers. 00:26:56.121 ======================================================== 00:26:56.122 Latency(us) 00:26:56.122 Device Information : IOPS MiB/s Average min max 00:26:56.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.48 0.02 22568.91 183.18 46291.72 00:26:56.122 ======================================================== 00:26:56.122 Total : 44.48 0.02 22568.91 183.18 46291.72 00:26:56.122 00:26:56.122 17:19:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:56.122 17:19:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.122 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.081 Initializing NVMe Controllers 00:27:06.081 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.081 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.081 Initialization complete. Launching workers. 00:27:06.081 ======================================================== 00:27:06.081 Latency(us) 00:27:06.081 Device Information : IOPS MiB/s Average min max 00:27:06.081 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 73.50 9.19 13615.09 5025.01 50873.83 00:27:06.081 ======================================================== 00:27:06.081 Total : 73.50 9.19 13615.09 5025.01 50873.83 00:27:06.081 00:27:06.081 17:20:01 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:06.081 17:20:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:06.081 17:20:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:06.081 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.043 Initializing NVMe Controllers 00:27:16.043 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:16.043 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:16.043 Initialization complete. Launching workers. 00:27:16.043 ======================================================== 00:27:16.043 Latency(us) 00:27:16.043 Device Information : IOPS MiB/s Average min max 00:27:16.043 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7826.49 3.82 4088.32 328.18 9593.51 00:27:16.043 ======================================================== 00:27:16.043 Total : 7826.49 3.82 4088.32 328.18 9593.51 00:27:16.043 00:27:16.043 17:20:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:16.043 17:20:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:16.043 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.009 Initializing NVMe Controllers 00:27:26.009 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.009 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.009 Initialization complete. Launching workers. 00:27:26.009 ======================================================== 00:27:26.009 Latency(us) 00:27:26.009 Device Information : IOPS MiB/s Average min max 00:27:26.009 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4064.59 508.07 7872.66 704.09 20308.64 00:27:26.009 ======================================================== 00:27:26.009 Total : 4064.59 508.07 7872.66 704.09 20308.64 00:27:26.009 00:27:26.009 17:20:21 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:26.009 17:20:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:26.009 17:20:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:26.009 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.970 Initializing NVMe Controllers 00:27:35.970 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:35.970 Controller IO queue size 128, less than required. 00:27:35.970 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:35.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:35.970 Initialization complete. Launching workers. 00:27:35.970 ======================================================== 00:27:35.970 Latency(us) 00:27:35.970 Device Information : IOPS MiB/s Average min max 00:27:35.970 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12007.12 5.86 10662.05 1848.58 54237.48 00:27:35.970 ======================================================== 00:27:35.970 Total : 12007.12 5.86 10662.05 1848.58 54237.48 00:27:35.970 00:27:35.970 17:20:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:35.970 17:20:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:35.970 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.933 Initializing NVMe Controllers 00:27:45.933 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:45.933 Controller IO queue size 128, less than required. 00:27:45.933 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:45.933 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:45.933 Initialization complete. Launching workers. 00:27:45.933 ======================================================== 00:27:45.933 Latency(us) 00:27:45.933 Device Information : IOPS MiB/s Average min max 00:27:45.933 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1206.70 150.84 106252.66 16456.04 217554.91 00:27:45.933 ======================================================== 00:27:45.933 Total : 1206.70 150.84 106252.66 16456.04 217554.91 00:27:45.933 00:27:45.933 17:20:42 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:45.933 17:20:42 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 437a8333-e9ef-4a68-8869-86c3ee884d00 00:27:46.866 17:20:43 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:47.123 17:20:43 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4921b1db-a867-4e7f-a1e0-aa21080d45ac 00:27:47.381 17:20:44 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:47.638 17:20:44 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:47.638 17:20:44 -- host/perf.sh@114 -- # nvmftestfini 00:27:47.638 17:20:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:47.638 17:20:44 -- nvmf/common.sh@116 -- # sync 00:27:47.638 17:20:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:47.638 17:20:44 -- nvmf/common.sh@119 -- # set +e 00:27:47.638 17:20:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:47.638 17:20:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:47.638 rmmod nvme_tcp 00:27:47.638 rmmod nvme_fabrics 00:27:47.638 rmmod nvme_keyring 00:27:47.638 17:20:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:47.638 17:20:44 -- nvmf/common.sh@123 -- # set -e 00:27:47.638 17:20:44 -- nvmf/common.sh@124 -- # return 0 00:27:47.638 17:20:44 -- nvmf/common.sh@477 -- # '[' -n 1831952 ']' 00:27:47.638 17:20:44 -- nvmf/common.sh@478 -- # killprocess 1831952 00:27:47.638 17:20:44 -- common/autotest_common.sh@936 -- # '[' -z 1831952 ']' 00:27:47.638 17:20:44 -- common/autotest_common.sh@940 -- # kill -0 1831952 00:27:47.638 17:20:44 -- common/autotest_common.sh@941 -- # uname 00:27:47.638 17:20:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:47.638 17:20:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1831952 00:27:47.638 17:20:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:47.638 17:20:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:47.638 17:20:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1831952' 00:27:47.638 killing process with pid 1831952 00:27:47.639 17:20:44 -- common/autotest_common.sh@955 -- # kill 1831952 00:27:47.639 17:20:44 -- common/autotest_common.sh@960 -- # wait 1831952 00:27:49.535 17:20:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:49.535 17:20:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:49.535 17:20:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:49.535 17:20:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:49.535 17:20:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:49.535 17:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.535 17:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.535 17:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:51.441 17:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:51.441 00:27:51.441 real 1m31.761s 00:27:51.441 user 5m40.468s 00:27:51.441 sys 0m15.253s 00:27:51.441 17:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:51.441 17:20:48 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 ************************************ 00:27:51.441 END TEST nvmf_perf 00:27:51.441 ************************************ 00:27:51.441 17:20:48 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:51.441 17:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:51.441 17:20:48 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 ************************************ 00:27:51.441 START TEST nvmf_fio_host 00:27:51.441 ************************************ 00:27:51.441 17:20:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:51.441 * Looking for test storage... 00:27:51.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:51.441 17:20:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:51.441 17:20:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:51.441 17:20:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:51.441 17:20:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:51.441 17:20:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:51.441 17:20:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:51.441 17:20:48 -- scripts/common.sh@335 -- # IFS=.-: 00:27:51.441 17:20:48 -- scripts/common.sh@335 -- # read -ra ver1 00:27:51.441 17:20:48 -- scripts/common.sh@336 -- # IFS=.-: 00:27:51.441 17:20:48 -- scripts/common.sh@336 -- # read -ra ver2 00:27:51.441 17:20:48 -- scripts/common.sh@337 -- # local 'op=<' 00:27:51.441 17:20:48 -- scripts/common.sh@339 -- # ver1_l=2 00:27:51.441 17:20:48 -- scripts/common.sh@340 -- # ver2_l=1 00:27:51.441 17:20:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:51.441 17:20:48 -- scripts/common.sh@343 -- # case "$op" in 00:27:51.441 17:20:48 -- scripts/common.sh@344 -- # : 1 00:27:51.441 17:20:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:51.441 17:20:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:51.441 17:20:48 -- scripts/common.sh@364 -- # decimal 1 00:27:51.441 17:20:48 -- scripts/common.sh@352 -- # local d=1 00:27:51.441 17:20:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:51.441 17:20:48 -- scripts/common.sh@354 -- # echo 1 00:27:51.441 17:20:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:51.441 17:20:48 -- scripts/common.sh@365 -- # decimal 2 00:27:51.441 17:20:48 -- scripts/common.sh@352 -- # local d=2 00:27:51.441 17:20:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:51.441 17:20:48 -- scripts/common.sh@354 -- # echo 2 00:27:51.441 17:20:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:51.441 17:20:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:51.441 17:20:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:51.441 17:20:48 -- scripts/common.sh@367 -- # return 0 00:27:51.441 17:20:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:51.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.441 --rc genhtml_branch_coverage=1 00:27:51.441 --rc genhtml_function_coverage=1 00:27:51.441 --rc genhtml_legend=1 00:27:51.441 --rc geninfo_all_blocks=1 00:27:51.441 --rc geninfo_unexecuted_blocks=1 00:27:51.441 00:27:51.441 ' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:51.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.441 --rc genhtml_branch_coverage=1 00:27:51.441 --rc genhtml_function_coverage=1 00:27:51.441 --rc genhtml_legend=1 00:27:51.441 --rc geninfo_all_blocks=1 00:27:51.441 --rc geninfo_unexecuted_blocks=1 00:27:51.441 00:27:51.441 ' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:51.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.441 --rc genhtml_branch_coverage=1 00:27:51.441 --rc genhtml_function_coverage=1 00:27:51.441 --rc genhtml_legend=1 00:27:51.441 --rc geninfo_all_blocks=1 00:27:51.441 --rc geninfo_unexecuted_blocks=1 00:27:51.441 00:27:51.441 ' 00:27:51.441 17:20:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:51.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.441 --rc genhtml_branch_coverage=1 00:27:51.441 --rc genhtml_function_coverage=1 00:27:51.441 --rc genhtml_legend=1 00:27:51.441 --rc geninfo_all_blocks=1 00:27:51.441 --rc geninfo_unexecuted_blocks=1 00:27:51.441 00:27:51.441 ' 00:27:51.441 17:20:48 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:51.441 17:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:51.441 17:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:51.441 17:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:51.441 17:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.441 17:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.441 17:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.441 17:20:48 -- paths/export.sh@5 -- # export PATH 00:27:51.441 17:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.441 17:20:48 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:51.441 17:20:48 -- nvmf/common.sh@7 -- # uname -s 00:27:51.441 17:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:51.441 17:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:51.441 17:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:51.441 17:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:51.441 17:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:51.441 17:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:51.441 17:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:51.441 17:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:51.441 17:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:51.441 17:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:51.441 17:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.441 17:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.441 17:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:51.441 17:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:51.441 17:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:51.700 17:20:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:51.700 17:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:51.700 17:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:51.700 17:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:51.700 17:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.700 17:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.700 17:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.700 17:20:48 -- paths/export.sh@5 -- # export PATH 00:27:51.700 17:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.700 17:20:48 -- nvmf/common.sh@46 -- # : 0 00:27:51.700 17:20:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:51.700 17:20:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:51.700 17:20:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:51.700 17:20:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:51.700 17:20:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:51.700 17:20:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:51.700 17:20:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:51.700 17:20:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:51.700 17:20:48 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:51.700 17:20:48 -- host/fio.sh@14 -- # nvmftestinit 00:27:51.700 17:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:51.700 17:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:51.700 17:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:51.700 17:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:51.700 17:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:51.700 17:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:51.700 17:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:51.700 17:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:51.700 17:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:51.700 17:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:51.700 17:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:51.700 17:20:48 -- common/autotest_common.sh@10 -- # set +x 00:27:53.601 17:20:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:53.601 17:20:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:53.601 17:20:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:53.601 17:20:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:53.601 17:20:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:53.601 17:20:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:53.601 17:20:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:53.601 17:20:50 -- nvmf/common.sh@294 -- # net_devs=() 00:27:53.601 17:20:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:53.601 17:20:50 -- nvmf/common.sh@295 -- # e810=() 00:27:53.601 17:20:50 -- nvmf/common.sh@295 -- # local -ga e810 00:27:53.601 17:20:50 -- nvmf/common.sh@296 -- # x722=() 00:27:53.601 17:20:50 -- nvmf/common.sh@296 -- # local -ga x722 00:27:53.601 17:20:50 -- nvmf/common.sh@297 -- # mlx=() 00:27:53.601 17:20:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:53.601 17:20:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:53.601 17:20:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:53.601 17:20:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:53.601 17:20:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:53.601 17:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:53.601 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:53.601 17:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:53.601 17:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:53.601 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:53.601 17:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:53.601 17:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:53.601 17:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:53.601 17:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:53.601 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:53.601 17:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:53.601 17:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:53.601 17:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:53.601 17:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:53.601 17:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:53.601 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:53.601 17:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:53.601 17:20:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:53.601 17:20:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:53.601 17:20:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:53.601 17:20:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:53.601 17:20:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:53.601 17:20:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:53.601 17:20:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:53.601 17:20:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:53.601 17:20:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:53.601 17:20:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:53.601 17:20:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:53.601 17:20:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:53.601 17:20:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:53.601 17:20:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:53.601 17:20:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:53.601 17:20:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:53.601 17:20:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:53.601 17:20:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:53.601 17:20:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:53.601 17:20:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:53.601 17:20:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:53.601 17:20:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:53.601 17:20:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:53.601 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:53.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:27:53.601 00:27:53.602 --- 10.0.0.2 ping statistics --- 00:27:53.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:53.602 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:27:53.602 17:20:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:53.602 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:53.602 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:27:53.602 00:27:53.602 --- 10.0.0.1 ping statistics --- 00:27:53.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:53.602 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:27:53.602 17:20:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:53.602 17:20:50 -- nvmf/common.sh@410 -- # return 0 00:27:53.602 17:20:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:53.602 17:20:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:53.602 17:20:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:53.602 17:20:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:53.602 17:20:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:53.602 17:20:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:53.602 17:20:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:53.602 17:20:50 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:53.602 17:20:50 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:53.602 17:20:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:53.602 17:20:50 -- common/autotest_common.sh@10 -- # set +x 00:27:53.602 17:20:50 -- host/fio.sh@24 -- # nvmfpid=1844388 00:27:53.602 17:20:50 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:53.602 17:20:50 -- host/fio.sh@28 -- # waitforlisten 1844388 00:27:53.602 17:20:50 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:53.602 17:20:50 -- common/autotest_common.sh@829 -- # '[' -z 1844388 ']' 00:27:53.602 17:20:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:53.602 17:20:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:53.602 17:20:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:53.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:53.602 17:20:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:53.602 17:20:50 -- common/autotest_common.sh@10 -- # set +x 00:27:53.602 [2024-11-27 17:20:50.534217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:53.602 [2024-11-27 17:20:50.534300] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:53.860 EAL: No free 2048 kB hugepages reported on node 1 00:27:53.860 [2024-11-27 17:20:50.603745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:53.860 [2024-11-27 17:20:50.693082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:53.860 [2024-11-27 17:20:50.693245] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:53.860 [2024-11-27 17:20:50.693265] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:53.860 [2024-11-27 17:20:50.693279] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:53.860 [2024-11-27 17:20:50.693377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:53.860 [2024-11-27 17:20:50.693447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:53.860 [2024-11-27 17:20:50.693557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:53.860 [2024-11-27 17:20:50.693561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:54.792 17:20:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:54.792 17:20:51 -- common/autotest_common.sh@862 -- # return 0 00:27:54.792 17:20:51 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:54.792 [2024-11-27 17:20:51.710849] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:54.792 17:20:51 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:54.792 17:20:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:54.793 17:20:51 -- common/autotest_common.sh@10 -- # set +x 00:27:55.050 17:20:51 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:55.308 Malloc1 00:27:55.308 17:20:52 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:55.566 17:20:52 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:55.823 17:20:52 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:55.823 [2024-11-27 17:20:52.773490] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:56.080 17:20:52 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:56.337 17:20:53 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:56.337 17:20:53 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:56.337 17:20:53 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:56.337 17:20:53 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:56.337 17:20:53 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:56.337 17:20:53 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:56.338 17:20:53 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.338 17:20:53 -- common/autotest_common.sh@1330 -- # shift 00:27:56.338 17:20:53 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:56.338 17:20:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.338 17:20:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.338 17:20:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.338 17:20:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.338 17:20:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.338 17:20:53 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:56.338 17:20:53 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:56.338 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:56.338 fio-3.35 00:27:56.338 Starting 1 thread 00:27:56.627 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.197 00:27:59.197 test: (groupid=0, jobs=1): err= 0: pid=1844889: Wed Nov 27 17:20:55 2024 00:27:59.197 read: IOPS=9492, BW=37.1MiB/s (38.9MB/s)(74.4MiB/2006msec) 00:27:59.197 slat (nsec): min=1868, max=110337, avg=2332.05, stdev=1306.04 00:27:59.197 clat (usec): min=2250, max=12571, avg=7438.42, stdev=569.87 00:27:59.197 lat (usec): min=2268, max=12573, avg=7440.75, stdev=569.81 00:27:59.197 clat percentiles (usec): 00:27:59.197 | 1.00th=[ 6128], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 6980], 00:27:59.197 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:27:59.197 | 70.00th=[ 7701], 80.00th=[ 7898], 90.00th=[ 8094], 95.00th=[ 8291], 00:27:59.197 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[10683], 99.95th=[11731], 00:27:59.197 | 99.99th=[12518] 00:27:59.197 bw ( KiB/s): min=36944, max=38728, per=99.97%, avg=37958.00, stdev=743.22, samples=4 00:27:59.197 iops : min= 9236, max= 9682, avg=9489.50, stdev=185.81, samples=4 00:27:59.197 write: IOPS=9501, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2006msec); 0 zone resets 00:27:59.197 slat (nsec): min=1959, max=106096, avg=2395.68, stdev=1105.52 00:27:59.197 clat (usec): min=935, max=11761, avg=5991.30, stdev=504.08 00:27:59.197 lat (usec): min=941, max=11764, avg=5993.70, stdev=504.04 00:27:59.197 clat percentiles (usec): 00:27:59.198 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:27:59.198 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:27:59.198 | 70.00th=[ 6194], 80.00th=[ 6390], 90.00th=[ 6521], 95.00th=[ 6718], 00:27:59.198 | 99.00th=[ 7046], 99.50th=[ 7242], 99.90th=[10159], 99.95th=[11076], 00:27:59.198 | 99.99th=[11731] 00:27:59.198 bw ( KiB/s): min=37824, max=38208, per=99.96%, avg=37990.00, stdev=185.60, samples=4 00:27:59.198 iops : min= 9456, max= 9552, avg=9497.50, stdev=46.40, samples=4 00:27:59.198 lat (usec) : 1000=0.01% 00:27:59.198 lat (msec) : 2=0.03%, 4=0.11%, 10=99.73%, 20=0.13% 00:27:59.198 cpu : usr=63.24%, sys=34.21%, ctx=80, majf=0, minf=36 00:27:59.198 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:59.198 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:59.198 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:59.198 issued rwts: total=19041,19060,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:59.198 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:59.198 00:27:59.198 Run status group 0 (all jobs): 00:27:59.198 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.4MiB (78.0MB), run=2006-2006msec 00:27:59.198 WRITE: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2006-2006msec 00:27:59.198 17:20:55 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:59.198 17:20:55 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:59.198 17:20:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:59.198 17:20:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:59.198 17:20:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:59.198 17:20:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.198 17:20:55 -- common/autotest_common.sh@1330 -- # shift 00:27:59.198 17:20:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:59.198 17:20:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.198 17:20:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.198 17:20:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.198 17:20:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.198 17:20:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.198 17:20:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:59.198 17:20:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:59.198 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:59.198 fio-3.35 00:27:59.198 Starting 1 thread 00:27:59.198 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.723 00:28:01.723 test: (groupid=0, jobs=1): err= 0: pid=1845235: Wed Nov 27 17:20:58 2024 00:28:01.723 read: IOPS=8906, BW=139MiB/s (146MB/s)(279MiB/2007msec) 00:28:01.723 slat (usec): min=2, max=113, avg= 3.69, stdev= 2.07 00:28:01.723 clat (usec): min=1855, max=15942, avg=8385.62, stdev=1953.63 00:28:01.723 lat (usec): min=1859, max=15945, avg=8389.31, stdev=1953.72 00:28:01.723 clat percentiles (usec): 00:28:01.723 | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 5866], 20.00th=[ 6718], 00:28:01.723 | 30.00th=[ 7308], 40.00th=[ 7898], 50.00th=[ 8356], 60.00th=[ 8848], 00:28:01.723 | 70.00th=[ 9372], 80.00th=[ 9896], 90.00th=[10814], 95.00th=[11600], 00:28:01.723 | 99.00th=[13960], 99.50th=[14353], 99.90th=[15401], 99.95th=[15533], 00:28:01.723 | 99.99th=[15926] 00:28:01.723 bw ( KiB/s): min=63552, max=80576, per=50.10%, avg=71392.00, stdev=6993.20, samples=4 00:28:01.723 iops : min= 3972, max= 5036, avg=4462.00, stdev=437.08, samples=4 00:28:01.723 write: IOPS=5192, BW=81.1MiB/s (85.1MB/s)(145MiB/1788msec); 0 zone resets 00:28:01.723 slat (usec): min=30, max=123, avg=34.26, stdev= 5.92 00:28:01.723 clat (usec): min=2562, max=18379, avg=10723.26, stdev=1783.63 00:28:01.723 lat (usec): min=2598, max=18410, avg=10757.52, stdev=1783.69 00:28:01.723 clat percentiles (usec): 00:28:01.723 | 1.00th=[ 7308], 5.00th=[ 8225], 10.00th=[ 8586], 20.00th=[ 9110], 00:28:01.723 | 30.00th=[ 9634], 40.00th=[10159], 50.00th=[10552], 60.00th=[10945], 00:28:01.723 | 70.00th=[11469], 80.00th=[12125], 90.00th=[13173], 95.00th=[14091], 00:28:01.723 | 99.00th=[15139], 99.50th=[15533], 99.90th=[16712], 99.95th=[17957], 00:28:01.723 | 99.99th=[18482] 00:28:01.723 bw ( KiB/s): min=65504, max=83808, per=89.40%, avg=74272.00, stdev=7532.27, samples=4 00:28:01.723 iops : min= 4094, max= 5238, avg=4642.00, stdev=470.77, samples=4 00:28:01.723 lat (msec) : 2=0.02%, 4=0.28%, 10=65.95%, 20=33.75% 00:28:01.723 cpu : usr=79.21%, sys=19.09%, ctx=33, majf=0, minf=60 00:28:01.723 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:28:01.723 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:01.723 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:01.723 issued rwts: total=17876,9284,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:01.723 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:01.723 00:28:01.723 Run status group 0 (all jobs): 00:28:01.723 READ: bw=139MiB/s (146MB/s), 139MiB/s-139MiB/s (146MB/s-146MB/s), io=279MiB (293MB), run=2007-2007msec 00:28:01.723 WRITE: bw=81.1MiB/s (85.1MB/s), 81.1MiB/s-81.1MiB/s (85.1MB/s-85.1MB/s), io=145MiB (152MB), run=1788-1788msec 00:28:01.723 17:20:58 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:01.723 17:20:58 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:28:01.723 17:20:58 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:28:01.723 17:20:58 -- host/fio.sh@51 -- # get_nvme_bdfs 00:28:01.723 17:20:58 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:01.723 17:20:58 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:01.723 17:20:58 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:01.723 17:20:58 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:01.723 17:20:58 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:01.723 17:20:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:01.723 17:20:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:01.723 17:20:58 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:28:05.001 Nvme0n1 00:28:05.001 17:21:01 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:07.528 17:21:04 -- host/fio.sh@53 -- # ls_guid=c2663225-57d4-49b4-a391-ec15bc0134e6 00:28:07.528 17:21:04 -- host/fio.sh@54 -- # get_lvs_free_mb c2663225-57d4-49b4-a391-ec15bc0134e6 00:28:07.528 17:21:04 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c2663225-57d4-49b4-a391-ec15bc0134e6 00:28:07.528 17:21:04 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:07.528 17:21:04 -- common/autotest_common.sh@1355 -- # local fc 00:28:07.528 17:21:04 -- common/autotest_common.sh@1356 -- # local cs 00:28:07.528 17:21:04 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:08.093 17:21:04 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:08.093 { 00:28:08.093 "uuid": "c2663225-57d4-49b4-a391-ec15bc0134e6", 00:28:08.093 "name": "lvs_0", 00:28:08.093 "base_bdev": "Nvme0n1", 00:28:08.093 "total_data_clusters": 930, 00:28:08.093 "free_clusters": 930, 00:28:08.093 "block_size": 512, 00:28:08.093 "cluster_size": 1073741824 00:28:08.093 } 00:28:08.093 ]' 00:28:08.093 17:21:04 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c2663225-57d4-49b4-a391-ec15bc0134e6") .free_clusters' 00:28:08.093 17:21:04 -- common/autotest_common.sh@1358 -- # fc=930 00:28:08.093 17:21:04 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c2663225-57d4-49b4-a391-ec15bc0134e6") .cluster_size' 00:28:08.093 17:21:04 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:28:08.093 17:21:04 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:28:08.093 17:21:04 -- common/autotest_common.sh@1363 -- # echo 952320 00:28:08.093 952320 00:28:08.093 17:21:04 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:28:08.351 50dff6b8-3476-456c-9591-21a8eb8098f3 00:28:08.351 17:21:05 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:08.609 17:21:05 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:08.867 17:21:05 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:09.124 17:21:06 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:09.124 17:21:06 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:09.124 17:21:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:09.124 17:21:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:09.124 17:21:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:09.124 17:21:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.124 17:21:06 -- common/autotest_common.sh@1330 -- # shift 00:28:09.124 17:21:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:09.124 17:21:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:09.124 17:21:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:09.124 17:21:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:09.124 17:21:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:09.382 17:21:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:09.382 17:21:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:09.382 17:21:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:09.382 17:21:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:09.382 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:09.382 fio-3.35 00:28:09.382 Starting 1 thread 00:28:09.382 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.910 00:28:11.910 test: (groupid=0, jobs=1): err= 0: pid=1846664: Wed Nov 27 17:21:08 2024 00:28:11.910 read: IOPS=6307, BW=24.6MiB/s (25.8MB/s)(49.4MiB/2007msec) 00:28:11.910 slat (usec): min=2, max=149, avg= 2.84, stdev= 2.59 00:28:11.910 clat (usec): min=800, max=170758, avg=11131.59, stdev=11375.59 00:28:11.910 lat (usec): min=804, max=170789, avg=11134.43, stdev=11375.89 00:28:11.910 clat percentiles (msec): 00:28:11.910 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:28:11.910 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:28:11.910 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:28:11.910 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:11.910 | 99.99th=[ 171] 00:28:11.910 bw ( KiB/s): min=17688, max=27928, per=99.87%, avg=25198.00, stdev=5009.70, samples=4 00:28:11.910 iops : min= 4422, max= 6982, avg=6299.50, stdev=1252.43, samples=4 00:28:11.910 write: IOPS=6301, BW=24.6MiB/s (25.8MB/s)(49.4MiB/2007msec); 0 zone resets 00:28:11.910 slat (usec): min=2, max=132, avg= 2.96, stdev= 2.19 00:28:11.910 clat (usec): min=312, max=168935, avg=9002.10, stdev=10679.30 00:28:11.910 lat (usec): min=315, max=168942, avg=9005.05, stdev=10679.63 00:28:11.910 clat percentiles (msec): 00:28:11.910 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:28:11.910 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:11.910 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:28:11.910 | 99.00th=[ 11], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:28:11.910 | 99.99th=[ 169] 00:28:11.910 bw ( KiB/s): min=18600, max=27392, per=99.82%, avg=25162.00, stdev=4374.77, samples=4 00:28:11.910 iops : min= 4650, max= 6848, avg=6290.50, stdev=1093.69, samples=4 00:28:11.910 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:28:11.910 lat (msec) : 2=0.03%, 4=0.14%, 10=66.22%, 20=33.08%, 250=0.51% 00:28:11.910 cpu : usr=60.07%, sys=37.89%, ctx=92, majf=0, minf=36 00:28:11.910 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:11.910 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:11.910 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:11.910 issued rwts: total=12659,12648,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:11.910 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:11.910 00:28:11.910 Run status group 0 (all jobs): 00:28:11.910 READ: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.4MiB (51.9MB), run=2007-2007msec 00:28:11.910 WRITE: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.4MiB (51.8MB), run=2007-2007msec 00:28:11.910 17:21:08 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:12.169 17:21:08 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:13.541 17:21:10 -- host/fio.sh@64 -- # ls_nested_guid=493c4419-16fd-499c-8b16-2754e26e9694 00:28:13.542 17:21:10 -- host/fio.sh@65 -- # get_lvs_free_mb 493c4419-16fd-499c-8b16-2754e26e9694 00:28:13.542 17:21:10 -- common/autotest_common.sh@1353 -- # local lvs_uuid=493c4419-16fd-499c-8b16-2754e26e9694 00:28:13.542 17:21:10 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:13.542 17:21:10 -- common/autotest_common.sh@1355 -- # local fc 00:28:13.542 17:21:10 -- common/autotest_common.sh@1356 -- # local cs 00:28:13.542 17:21:10 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:13.542 17:21:10 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:13.542 { 00:28:13.542 "uuid": "c2663225-57d4-49b4-a391-ec15bc0134e6", 00:28:13.542 "name": "lvs_0", 00:28:13.542 "base_bdev": "Nvme0n1", 00:28:13.542 "total_data_clusters": 930, 00:28:13.542 "free_clusters": 0, 00:28:13.542 "block_size": 512, 00:28:13.542 "cluster_size": 1073741824 00:28:13.542 }, 00:28:13.542 { 00:28:13.542 "uuid": "493c4419-16fd-499c-8b16-2754e26e9694", 00:28:13.542 "name": "lvs_n_0", 00:28:13.542 "base_bdev": "50dff6b8-3476-456c-9591-21a8eb8098f3", 00:28:13.542 "total_data_clusters": 237847, 00:28:13.542 "free_clusters": 237847, 00:28:13.542 "block_size": 512, 00:28:13.542 "cluster_size": 4194304 00:28:13.542 } 00:28:13.542 ]' 00:28:13.542 17:21:10 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="493c4419-16fd-499c-8b16-2754e26e9694") .free_clusters' 00:28:13.542 17:21:10 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:13.542 17:21:10 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="493c4419-16fd-499c-8b16-2754e26e9694") .cluster_size' 00:28:13.542 17:21:10 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:13.542 17:21:10 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:13.542 17:21:10 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:13.542 951388 00:28:13.542 17:21:10 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:14.477 110438f9-3e8e-4ff4-944f-6549994f3d4e 00:28:14.477 17:21:11 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:14.477 17:21:11 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:14.735 17:21:11 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:14.993 17:21:11 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:14.993 17:21:11 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:14.993 17:21:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:14.993 17:21:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:14.993 17:21:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:14.993 17:21:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:14.993 17:21:11 -- common/autotest_common.sh@1330 -- # shift 00:28:14.993 17:21:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:14.993 17:21:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:14.993 17:21:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:14.993 17:21:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:14.993 17:21:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:14.993 17:21:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:14.993 17:21:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:14.993 17:21:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:15.251 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:15.251 fio-3.35 00:28:15.251 Starting 1 thread 00:28:15.251 EAL: No free 2048 kB hugepages reported on node 1 00:28:17.777 00:28:17.777 test: (groupid=0, jobs=1): err= 0: pid=1847927: Wed Nov 27 17:21:14 2024 00:28:17.777 read: IOPS=6059, BW=23.7MiB/s (24.8MB/s)(47.5MiB/2008msec) 00:28:17.777 slat (nsec): min=1910, max=160036, avg=2615.28, stdev=2408.35 00:28:17.777 clat (usec): min=4021, max=18804, avg=11669.34, stdev=1010.10 00:28:17.777 lat (usec): min=4053, max=18806, avg=11671.96, stdev=1010.00 00:28:17.777 clat percentiles (usec): 00:28:17.777 | 1.00th=[ 9372], 5.00th=[10028], 10.00th=[10421], 20.00th=[10945], 00:28:17.777 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11731], 60.00th=[11863], 00:28:17.777 | 70.00th=[12125], 80.00th=[12518], 90.00th=[12911], 95.00th=[13173], 00:28:17.777 | 99.00th=[13829], 99.50th=[14222], 99.90th=[17433], 99.95th=[17695], 00:28:17.777 | 99.99th=[18744] 00:28:17.777 bw ( KiB/s): min=23041, max=24760, per=99.74%, avg=24176.25, stdev=771.80, samples=4 00:28:17.777 iops : min= 5760, max= 6190, avg=6044.00, stdev=193.07, samples=4 00:28:17.777 write: IOPS=6038, BW=23.6MiB/s (24.7MB/s)(47.4MiB/2008msec); 0 zone resets 00:28:17.777 slat (usec): min=2, max=118, avg= 2.69, stdev= 1.87 00:28:17.777 clat (usec): min=2961, max=17271, avg=9364.32, stdev=876.59 00:28:17.777 lat (usec): min=2971, max=17273, avg=9367.01, stdev=876.57 00:28:17.777 clat percentiles (usec): 00:28:17.777 | 1.00th=[ 7308], 5.00th=[ 8029], 10.00th=[ 8356], 20.00th=[ 8717], 00:28:17.777 | 30.00th=[ 8979], 40.00th=[ 9241], 50.00th=[ 9372], 60.00th=[ 9503], 00:28:17.777 | 70.00th=[ 9765], 80.00th=[10028], 90.00th=[10421], 95.00th=[10683], 00:28:17.777 | 99.00th=[11207], 99.50th=[11469], 99.90th=[15533], 99.95th=[16581], 00:28:17.777 | 99.99th=[17171] 00:28:17.777 bw ( KiB/s): min=24015, max=24192, per=99.91%, avg=24131.75, stdev=83.48, samples=4 00:28:17.777 iops : min= 6003, max= 6048, avg=6032.75, stdev=21.22, samples=4 00:28:17.777 lat (msec) : 4=0.04%, 10=41.53%, 20=58.42% 00:28:17.777 cpu : usr=57.70%, sys=40.41%, ctx=107, majf=0, minf=36 00:28:17.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:17.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:17.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:17.777 issued rwts: total=12168,12125,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:17.777 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:17.777 00:28:17.777 Run status group 0 (all jobs): 00:28:17.777 READ: bw=23.7MiB/s (24.8MB/s), 23.7MiB/s-23.7MiB/s (24.8MB/s-24.8MB/s), io=47.5MiB (49.8MB), run=2008-2008msec 00:28:17.777 WRITE: bw=23.6MiB/s (24.7MB/s), 23.6MiB/s-23.6MiB/s (24.7MB/s-24.7MB/s), io=47.4MiB (49.7MB), run=2008-2008msec 00:28:17.777 17:21:14 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:17.777 17:21:14 -- host/fio.sh@74 -- # sync 00:28:17.777 17:21:14 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:21.958 17:21:18 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:21.959 17:21:18 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:25.231 17:21:21 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:25.231 17:21:21 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:27.125 17:21:23 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:27.125 17:21:23 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:27.125 17:21:23 -- host/fio.sh@86 -- # nvmftestfini 00:28:27.125 17:21:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:27.125 17:21:23 -- nvmf/common.sh@116 -- # sync 00:28:27.125 17:21:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:27.125 17:21:23 -- nvmf/common.sh@119 -- # set +e 00:28:27.125 17:21:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:27.125 17:21:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:27.125 rmmod nvme_tcp 00:28:27.125 rmmod nvme_fabrics 00:28:27.125 rmmod nvme_keyring 00:28:27.125 17:21:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:27.125 17:21:23 -- nvmf/common.sh@123 -- # set -e 00:28:27.125 17:21:23 -- nvmf/common.sh@124 -- # return 0 00:28:27.125 17:21:23 -- nvmf/common.sh@477 -- # '[' -n 1844388 ']' 00:28:27.125 17:21:23 -- nvmf/common.sh@478 -- # killprocess 1844388 00:28:27.125 17:21:23 -- common/autotest_common.sh@936 -- # '[' -z 1844388 ']' 00:28:27.125 17:21:23 -- common/autotest_common.sh@940 -- # kill -0 1844388 00:28:27.125 17:21:23 -- common/autotest_common.sh@941 -- # uname 00:28:27.125 17:21:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.125 17:21:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1844388 00:28:27.125 17:21:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:27.125 17:21:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:27.125 17:21:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1844388' 00:28:27.125 killing process with pid 1844388 00:28:27.125 17:21:23 -- common/autotest_common.sh@955 -- # kill 1844388 00:28:27.125 17:21:23 -- common/autotest_common.sh@960 -- # wait 1844388 00:28:27.384 17:21:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:27.384 17:21:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:27.384 17:21:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:27.384 17:21:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:27.384 17:21:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:27.384 17:21:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:27.384 17:21:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:27.384 17:21:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:29.289 17:21:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:29.289 00:28:29.289 real 0m37.982s 00:28:29.289 user 2m25.430s 00:28:29.289 sys 0m7.231s 00:28:29.289 17:21:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:29.289 17:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:29.289 ************************************ 00:28:29.289 END TEST nvmf_fio_host 00:28:29.289 ************************************ 00:28:29.547 17:21:26 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:29.548 17:21:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:29.548 17:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:29.548 ************************************ 00:28:29.548 START TEST nvmf_failover 00:28:29.548 ************************************ 00:28:29.548 17:21:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:29.548 * Looking for test storage... 00:28:29.548 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:29.548 17:21:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:29.548 17:21:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:29.548 17:21:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:29.548 17:21:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:29.548 17:21:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:29.548 17:21:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:29.548 17:21:26 -- scripts/common.sh@335 -- # IFS=.-: 00:28:29.548 17:21:26 -- scripts/common.sh@335 -- # read -ra ver1 00:28:29.548 17:21:26 -- scripts/common.sh@336 -- # IFS=.-: 00:28:29.548 17:21:26 -- scripts/common.sh@336 -- # read -ra ver2 00:28:29.548 17:21:26 -- scripts/common.sh@337 -- # local 'op=<' 00:28:29.548 17:21:26 -- scripts/common.sh@339 -- # ver1_l=2 00:28:29.548 17:21:26 -- scripts/common.sh@340 -- # ver2_l=1 00:28:29.548 17:21:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:29.548 17:21:26 -- scripts/common.sh@343 -- # case "$op" in 00:28:29.548 17:21:26 -- scripts/common.sh@344 -- # : 1 00:28:29.548 17:21:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:29.548 17:21:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:29.548 17:21:26 -- scripts/common.sh@364 -- # decimal 1 00:28:29.548 17:21:26 -- scripts/common.sh@352 -- # local d=1 00:28:29.548 17:21:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:29.548 17:21:26 -- scripts/common.sh@354 -- # echo 1 00:28:29.548 17:21:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:29.548 17:21:26 -- scripts/common.sh@365 -- # decimal 2 00:28:29.548 17:21:26 -- scripts/common.sh@352 -- # local d=2 00:28:29.548 17:21:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:29.548 17:21:26 -- scripts/common.sh@354 -- # echo 2 00:28:29.548 17:21:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:29.548 17:21:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:29.548 17:21:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:29.548 17:21:26 -- scripts/common.sh@367 -- # return 0 00:28:29.548 17:21:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:29.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.548 --rc genhtml_branch_coverage=1 00:28:29.548 --rc genhtml_function_coverage=1 00:28:29.548 --rc genhtml_legend=1 00:28:29.548 --rc geninfo_all_blocks=1 00:28:29.548 --rc geninfo_unexecuted_blocks=1 00:28:29.548 00:28:29.548 ' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:29.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.548 --rc genhtml_branch_coverage=1 00:28:29.548 --rc genhtml_function_coverage=1 00:28:29.548 --rc genhtml_legend=1 00:28:29.548 --rc geninfo_all_blocks=1 00:28:29.548 --rc geninfo_unexecuted_blocks=1 00:28:29.548 00:28:29.548 ' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:29.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.548 --rc genhtml_branch_coverage=1 00:28:29.548 --rc genhtml_function_coverage=1 00:28:29.548 --rc genhtml_legend=1 00:28:29.548 --rc geninfo_all_blocks=1 00:28:29.548 --rc geninfo_unexecuted_blocks=1 00:28:29.548 00:28:29.548 ' 00:28:29.548 17:21:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:29.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.548 --rc genhtml_branch_coverage=1 00:28:29.548 --rc genhtml_function_coverage=1 00:28:29.548 --rc genhtml_legend=1 00:28:29.548 --rc geninfo_all_blocks=1 00:28:29.548 --rc geninfo_unexecuted_blocks=1 00:28:29.548 00:28:29.548 ' 00:28:29.548 17:21:26 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:29.548 17:21:26 -- nvmf/common.sh@7 -- # uname -s 00:28:29.548 17:21:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:29.548 17:21:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:29.548 17:21:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:29.548 17:21:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:29.548 17:21:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:29.548 17:21:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:29.548 17:21:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:29.548 17:21:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:29.548 17:21:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:29.548 17:21:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:29.548 17:21:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:29.548 17:21:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:29.548 17:21:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:29.548 17:21:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:29.548 17:21:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:29.548 17:21:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:29.548 17:21:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:29.548 17:21:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:29.548 17:21:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:29.548 17:21:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.548 17:21:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.548 17:21:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.548 17:21:26 -- paths/export.sh@5 -- # export PATH 00:28:29.548 17:21:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.548 17:21:26 -- nvmf/common.sh@46 -- # : 0 00:28:29.548 17:21:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:29.548 17:21:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:29.548 17:21:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:29.548 17:21:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:29.548 17:21:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:29.548 17:21:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:29.548 17:21:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:29.548 17:21:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:29.548 17:21:26 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:29.548 17:21:26 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:29.548 17:21:26 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:29.548 17:21:26 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:29.548 17:21:26 -- host/failover.sh@18 -- # nvmftestinit 00:28:29.548 17:21:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:29.548 17:21:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:29.548 17:21:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:29.548 17:21:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:29.548 17:21:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:29.548 17:21:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:29.548 17:21:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:29.548 17:21:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:29.548 17:21:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:29.548 17:21:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:29.548 17:21:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:29.548 17:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:31.448 17:21:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:31.448 17:21:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:31.448 17:21:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:31.448 17:21:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:31.448 17:21:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:31.448 17:21:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:31.448 17:21:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:31.448 17:21:28 -- nvmf/common.sh@294 -- # net_devs=() 00:28:31.448 17:21:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:31.448 17:21:28 -- nvmf/common.sh@295 -- # e810=() 00:28:31.448 17:21:28 -- nvmf/common.sh@295 -- # local -ga e810 00:28:31.448 17:21:28 -- nvmf/common.sh@296 -- # x722=() 00:28:31.448 17:21:28 -- nvmf/common.sh@296 -- # local -ga x722 00:28:31.448 17:21:28 -- nvmf/common.sh@297 -- # mlx=() 00:28:31.448 17:21:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:31.448 17:21:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:31.448 17:21:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:31.448 17:21:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:31.448 17:21:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:31.448 17:21:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:31.448 17:21:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:31.448 17:21:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:31.448 17:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.448 17:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:31.448 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:31.448 17:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.448 17:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.449 17:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:31.449 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:31.449 17:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:31.449 17:21:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:31.449 17:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.449 17:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.449 17:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.449 17:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.449 17:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:31.449 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:31.449 17:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.449 17:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.449 17:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.449 17:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.449 17:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.707 17:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:31.707 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:31.707 17:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.707 17:21:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:31.707 17:21:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:31.707 17:21:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:31.707 17:21:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:31.707 17:21:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:31.707 17:21:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:31.707 17:21:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:31.707 17:21:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:31.707 17:21:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:31.707 17:21:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:31.707 17:21:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:31.707 17:21:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:31.707 17:21:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:31.707 17:21:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:31.707 17:21:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:31.707 17:21:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:31.707 17:21:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:31.707 17:21:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:31.707 17:21:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:31.707 17:21:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:31.707 17:21:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:31.707 17:21:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:31.707 17:21:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:31.707 17:21:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:31.707 17:21:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:31.707 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:31.707 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.300 ms 00:28:31.707 00:28:31.707 --- 10.0.0.2 ping statistics --- 00:28:31.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.707 rtt min/avg/max/mdev = 0.300/0.300/0.300/0.000 ms 00:28:31.707 17:21:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:31.707 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:31.707 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:28:31.707 00:28:31.707 --- 10.0.0.1 ping statistics --- 00:28:31.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.707 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:28:31.707 17:21:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:31.707 17:21:28 -- nvmf/common.sh@410 -- # return 0 00:28:31.707 17:21:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:31.707 17:21:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:31.707 17:21:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:31.707 17:21:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:31.707 17:21:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:31.707 17:21:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:31.707 17:21:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:31.707 17:21:28 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:31.707 17:21:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:31.707 17:21:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:31.707 17:21:28 -- common/autotest_common.sh@10 -- # set +x 00:28:31.707 17:21:28 -- nvmf/common.sh@469 -- # nvmfpid=1851357 00:28:31.707 17:21:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:31.707 17:21:28 -- nvmf/common.sh@470 -- # waitforlisten 1851357 00:28:31.707 17:21:28 -- common/autotest_common.sh@829 -- # '[' -z 1851357 ']' 00:28:31.707 17:21:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:31.707 17:21:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:31.707 17:21:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:31.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:31.707 17:21:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:31.707 17:21:28 -- common/autotest_common.sh@10 -- # set +x 00:28:31.707 [2024-11-27 17:21:28.591216] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:31.707 [2024-11-27 17:21:28.591296] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:31.707 EAL: No free 2048 kB hugepages reported on node 1 00:28:31.707 [2024-11-27 17:21:28.656086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:31.965 [2024-11-27 17:21:28.741192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:31.965 [2024-11-27 17:21:28.741361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:31.965 [2024-11-27 17:21:28.741378] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:31.965 [2024-11-27 17:21:28.741391] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:31.965 [2024-11-27 17:21:28.741488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:31.965 [2024-11-27 17:21:28.741547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:31.965 [2024-11-27 17:21:28.741551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:32.897 17:21:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:32.897 17:21:29 -- common/autotest_common.sh@862 -- # return 0 00:28:32.897 17:21:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:32.897 17:21:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:32.897 17:21:29 -- common/autotest_common.sh@10 -- # set +x 00:28:32.897 17:21:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:32.897 17:21:29 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:32.897 [2024-11-27 17:21:29.821815] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:32.897 17:21:29 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:33.463 Malloc0 00:28:33.463 17:21:30 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:33.463 17:21:30 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:33.721 17:21:30 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:33.978 [2024-11-27 17:21:30.896091] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:33.978 17:21:30 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:34.235 [2024-11-27 17:21:31.148846] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:34.235 17:21:31 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:34.493 [2024-11-27 17:21:31.397660] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:34.493 17:21:31 -- host/failover.sh@31 -- # bdevperf_pid=1851667 00:28:34.493 17:21:31 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:34.493 17:21:31 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:34.493 17:21:31 -- host/failover.sh@34 -- # waitforlisten 1851667 /var/tmp/bdevperf.sock 00:28:34.493 17:21:31 -- common/autotest_common.sh@829 -- # '[' -z 1851667 ']' 00:28:34.493 17:21:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:34.493 17:21:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:34.493 17:21:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:34.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:34.493 17:21:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:34.493 17:21:31 -- common/autotest_common.sh@10 -- # set +x 00:28:35.867 17:21:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:35.867 17:21:32 -- common/autotest_common.sh@862 -- # return 0 00:28:35.867 17:21:32 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:35.867 NVMe0n1 00:28:35.867 17:21:32 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:36.124 00:28:36.382 17:21:33 -- host/failover.sh@39 -- # run_test_pid=1851928 00:28:36.382 17:21:33 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:36.382 17:21:33 -- host/failover.sh@41 -- # sleep 1 00:28:37.444 17:21:34 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:37.444 [2024-11-27 17:21:34.322421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 [2024-11-27 17:21:34.322944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223a180 is same with the state(5) to be set 00:28:37.444 17:21:34 -- host/failover.sh@45 -- # sleep 3 00:28:40.725 17:21:37 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:40.725 00:28:40.983 17:21:37 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:40.983 [2024-11-27 17:21:37.931692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.983 [2024-11-27 17:21:37.931959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.931971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.931982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.931994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:40.984 [2024-11-27 17:21:37.932286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b530 is same with the state(5) to be set 00:28:41.242 17:21:37 -- host/failover.sh@50 -- # sleep 3 00:28:44.524 17:21:40 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:44.524 [2024-11-27 17:21:41.235451] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:44.524 17:21:41 -- host/failover.sh@55 -- # sleep 1 00:28:45.458 17:21:42 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:45.715 [2024-11-27 17:21:42.519180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.715 [2024-11-27 17:21:42.519314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 [2024-11-27 17:21:42.519827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23f15e0 is same with the state(5) to be set 00:28:45.716 17:21:42 -- host/failover.sh@59 -- # wait 1851928 00:28:52.280 0 00:28:52.280 17:21:48 -- host/failover.sh@61 -- # killprocess 1851667 00:28:52.280 17:21:48 -- common/autotest_common.sh@936 -- # '[' -z 1851667 ']' 00:28:52.280 17:21:48 -- common/autotest_common.sh@940 -- # kill -0 1851667 00:28:52.280 17:21:48 -- common/autotest_common.sh@941 -- # uname 00:28:52.280 17:21:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:52.280 17:21:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1851667 00:28:52.280 17:21:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:52.280 17:21:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:52.280 17:21:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1851667' 00:28:52.280 killing process with pid 1851667 00:28:52.280 17:21:48 -- common/autotest_common.sh@955 -- # kill 1851667 00:28:52.280 17:21:48 -- common/autotest_common.sh@960 -- # wait 1851667 00:28:52.280 17:21:48 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:52.280 [2024-11-27 17:21:31.457963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:52.280 [2024-11-27 17:21:31.458043] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1851667 ] 00:28:52.280 EAL: No free 2048 kB hugepages reported on node 1 00:28:52.280 [2024-11-27 17:21:31.518168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:52.280 [2024-11-27 17:21:31.604396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:52.280 Running I/O for 15 seconds... 00:28:52.280 [2024-11-27 17:21:34.323256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.280 [2024-11-27 17:21:34.323298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.280 [2024-11-27 17:21:34.323327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.280 [2024-11-27 17:21:34.323342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.280 [2024-11-27 17:21:34.323359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.280 [2024-11-27 17:21:34.323373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.280 [2024-11-27 17:21:34.323389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.280 [2024-11-27 17:21:34.323411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.323440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.323499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:116856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.323664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:116864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.323693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:116888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.323780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.323983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.323998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:116936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.281 [2024-11-27 17:21:34.324428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:116432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.281 [2024-11-27 17:21:34.324573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.281 [2024-11-27 17:21:34.324587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:116968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.324796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:116976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.324827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:116992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.324892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:117000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.324919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.324950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:117016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.324979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.324994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:117024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:117040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:117056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:117064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:117072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:117080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:117088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:117096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:117112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:117128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:117144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.282 [2024-11-27 17:21:34.325703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:117160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.282 [2024-11-27 17:21:34.325776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.282 [2024-11-27 17:21:34.325790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:117176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.325826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.325854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.325889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.325922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.325951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:117216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.325979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.325994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:117232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:117264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:117272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:117280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:117320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:117336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:117352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:117360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:117368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:117376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:117384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:117392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.283 [2024-11-27 17:21:34.326870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:116704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.283 [2024-11-27 17:21:34.326960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.283 [2024-11-27 17:21:34.326976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:34.326991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:34.327019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:34.327052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:34.327081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:34.327110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9c70 is same with the state(5) to be set 00:28:52.284 [2024-11-27 17:21:34.327142] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:52.284 [2024-11-27 17:21:34.327154] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:52.284 [2024-11-27 17:21:34.327166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116792 len:8 PRP1 0x0 PRP2 0x0 00:28:52.284 [2024-11-27 17:21:34.327179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327240] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18a9c70 was disconnected and freed. reset controller. 00:28:52.284 [2024-11-27 17:21:34.327264] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:52.284 [2024-11-27 17:21:34.327302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.284 [2024-11-27 17:21:34.327320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327334] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.284 [2024-11-27 17:21:34.327347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327360] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.284 [2024-11-27 17:21:34.327373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.284 [2024-11-27 17:21:34.327400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:34.327413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:52.284 [2024-11-27 17:21:34.327464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a600 (9): Bad file descriptor 00:28:52.284 [2024-11-27 17:21:34.329780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:52.284 [2024-11-27 17:21:34.358816] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:52.284 [2024-11-27 17:21:37.932430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:103912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:103920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:103928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:103936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:103952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:103960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:103984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:104000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:104016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:104032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:104040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:104064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:103440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:103464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:103488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.932970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.932997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:103496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:103528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:103552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:103560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:103568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:104080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:104088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:104104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:104120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:103592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:103608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.284 [2024-11-27 17:21:37.933354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.284 [2024-11-27 17:21:37.933373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:103616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:103664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:103688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:103696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:103704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:103744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:104144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:104152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:104176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:104184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:104192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:104200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:104208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:104216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:104224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.933869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:104232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:104240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:104248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:104256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.933981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.933996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:104264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:104272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.934038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:104280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:104288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.934095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:104296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:104304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.934153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:104312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.285 [2024-11-27 17:21:37.934185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:104320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:104328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:104336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.285 [2024-11-27 17:21:37.934287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.285 [2024-11-27 17:21:37.934302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:104344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:104352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:103752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:103768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:103776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:103816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:103824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:103832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:103840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:103872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:104360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:104368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:104376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:104384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:104392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:104400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:104408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:104416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:104424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:104432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:104440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:104448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.934952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:104456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.934980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.934994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:104464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:104472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:104480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:104488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:104496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:104504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:104512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:104520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:104528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:104536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:104544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:104552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:104560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:104568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:104576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:104584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.286 [2024-11-27 17:21:37.935501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:104592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.286 [2024-11-27 17:21:37.935537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.286 [2024-11-27 17:21:37.935553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:104600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:104608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:104616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:104624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:104632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:104640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:104648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:104656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:104664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:104672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:104680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.287 [2024-11-27 17:21:37.935863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:104688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:104696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:104704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.935967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:104712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.935992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:104720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:104728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:103904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:103944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:103968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:103976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:103992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:104008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:104024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:104048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:104056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:104072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:104096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:104112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:104128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:104136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:104160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.287 [2024-11-27 17:21:37.936576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1896a90 is same with the state(5) to be set 00:28:52.287 [2024-11-27 17:21:37.936608] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:52.287 [2024-11-27 17:21:37.936624] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:52.287 [2024-11-27 17:21:37.936651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:104168 len:8 PRP1 0x0 PRP2 0x0 00:28:52.287 [2024-11-27 17:21:37.936675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936742] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1896a90 was disconnected and freed. reset controller. 00:28:52.287 [2024-11-27 17:21:37.936762] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:52.287 [2024-11-27 17:21:37.936797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.287 [2024-11-27 17:21:37.936815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.287 [2024-11-27 17:21:37.936843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.287 [2024-11-27 17:21:37.936870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936884] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.287 [2024-11-27 17:21:37.936898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.287 [2024-11-27 17:21:37.936911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:52.287 [2024-11-27 17:21:37.936948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a600 (9): Bad file descriptor 00:28:52.287 [2024-11-27 17:21:37.939041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:52.288 [2024-11-27 17:21:38.045998] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:52.288 [2024-11-27 17:21:42.519979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:91136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:91160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:91176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:91184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:91200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:91208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:90624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:90632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:90648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:90656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:90672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:90696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:90728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:90736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:91224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:91248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:91256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:91272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:91280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:91296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:91344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:91360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.520697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:91368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.520725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:91376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.520754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:91384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.520782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:90752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:90768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:90784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:90824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:90832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.520973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:90872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.520987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:90880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.521015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:90920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.521043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:91392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.521071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:91400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.521099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:91408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.521127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:91416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.288 [2024-11-27 17:21:42.521156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:91424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.521184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:91432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.288 [2024-11-27 17:21:42.521212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.288 [2024-11-27 17:21:42.521226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:91440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:91448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:91456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:91464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:91472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:91480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:91488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:91496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:91504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:91512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:91520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:91528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:91536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:91544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:91552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:91560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:91568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:91576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:91584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:91592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:91600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.521854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:91608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:91616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:91624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:91632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.521980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:91640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.521994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:91648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:91656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.522049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:91664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.522080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:91672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:91680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:91688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.522163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:91696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:91704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:91712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.289 [2024-11-27 17:21:42.522245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.289 [2024-11-27 17:21:42.522259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:90952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.289 [2024-11-27 17:21:42.522272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:91008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:91016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:91040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:91056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:91080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:91096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:91104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:91720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.522497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:91728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:91736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:91744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:91752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:91760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.522672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:91768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.522701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:91776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:91784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:91792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:91800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:91128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:91144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:91152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:91168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.522977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:91192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.522990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:91216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:91232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:91240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:91808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:91816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:91824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:91832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:91840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:91848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:91856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:91864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:91872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:91880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:91888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.290 [2024-11-27 17:21:42.523381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:91896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:91904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.290 [2024-11-27 17:21:42.523444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.290 [2024-11-27 17:21:42.523459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:91912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:91920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:91928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.291 [2024-11-27 17:21:42.523549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:91936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.291 [2024-11-27 17:21:42.523586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:91944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:91952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:52.291 [2024-11-27 17:21:42.523645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:91264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:91288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:91304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:91312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:91320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:91328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:91336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:52.291 [2024-11-27 17:21:42.523862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.523876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18abc50 is same with the state(5) to be set 00:28:52.291 [2024-11-27 17:21:42.523893] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:52.291 [2024-11-27 17:21:42.523921] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:52.291 [2024-11-27 17:21:42.523938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:91352 len:8 PRP1 0x0 PRP2 0x0 00:28:52.291 [2024-11-27 17:21:42.523951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.524017] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18abc50 was disconnected and freed. reset controller. 00:28:52.291 [2024-11-27 17:21:42.524035] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:52.291 [2024-11-27 17:21:42.524074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.291 [2024-11-27 17:21:42.524093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.524108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.291 [2024-11-27 17:21:42.524121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.524135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.291 [2024-11-27 17:21:42.524147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.524161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:52.291 [2024-11-27 17:21:42.524174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:52.291 [2024-11-27 17:21:42.524187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:52.291 [2024-11-27 17:21:42.524227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a600 (9): Bad file descriptor 00:28:52.291 [2024-11-27 17:21:42.526385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:52.291 [2024-11-27 17:21:42.718060] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:52.291 00:28:52.291 Latency(us) 00:28:52.291 [2024-11-27T16:21:49.242Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:52.291 [2024-11-27T16:21:49.242Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:52.291 Verification LBA range: start 0x0 length 0x4000 00:28:52.291 NVMe0n1 : 15.01 12581.83 49.15 1287.69 0.00 9212.10 573.44 15243.19 00:28:52.291 [2024-11-27T16:21:49.242Z] =================================================================================================================== 00:28:52.291 [2024-11-27T16:21:49.242Z] Total : 12581.83 49.15 1287.69 0.00 9212.10 573.44 15243.19 00:28:52.291 Received shutdown signal, test time was about 15.000000 seconds 00:28:52.291 00:28:52.291 Latency(us) 00:28:52.291 [2024-11-27T16:21:49.242Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:52.291 [2024-11-27T16:21:49.242Z] =================================================================================================================== 00:28:52.291 [2024-11-27T16:21:49.242Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:52.291 17:21:48 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:52.291 17:21:48 -- host/failover.sh@65 -- # count=3 00:28:52.291 17:21:48 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:52.291 17:21:48 -- host/failover.sh@73 -- # bdevperf_pid=1853729 00:28:52.291 17:21:48 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:52.291 17:21:48 -- host/failover.sh@75 -- # waitforlisten 1853729 /var/tmp/bdevperf.sock 00:28:52.291 17:21:48 -- common/autotest_common.sh@829 -- # '[' -z 1853729 ']' 00:28:52.291 17:21:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:52.291 17:21:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:52.291 17:21:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:52.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:52.291 17:21:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:52.291 17:21:48 -- common/autotest_common.sh@10 -- # set +x 00:28:52.856 17:21:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:52.856 17:21:49 -- common/autotest_common.sh@862 -- # return 0 00:28:52.857 17:21:49 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:52.857 [2024-11-27 17:21:49.775886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:52.857 17:21:49 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:53.115 [2024-11-27 17:21:50.024628] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:53.115 17:21:50 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:53.681 NVMe0n1 00:28:53.681 17:21:50 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:53.939 00:28:53.939 17:21:50 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:54.506 00:28:54.506 17:21:51 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:54.506 17:21:51 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:54.506 17:21:51 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:54.764 17:21:51 -- host/failover.sh@87 -- # sleep 3 00:28:58.044 17:21:54 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:58.044 17:21:54 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:58.044 17:21:54 -- host/failover.sh@90 -- # run_test_pid=1854533 00:28:58.044 17:21:54 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:58.044 17:21:54 -- host/failover.sh@92 -- # wait 1854533 00:28:59.420 0 00:28:59.420 17:21:56 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:59.420 [2024-11-27 17:21:48.559047] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:59.420 [2024-11-27 17:21:48.559139] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1853729 ] 00:28:59.420 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.420 [2024-11-27 17:21:48.620564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:59.420 [2024-11-27 17:21:48.704320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:59.420 [2024-11-27 17:21:51.660485] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:59.420 [2024-11-27 17:21:51.660595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.420 [2024-11-27 17:21:51.660619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.420 [2024-11-27 17:21:51.660636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.420 [2024-11-27 17:21:51.660649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.420 [2024-11-27 17:21:51.660663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.420 [2024-11-27 17:21:51.660676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.420 [2024-11-27 17:21:51.660690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.420 [2024-11-27 17:21:51.660703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.420 [2024-11-27 17:21:51.660716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:59.420 [2024-11-27 17:21:51.660751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:59.420 [2024-11-27 17:21:51.660781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18f9600 (9): Bad file descriptor 00:28:59.420 [2024-11-27 17:21:51.671628] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:59.420 Running I/O for 1 seconds... 00:28:59.420 00:28:59.420 Latency(us) 00:28:59.420 [2024-11-27T16:21:56.371Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:59.420 [2024-11-27T16:21:56.371Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:59.420 Verification LBA range: start 0x0 length 0x4000 00:28:59.420 NVMe0n1 : 1.01 12710.74 49.65 0.00 0.00 10022.23 1492.76 16117.00 00:28:59.420 [2024-11-27T16:21:56.371Z] =================================================================================================================== 00:28:59.420 [2024-11-27T16:21:56.371Z] Total : 12710.74 49.65 0.00 0.00 10022.23 1492.76 16117.00 00:28:59.420 17:21:56 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:59.420 17:21:56 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:59.420 17:21:56 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:59.985 17:21:56 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:59.985 17:21:56 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:59.985 17:21:56 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:00.243 17:21:57 -- host/failover.sh@101 -- # sleep 3 00:29:03.522 17:22:00 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:03.522 17:22:00 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:03.522 17:22:00 -- host/failover.sh@108 -- # killprocess 1853729 00:29:03.522 17:22:00 -- common/autotest_common.sh@936 -- # '[' -z 1853729 ']' 00:29:03.522 17:22:00 -- common/autotest_common.sh@940 -- # kill -0 1853729 00:29:03.522 17:22:00 -- common/autotest_common.sh@941 -- # uname 00:29:03.522 17:22:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:03.522 17:22:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1853729 00:29:03.780 17:22:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:03.780 17:22:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:03.780 17:22:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1853729' 00:29:03.780 killing process with pid 1853729 00:29:03.780 17:22:00 -- common/autotest_common.sh@955 -- # kill 1853729 00:29:03.780 17:22:00 -- common/autotest_common.sh@960 -- # wait 1853729 00:29:03.780 17:22:00 -- host/failover.sh@110 -- # sync 00:29:03.780 17:22:00 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:04.038 17:22:00 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:04.038 17:22:00 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:04.038 17:22:00 -- host/failover.sh@116 -- # nvmftestfini 00:29:04.038 17:22:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:04.038 17:22:00 -- nvmf/common.sh@116 -- # sync 00:29:04.038 17:22:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:04.038 17:22:00 -- nvmf/common.sh@119 -- # set +e 00:29:04.038 17:22:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:04.038 17:22:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:04.038 rmmod nvme_tcp 00:29:04.038 rmmod nvme_fabrics 00:29:04.038 rmmod nvme_keyring 00:29:04.296 17:22:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:04.296 17:22:01 -- nvmf/common.sh@123 -- # set -e 00:29:04.296 17:22:01 -- nvmf/common.sh@124 -- # return 0 00:29:04.296 17:22:01 -- nvmf/common.sh@477 -- # '[' -n 1851357 ']' 00:29:04.296 17:22:01 -- nvmf/common.sh@478 -- # killprocess 1851357 00:29:04.296 17:22:01 -- common/autotest_common.sh@936 -- # '[' -z 1851357 ']' 00:29:04.296 17:22:01 -- common/autotest_common.sh@940 -- # kill -0 1851357 00:29:04.296 17:22:01 -- common/autotest_common.sh@941 -- # uname 00:29:04.296 17:22:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:04.296 17:22:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1851357 00:29:04.296 17:22:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:04.296 17:22:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:04.296 17:22:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1851357' 00:29:04.296 killing process with pid 1851357 00:29:04.296 17:22:01 -- common/autotest_common.sh@955 -- # kill 1851357 00:29:04.296 17:22:01 -- common/autotest_common.sh@960 -- # wait 1851357 00:29:04.555 17:22:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:04.555 17:22:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:04.555 17:22:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:04.555 17:22:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:04.555 17:22:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:04.555 17:22:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:04.555 17:22:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:04.555 17:22:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.456 17:22:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:06.456 00:29:06.456 real 0m37.065s 00:29:06.456 user 2m11.890s 00:29:06.456 sys 0m5.742s 00:29:06.456 17:22:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:06.456 17:22:03 -- common/autotest_common.sh@10 -- # set +x 00:29:06.456 ************************************ 00:29:06.456 END TEST nvmf_failover 00:29:06.456 ************************************ 00:29:06.456 17:22:03 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:06.456 17:22:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:06.456 17:22:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:06.456 17:22:03 -- common/autotest_common.sh@10 -- # set +x 00:29:06.456 ************************************ 00:29:06.456 START TEST nvmf_discovery 00:29:06.456 ************************************ 00:29:06.456 17:22:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:06.456 * Looking for test storage... 00:29:06.456 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:06.456 17:22:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:06.456 17:22:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:06.456 17:22:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:06.715 17:22:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:06.715 17:22:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:06.715 17:22:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:06.715 17:22:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:06.715 17:22:03 -- scripts/common.sh@335 -- # IFS=.-: 00:29:06.715 17:22:03 -- scripts/common.sh@335 -- # read -ra ver1 00:29:06.715 17:22:03 -- scripts/common.sh@336 -- # IFS=.-: 00:29:06.715 17:22:03 -- scripts/common.sh@336 -- # read -ra ver2 00:29:06.715 17:22:03 -- scripts/common.sh@337 -- # local 'op=<' 00:29:06.715 17:22:03 -- scripts/common.sh@339 -- # ver1_l=2 00:29:06.715 17:22:03 -- scripts/common.sh@340 -- # ver2_l=1 00:29:06.715 17:22:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:06.715 17:22:03 -- scripts/common.sh@343 -- # case "$op" in 00:29:06.715 17:22:03 -- scripts/common.sh@344 -- # : 1 00:29:06.715 17:22:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:06.715 17:22:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:06.715 17:22:03 -- scripts/common.sh@364 -- # decimal 1 00:29:06.715 17:22:03 -- scripts/common.sh@352 -- # local d=1 00:29:06.715 17:22:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:06.715 17:22:03 -- scripts/common.sh@354 -- # echo 1 00:29:06.715 17:22:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:06.715 17:22:03 -- scripts/common.sh@365 -- # decimal 2 00:29:06.715 17:22:03 -- scripts/common.sh@352 -- # local d=2 00:29:06.715 17:22:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:06.715 17:22:03 -- scripts/common.sh@354 -- # echo 2 00:29:06.715 17:22:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:06.715 17:22:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:06.715 17:22:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:06.715 17:22:03 -- scripts/common.sh@367 -- # return 0 00:29:06.715 17:22:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:06.715 17:22:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:06.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.715 --rc genhtml_branch_coverage=1 00:29:06.715 --rc genhtml_function_coverage=1 00:29:06.715 --rc genhtml_legend=1 00:29:06.715 --rc geninfo_all_blocks=1 00:29:06.715 --rc geninfo_unexecuted_blocks=1 00:29:06.715 00:29:06.715 ' 00:29:06.715 17:22:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:06.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.715 --rc genhtml_branch_coverage=1 00:29:06.715 --rc genhtml_function_coverage=1 00:29:06.715 --rc genhtml_legend=1 00:29:06.715 --rc geninfo_all_blocks=1 00:29:06.715 --rc geninfo_unexecuted_blocks=1 00:29:06.715 00:29:06.715 ' 00:29:06.715 17:22:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:06.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.715 --rc genhtml_branch_coverage=1 00:29:06.715 --rc genhtml_function_coverage=1 00:29:06.715 --rc genhtml_legend=1 00:29:06.715 --rc geninfo_all_blocks=1 00:29:06.715 --rc geninfo_unexecuted_blocks=1 00:29:06.715 00:29:06.715 ' 00:29:06.715 17:22:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:06.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.715 --rc genhtml_branch_coverage=1 00:29:06.715 --rc genhtml_function_coverage=1 00:29:06.715 --rc genhtml_legend=1 00:29:06.715 --rc geninfo_all_blocks=1 00:29:06.715 --rc geninfo_unexecuted_blocks=1 00:29:06.715 00:29:06.715 ' 00:29:06.715 17:22:03 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:06.715 17:22:03 -- nvmf/common.sh@7 -- # uname -s 00:29:06.715 17:22:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:06.715 17:22:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:06.715 17:22:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:06.715 17:22:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:06.715 17:22:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:06.715 17:22:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:06.715 17:22:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:06.715 17:22:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:06.715 17:22:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:06.715 17:22:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:06.715 17:22:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.715 17:22:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.715 17:22:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:06.715 17:22:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:06.715 17:22:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:06.715 17:22:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:06.716 17:22:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:06.716 17:22:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:06.716 17:22:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:06.716 17:22:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.716 17:22:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.716 17:22:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.716 17:22:03 -- paths/export.sh@5 -- # export PATH 00:29:06.716 17:22:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.716 17:22:03 -- nvmf/common.sh@46 -- # : 0 00:29:06.716 17:22:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:06.716 17:22:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:06.716 17:22:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:06.716 17:22:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:06.716 17:22:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:06.716 17:22:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:06.716 17:22:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:06.716 17:22:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:06.716 17:22:03 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:06.716 17:22:03 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:06.716 17:22:03 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:06.716 17:22:03 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:06.716 17:22:03 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:06.716 17:22:03 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:06.716 17:22:03 -- host/discovery.sh@25 -- # nvmftestinit 00:29:06.716 17:22:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:06.716 17:22:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:06.716 17:22:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:06.716 17:22:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:06.716 17:22:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:06.716 17:22:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:06.716 17:22:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:06.716 17:22:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.716 17:22:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:06.716 17:22:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:06.716 17:22:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:06.716 17:22:03 -- common/autotest_common.sh@10 -- # set +x 00:29:08.618 17:22:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:08.618 17:22:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:08.618 17:22:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:08.618 17:22:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:08.618 17:22:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:08.618 17:22:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:08.618 17:22:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:08.618 17:22:05 -- nvmf/common.sh@294 -- # net_devs=() 00:29:08.618 17:22:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:08.618 17:22:05 -- nvmf/common.sh@295 -- # e810=() 00:29:08.618 17:22:05 -- nvmf/common.sh@295 -- # local -ga e810 00:29:08.618 17:22:05 -- nvmf/common.sh@296 -- # x722=() 00:29:08.618 17:22:05 -- nvmf/common.sh@296 -- # local -ga x722 00:29:08.618 17:22:05 -- nvmf/common.sh@297 -- # mlx=() 00:29:08.618 17:22:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:08.618 17:22:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:08.618 17:22:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:08.618 17:22:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:08.618 17:22:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.618 17:22:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:08.618 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:08.618 17:22:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.618 17:22:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:08.618 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:08.618 17:22:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.618 17:22:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.618 17:22:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.618 17:22:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:08.618 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:08.618 17:22:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.618 17:22:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.618 17:22:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.618 17:22:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.618 17:22:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:08.618 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:08.618 17:22:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.618 17:22:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:08.618 17:22:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:08.618 17:22:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:08.618 17:22:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:08.618 17:22:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:08.618 17:22:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:08.618 17:22:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:08.618 17:22:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:08.618 17:22:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:08.619 17:22:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:08.619 17:22:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:08.619 17:22:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:08.619 17:22:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:08.619 17:22:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:08.619 17:22:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:08.619 17:22:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:08.619 17:22:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:08.619 17:22:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:08.619 17:22:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:08.619 17:22:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:08.619 17:22:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:08.619 17:22:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:08.619 17:22:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:08.619 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:08.619 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:29:08.619 00:29:08.619 --- 10.0.0.2 ping statistics --- 00:29:08.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.619 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:29:08.619 17:22:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:08.619 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:08.619 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:29:08.619 00:29:08.619 --- 10.0.0.1 ping statistics --- 00:29:08.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.619 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:29:08.619 17:22:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:08.619 17:22:05 -- nvmf/common.sh@410 -- # return 0 00:29:08.619 17:22:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:08.619 17:22:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:08.619 17:22:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:08.619 17:22:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:08.619 17:22:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:08.619 17:22:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:08.619 17:22:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:08.619 17:22:05 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:08.619 17:22:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:08.619 17:22:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:08.619 17:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:08.619 17:22:05 -- nvmf/common.sh@469 -- # nvmfpid=1857283 00:29:08.619 17:22:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:08.619 17:22:05 -- nvmf/common.sh@470 -- # waitforlisten 1857283 00:29:08.619 17:22:05 -- common/autotest_common.sh@829 -- # '[' -z 1857283 ']' 00:29:08.619 17:22:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:08.619 17:22:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:08.619 17:22:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:08.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:08.619 17:22:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:08.619 17:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:08.877 [2024-11-27 17:22:05.593680] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:08.877 [2024-11-27 17:22:05.593764] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:08.877 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.877 [2024-11-27 17:22:05.661166] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:08.878 [2024-11-27 17:22:05.750194] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:08.878 [2024-11-27 17:22:05.750336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:08.878 [2024-11-27 17:22:05.750355] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:08.878 [2024-11-27 17:22:05.750370] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:08.878 [2024-11-27 17:22:05.750399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:09.811 17:22:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:09.811 17:22:06 -- common/autotest_common.sh@862 -- # return 0 00:29:09.811 17:22:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:09.811 17:22:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:09.811 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 17:22:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:09.812 17:22:06 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:09.812 17:22:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 [2024-11-27 17:22:06.616663] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:09.812 17:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.812 17:22:06 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:09.812 17:22:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 [2024-11-27 17:22:06.624839] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:09.812 17:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.812 17:22:06 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:09.812 17:22:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 null0 00:29:09.812 17:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.812 17:22:06 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:09.812 17:22:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 null1 00:29:09.812 17:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.812 17:22:06 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:09.812 17:22:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 17:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.812 17:22:06 -- host/discovery.sh@45 -- # hostpid=1857407 00:29:09.812 17:22:06 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:09.812 17:22:06 -- host/discovery.sh@46 -- # waitforlisten 1857407 /tmp/host.sock 00:29:09.812 17:22:06 -- common/autotest_common.sh@829 -- # '[' -z 1857407 ']' 00:29:09.812 17:22:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:09.812 17:22:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:09.812 17:22:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:09.812 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:09.812 17:22:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:09.812 17:22:06 -- common/autotest_common.sh@10 -- # set +x 00:29:09.812 [2024-11-27 17:22:06.696642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:09.812 [2024-11-27 17:22:06.696721] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1857407 ] 00:29:09.812 EAL: No free 2048 kB hugepages reported on node 1 00:29:09.812 [2024-11-27 17:22:06.755681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:10.070 [2024-11-27 17:22:06.840465] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:10.070 [2024-11-27 17:22:06.840657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:11.005 17:22:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:11.005 17:22:07 -- common/autotest_common.sh@862 -- # return 0 00:29:11.005 17:22:07 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:11.005 17:22:07 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@72 -- # notify_id=0 00:29:11.005 17:22:07 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # sort 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@79 -- # get_bdev_list 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # sort 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # sort 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@83 -- # get_bdev_list 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # sort 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # sort 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@87 -- # get_bdev_list 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # sort 00:29:11.005 17:22:07 -- host/discovery.sh@55 -- # xargs 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:11.005 17:22:07 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.005 [2024-11-27 17:22:07.944436] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:11.005 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.005 17:22:07 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:11.005 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.005 17:22:07 -- host/discovery.sh@59 -- # sort 00:29:11.005 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.006 17:22:07 -- host/discovery.sh@59 -- # xargs 00:29:11.264 17:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.264 17:22:07 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:11.264 17:22:07 -- host/discovery.sh@93 -- # get_bdev_list 00:29:11.264 17:22:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.264 17:22:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:11.264 17:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.264 17:22:07 -- common/autotest_common.sh@10 -- # set +x 00:29:11.264 17:22:07 -- host/discovery.sh@55 -- # sort 00:29:11.264 17:22:07 -- host/discovery.sh@55 -- # xargs 00:29:11.264 17:22:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.264 17:22:08 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:11.264 17:22:08 -- host/discovery.sh@94 -- # get_notification_count 00:29:11.264 17:22:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:11.264 17:22:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.264 17:22:08 -- host/discovery.sh@74 -- # jq '. | length' 00:29:11.264 17:22:08 -- common/autotest_common.sh@10 -- # set +x 00:29:11.264 17:22:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.264 17:22:08 -- host/discovery.sh@74 -- # notification_count=0 00:29:11.264 17:22:08 -- host/discovery.sh@75 -- # notify_id=0 00:29:11.264 17:22:08 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:11.264 17:22:08 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:11.264 17:22:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.264 17:22:08 -- common/autotest_common.sh@10 -- # set +x 00:29:11.264 17:22:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.264 17:22:08 -- host/discovery.sh@100 -- # sleep 1 00:29:11.831 [2024-11-27 17:22:08.725673] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:11.831 [2024-11-27 17:22:08.725705] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:11.831 [2024-11-27 17:22:08.725729] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:12.089 [2024-11-27 17:22:08.813055] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:12.089 [2024-11-27 17:22:09.038240] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:12.089 [2024-11-27 17:22:09.038267] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:12.347 17:22:09 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:12.347 17:22:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:12.347 17:22:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:12.347 17:22:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.347 17:22:09 -- host/discovery.sh@59 -- # sort 00:29:12.347 17:22:09 -- common/autotest_common.sh@10 -- # set +x 00:29:12.347 17:22:09 -- host/discovery.sh@59 -- # xargs 00:29:12.347 17:22:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@102 -- # get_bdev_list 00:29:12.347 17:22:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:12.347 17:22:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.347 17:22:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:12.347 17:22:09 -- common/autotest_common.sh@10 -- # set +x 00:29:12.347 17:22:09 -- host/discovery.sh@55 -- # sort 00:29:12.347 17:22:09 -- host/discovery.sh@55 -- # xargs 00:29:12.347 17:22:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:12.347 17:22:09 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:12.347 17:22:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.347 17:22:09 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:12.347 17:22:09 -- common/autotest_common.sh@10 -- # set +x 00:29:12.347 17:22:09 -- host/discovery.sh@63 -- # sort -n 00:29:12.347 17:22:09 -- host/discovery.sh@63 -- # xargs 00:29:12.347 17:22:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@104 -- # get_notification_count 00:29:12.347 17:22:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:12.347 17:22:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.347 17:22:09 -- host/discovery.sh@74 -- # jq '. | length' 00:29:12.347 17:22:09 -- common/autotest_common.sh@10 -- # set +x 00:29:12.347 17:22:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@74 -- # notification_count=1 00:29:12.347 17:22:09 -- host/discovery.sh@75 -- # notify_id=1 00:29:12.347 17:22:09 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:12.347 17:22:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.347 17:22:09 -- common/autotest_common.sh@10 -- # set +x 00:29:12.347 17:22:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.347 17:22:09 -- host/discovery.sh@109 -- # sleep 1 00:29:13.720 17:22:10 -- host/discovery.sh@110 -- # get_bdev_list 00:29:13.720 17:22:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:13.720 17:22:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:13.720 17:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.720 17:22:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.720 17:22:10 -- host/discovery.sh@55 -- # sort 00:29:13.720 17:22:10 -- host/discovery.sh@55 -- # xargs 00:29:13.720 17:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.720 17:22:10 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:13.720 17:22:10 -- host/discovery.sh@111 -- # get_notification_count 00:29:13.720 17:22:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:13.720 17:22:10 -- host/discovery.sh@74 -- # jq '. | length' 00:29:13.720 17:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.720 17:22:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.720 17:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.720 17:22:10 -- host/discovery.sh@74 -- # notification_count=1 00:29:13.720 17:22:10 -- host/discovery.sh@75 -- # notify_id=2 00:29:13.720 17:22:10 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:13.720 17:22:10 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:13.720 17:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.720 17:22:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.720 [2024-11-27 17:22:10.339831] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:13.720 [2024-11-27 17:22:10.340957] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:13.720 [2024-11-27 17:22:10.341003] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:13.720 17:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.720 17:22:10 -- host/discovery.sh@117 -- # sleep 1 00:29:13.720 [2024-11-27 17:22:10.467346] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:13.978 [2024-11-27 17:22:10.732728] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:13.978 [2024-11-27 17:22:10.732762] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:13.978 [2024-11-27 17:22:10.732772] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:14.543 17:22:11 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:14.543 17:22:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:14.543 17:22:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:14.543 17:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 17:22:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 17:22:11 -- host/discovery.sh@59 -- # sort 00:29:14.543 17:22:11 -- host/discovery.sh@59 -- # xargs 00:29:14.543 17:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@119 -- # get_bdev_list 00:29:14.543 17:22:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:14.543 17:22:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:14.543 17:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 17:22:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 17:22:11 -- host/discovery.sh@55 -- # sort 00:29:14.543 17:22:11 -- host/discovery.sh@55 -- # xargs 00:29:14.543 17:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:14.543 17:22:11 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:14.543 17:22:11 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:14.543 17:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 17:22:11 -- host/discovery.sh@63 -- # sort -n 00:29:14.543 17:22:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 17:22:11 -- host/discovery.sh@63 -- # xargs 00:29:14.543 17:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:14.543 17:22:11 -- host/discovery.sh@121 -- # get_notification_count 00:29:14.543 17:22:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:14.543 17:22:11 -- host/discovery.sh@74 -- # jq '. | length' 00:29:14.543 17:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 17:22:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 17:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.802 17:22:11 -- host/discovery.sh@74 -- # notification_count=0 00:29:14.802 17:22:11 -- host/discovery.sh@75 -- # notify_id=2 00:29:14.802 17:22:11 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:14.802 17:22:11 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:14.802 17:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.802 17:22:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.802 [2024-11-27 17:22:11.523669] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:14.802 [2024-11-27 17:22:11.523713] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:14.802 17:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.802 17:22:11 -- host/discovery.sh@127 -- # sleep 1 00:29:14.802 [2024-11-27 17:22:11.531925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:14.802 [2024-11-27 17:22:11.531966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:14.802 [2024-11-27 17:22:11.531985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:14.802 [2024-11-27 17:22:11.532001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:14.802 [2024-11-27 17:22:11.532016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:14.802 [2024-11-27 17:22:11.532031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:14.802 [2024-11-27 17:22:11.532047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:14.802 [2024-11-27 17:22:11.532062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:14.802 [2024-11-27 17:22:11.532076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.802 [2024-11-27 17:22:11.541925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.802 [2024-11-27 17:22:11.551975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.802 [2024-11-27 17:22:11.552198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.802 [2024-11-27 17:22:11.552347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.802 [2024-11-27 17:22:11.552374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.802 [2024-11-27 17:22:11.552391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.802 [2024-11-27 17:22:11.552415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.802 [2024-11-27 17:22:11.552437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.802 [2024-11-27 17:22:11.552451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.802 [2024-11-27 17:22:11.552487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.802 [2024-11-27 17:22:11.552509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.802 [2024-11-27 17:22:11.562063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.802 [2024-11-27 17:22:11.562227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.802 [2024-11-27 17:22:11.562392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.802 [2024-11-27 17:22:11.562417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.803 [2024-11-27 17:22:11.562433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.803 [2024-11-27 17:22:11.562480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.803 [2024-11-27 17:22:11.562504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.803 [2024-11-27 17:22:11.562519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.803 [2024-11-27 17:22:11.562542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.803 [2024-11-27 17:22:11.562579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.803 [2024-11-27 17:22:11.572139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.803 [2024-11-27 17:22:11.572300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.572450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.572478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.803 [2024-11-27 17:22:11.572495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.803 [2024-11-27 17:22:11.572519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.803 [2024-11-27 17:22:11.572555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.803 [2024-11-27 17:22:11.572585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.803 [2024-11-27 17:22:11.572598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.803 [2024-11-27 17:22:11.572617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.803 [2024-11-27 17:22:11.582217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.803 [2024-11-27 17:22:11.582401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.582536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.582580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.803 [2024-11-27 17:22:11.582596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.803 [2024-11-27 17:22:11.582617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.803 [2024-11-27 17:22:11.582637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.803 [2024-11-27 17:22:11.582650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.803 [2024-11-27 17:22:11.582662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.803 [2024-11-27 17:22:11.582680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.803 [2024-11-27 17:22:11.592292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.803 [2024-11-27 17:22:11.592485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.592698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.592724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.803 [2024-11-27 17:22:11.592739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.803 [2024-11-27 17:22:11.592761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.803 [2024-11-27 17:22:11.592786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.803 [2024-11-27 17:22:11.592817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.803 [2024-11-27 17:22:11.592832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.803 [2024-11-27 17:22:11.592852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.803 [2024-11-27 17:22:11.602368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:14.803 [2024-11-27 17:22:11.602554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.602677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:14.803 [2024-11-27 17:22:11.602703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd47b80 with addr=10.0.0.2, port=4420 00:29:14.803 [2024-11-27 17:22:11.602718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd47b80 is same with the state(5) to be set 00:29:14.803 [2024-11-27 17:22:11.602740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd47b80 (9): Bad file descriptor 00:29:14.803 [2024-11-27 17:22:11.602760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:14.803 [2024-11-27 17:22:11.602773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:14.803 [2024-11-27 17:22:11.602786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:14.803 [2024-11-27 17:22:11.602804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:14.803 [2024-11-27 17:22:11.609947] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:14.803 [2024-11-27 17:22:11.609993] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:15.746 17:22:12 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:15.746 17:22:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:15.746 17:22:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.746 17:22:12 -- common/autotest_common.sh@10 -- # set +x 00:29:15.746 17:22:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:15.746 17:22:12 -- host/discovery.sh@59 -- # sort 00:29:15.746 17:22:12 -- host/discovery.sh@59 -- # xargs 00:29:15.746 17:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@129 -- # get_bdev_list 00:29:15.746 17:22:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.746 17:22:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.746 17:22:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:15.746 17:22:12 -- common/autotest_common.sh@10 -- # set +x 00:29:15.746 17:22:12 -- host/discovery.sh@55 -- # sort 00:29:15.746 17:22:12 -- host/discovery.sh@55 -- # xargs 00:29:15.746 17:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:15.746 17:22:12 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:15.746 17:22:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.746 17:22:12 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:15.746 17:22:12 -- common/autotest_common.sh@10 -- # set +x 00:29:15.746 17:22:12 -- host/discovery.sh@63 -- # sort -n 00:29:15.746 17:22:12 -- host/discovery.sh@63 -- # xargs 00:29:15.746 17:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@131 -- # get_notification_count 00:29:15.746 17:22:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:15.746 17:22:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.746 17:22:12 -- common/autotest_common.sh@10 -- # set +x 00:29:15.746 17:22:12 -- host/discovery.sh@74 -- # jq '. | length' 00:29:15.746 17:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@74 -- # notification_count=0 00:29:15.746 17:22:12 -- host/discovery.sh@75 -- # notify_id=2 00:29:15.746 17:22:12 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:15.746 17:22:12 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:15.746 17:22:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.746 17:22:12 -- common/autotest_common.sh@10 -- # set +x 00:29:16.004 17:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.005 17:22:12 -- host/discovery.sh@135 -- # sleep 1 00:29:16.988 17:22:13 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:16.988 17:22:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:16.988 17:22:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:16.988 17:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.988 17:22:13 -- common/autotest_common.sh@10 -- # set +x 00:29:16.988 17:22:13 -- host/discovery.sh@59 -- # sort 00:29:16.988 17:22:13 -- host/discovery.sh@59 -- # xargs 00:29:16.988 17:22:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.988 17:22:13 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:16.988 17:22:13 -- host/discovery.sh@137 -- # get_bdev_list 00:29:16.988 17:22:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:16.988 17:22:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:16.988 17:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.988 17:22:13 -- common/autotest_common.sh@10 -- # set +x 00:29:16.988 17:22:13 -- host/discovery.sh@55 -- # sort 00:29:16.988 17:22:13 -- host/discovery.sh@55 -- # xargs 00:29:16.988 17:22:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.988 17:22:13 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:16.988 17:22:13 -- host/discovery.sh@138 -- # get_notification_count 00:29:16.988 17:22:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:16.988 17:22:13 -- host/discovery.sh@74 -- # jq '. | length' 00:29:16.988 17:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.988 17:22:13 -- common/autotest_common.sh@10 -- # set +x 00:29:16.988 17:22:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.988 17:22:13 -- host/discovery.sh@74 -- # notification_count=2 00:29:16.988 17:22:13 -- host/discovery.sh@75 -- # notify_id=4 00:29:16.988 17:22:13 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:16.988 17:22:13 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.988 17:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.988 17:22:13 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 [2024-11-27 17:22:14.882682] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:18.361 [2024-11-27 17:22:14.882708] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:18.361 [2024-11-27 17:22:14.882731] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:18.361 [2024-11-27 17:22:14.969030] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:18.361 [2024-11-27 17:22:15.078292] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:18.361 [2024-11-27 17:22:15.078333] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@650 -- # local es=0 00:29:18.361 17:22:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 request: 00:29:18.361 { 00:29:18.361 "name": "nvme", 00:29:18.361 "trtype": "tcp", 00:29:18.361 "traddr": "10.0.0.2", 00:29:18.361 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:18.361 "adrfam": "ipv4", 00:29:18.361 "trsvcid": "8009", 00:29:18.361 "wait_for_attach": true, 00:29:18.361 "method": "bdev_nvme_start_discovery", 00:29:18.361 "req_id": 1 00:29:18.361 } 00:29:18.361 Got JSON-RPC error response 00:29:18.361 response: 00:29:18.361 { 00:29:18.361 "code": -17, 00:29:18.361 "message": "File exists" 00:29:18.361 } 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:18.361 17:22:15 -- common/autotest_common.sh@653 -- # es=1 00:29:18.361 17:22:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:18.361 17:22:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:18.361 17:22:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:18.361 17:22:15 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # sort 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # xargs 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:18.361 17:22:15 -- host/discovery.sh@147 -- # get_bdev_list 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # sort 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # xargs 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@650 -- # local es=0 00:29:18.361 17:22:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 request: 00:29:18.361 { 00:29:18.361 "name": "nvme_second", 00:29:18.361 "trtype": "tcp", 00:29:18.361 "traddr": "10.0.0.2", 00:29:18.361 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:18.361 "adrfam": "ipv4", 00:29:18.361 "trsvcid": "8009", 00:29:18.361 "wait_for_attach": true, 00:29:18.361 "method": "bdev_nvme_start_discovery", 00:29:18.361 "req_id": 1 00:29:18.361 } 00:29:18.361 Got JSON-RPC error response 00:29:18.361 response: 00:29:18.361 { 00:29:18.361 "code": -17, 00:29:18.361 "message": "File exists" 00:29:18.361 } 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:18.361 17:22:15 -- common/autotest_common.sh@653 -- # es=1 00:29:18.361 17:22:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:18.361 17:22:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:18.361 17:22:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:18.361 17:22:15 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # sort 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 17:22:15 -- host/discovery.sh@67 -- # xargs 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:18.361 17:22:15 -- host/discovery.sh@153 -- # get_bdev_list 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # sort 00:29:18.361 17:22:15 -- host/discovery.sh@55 -- # xargs 00:29:18.361 17:22:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:18.361 17:22:15 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:18.361 17:22:15 -- common/autotest_common.sh@650 -- # local es=0 00:29:18.361 17:22:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:18.361 17:22:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:18.361 17:22:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:18.361 17:22:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:18.361 17:22:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.361 17:22:15 -- common/autotest_common.sh@10 -- # set +x 00:29:19.734 [2024-11-27 17:22:16.297746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:19.734 [2024-11-27 17:22:16.297910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:19.734 [2024-11-27 17:22:16.297939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd7f3c0 with addr=10.0.0.2, port=8010 00:29:19.734 [2024-11-27 17:22:16.297962] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:19.734 [2024-11-27 17:22:16.297977] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:19.734 [2024-11-27 17:22:16.297990] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:20.666 [2024-11-27 17:22:17.300165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:20.666 [2024-11-27 17:22:17.300294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:20.666 [2024-11-27 17:22:17.300323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd7f3c0 with addr=10.0.0.2, port=8010 00:29:20.666 [2024-11-27 17:22:17.300344] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:20.666 [2024-11-27 17:22:17.300358] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:20.666 [2024-11-27 17:22:17.300372] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:21.598 [2024-11-27 17:22:18.302437] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:21.598 request: 00:29:21.598 { 00:29:21.598 "name": "nvme_second", 00:29:21.598 "trtype": "tcp", 00:29:21.598 "traddr": "10.0.0.2", 00:29:21.598 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:21.598 "adrfam": "ipv4", 00:29:21.598 "trsvcid": "8010", 00:29:21.598 "attach_timeout_ms": 3000, 00:29:21.598 "method": "bdev_nvme_start_discovery", 00:29:21.598 "req_id": 1 00:29:21.598 } 00:29:21.598 Got JSON-RPC error response 00:29:21.598 response: 00:29:21.598 { 00:29:21.598 "code": -110, 00:29:21.598 "message": "Connection timed out" 00:29:21.598 } 00:29:21.598 17:22:18 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:21.598 17:22:18 -- common/autotest_common.sh@653 -- # es=1 00:29:21.598 17:22:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:21.598 17:22:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:21.598 17:22:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:21.598 17:22:18 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:21.598 17:22:18 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:21.598 17:22:18 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:21.598 17:22:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.598 17:22:18 -- host/discovery.sh@67 -- # sort 00:29:21.598 17:22:18 -- common/autotest_common.sh@10 -- # set +x 00:29:21.598 17:22:18 -- host/discovery.sh@67 -- # xargs 00:29:21.598 17:22:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.598 17:22:18 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:21.598 17:22:18 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:21.598 17:22:18 -- host/discovery.sh@162 -- # kill 1857407 00:29:21.598 17:22:18 -- host/discovery.sh@163 -- # nvmftestfini 00:29:21.598 17:22:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:21.598 17:22:18 -- nvmf/common.sh@116 -- # sync 00:29:21.598 17:22:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:21.598 17:22:18 -- nvmf/common.sh@119 -- # set +e 00:29:21.598 17:22:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:21.598 17:22:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:21.598 rmmod nvme_tcp 00:29:21.598 rmmod nvme_fabrics 00:29:21.598 rmmod nvme_keyring 00:29:21.598 17:22:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:21.598 17:22:18 -- nvmf/common.sh@123 -- # set -e 00:29:21.598 17:22:18 -- nvmf/common.sh@124 -- # return 0 00:29:21.598 17:22:18 -- nvmf/common.sh@477 -- # '[' -n 1857283 ']' 00:29:21.598 17:22:18 -- nvmf/common.sh@478 -- # killprocess 1857283 00:29:21.598 17:22:18 -- common/autotest_common.sh@936 -- # '[' -z 1857283 ']' 00:29:21.599 17:22:18 -- common/autotest_common.sh@940 -- # kill -0 1857283 00:29:21.599 17:22:18 -- common/autotest_common.sh@941 -- # uname 00:29:21.599 17:22:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:21.599 17:22:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1857283 00:29:21.599 17:22:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:21.599 17:22:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:21.599 17:22:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1857283' 00:29:21.599 killing process with pid 1857283 00:29:21.599 17:22:18 -- common/autotest_common.sh@955 -- # kill 1857283 00:29:21.599 17:22:18 -- common/autotest_common.sh@960 -- # wait 1857283 00:29:21.856 17:22:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:21.856 17:22:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:21.856 17:22:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:21.856 17:22:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:21.856 17:22:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:21.856 17:22:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:21.857 17:22:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:21.857 17:22:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.387 17:22:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:24.387 00:29:24.387 real 0m17.389s 00:29:24.387 user 0m27.114s 00:29:24.387 sys 0m2.818s 00:29:24.387 17:22:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:24.387 17:22:20 -- common/autotest_common.sh@10 -- # set +x 00:29:24.387 ************************************ 00:29:24.387 END TEST nvmf_discovery 00:29:24.387 ************************************ 00:29:24.387 17:22:20 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:24.387 17:22:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:24.387 17:22:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:24.387 17:22:20 -- common/autotest_common.sh@10 -- # set +x 00:29:24.387 ************************************ 00:29:24.387 START TEST nvmf_discovery_remove_ifc 00:29:24.387 ************************************ 00:29:24.387 17:22:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:24.387 * Looking for test storage... 00:29:24.387 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:24.387 17:22:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:24.387 17:22:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:24.387 17:22:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:24.387 17:22:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:24.387 17:22:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:24.387 17:22:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:24.387 17:22:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:24.387 17:22:20 -- scripts/common.sh@335 -- # IFS=.-: 00:29:24.387 17:22:20 -- scripts/common.sh@335 -- # read -ra ver1 00:29:24.387 17:22:20 -- scripts/common.sh@336 -- # IFS=.-: 00:29:24.387 17:22:20 -- scripts/common.sh@336 -- # read -ra ver2 00:29:24.387 17:22:20 -- scripts/common.sh@337 -- # local 'op=<' 00:29:24.387 17:22:20 -- scripts/common.sh@339 -- # ver1_l=2 00:29:24.387 17:22:20 -- scripts/common.sh@340 -- # ver2_l=1 00:29:24.387 17:22:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:24.387 17:22:20 -- scripts/common.sh@343 -- # case "$op" in 00:29:24.387 17:22:20 -- scripts/common.sh@344 -- # : 1 00:29:24.387 17:22:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:24.387 17:22:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:24.387 17:22:20 -- scripts/common.sh@364 -- # decimal 1 00:29:24.387 17:22:20 -- scripts/common.sh@352 -- # local d=1 00:29:24.387 17:22:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:24.387 17:22:20 -- scripts/common.sh@354 -- # echo 1 00:29:24.387 17:22:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:24.387 17:22:20 -- scripts/common.sh@365 -- # decimal 2 00:29:24.387 17:22:20 -- scripts/common.sh@352 -- # local d=2 00:29:24.387 17:22:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:24.387 17:22:20 -- scripts/common.sh@354 -- # echo 2 00:29:24.387 17:22:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:24.387 17:22:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:24.387 17:22:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:24.387 17:22:20 -- scripts/common.sh@367 -- # return 0 00:29:24.387 17:22:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:24.387 17:22:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:24.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.387 --rc genhtml_branch_coverage=1 00:29:24.387 --rc genhtml_function_coverage=1 00:29:24.387 --rc genhtml_legend=1 00:29:24.387 --rc geninfo_all_blocks=1 00:29:24.388 --rc geninfo_unexecuted_blocks=1 00:29:24.388 00:29:24.388 ' 00:29:24.388 17:22:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:24.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.388 --rc genhtml_branch_coverage=1 00:29:24.388 --rc genhtml_function_coverage=1 00:29:24.388 --rc genhtml_legend=1 00:29:24.388 --rc geninfo_all_blocks=1 00:29:24.388 --rc geninfo_unexecuted_blocks=1 00:29:24.388 00:29:24.388 ' 00:29:24.388 17:22:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:24.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.388 --rc genhtml_branch_coverage=1 00:29:24.388 --rc genhtml_function_coverage=1 00:29:24.388 --rc genhtml_legend=1 00:29:24.388 --rc geninfo_all_blocks=1 00:29:24.388 --rc geninfo_unexecuted_blocks=1 00:29:24.388 00:29:24.388 ' 00:29:24.388 17:22:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:24.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.388 --rc genhtml_branch_coverage=1 00:29:24.388 --rc genhtml_function_coverage=1 00:29:24.388 --rc genhtml_legend=1 00:29:24.388 --rc geninfo_all_blocks=1 00:29:24.388 --rc geninfo_unexecuted_blocks=1 00:29:24.388 00:29:24.388 ' 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:24.388 17:22:20 -- nvmf/common.sh@7 -- # uname -s 00:29:24.388 17:22:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:24.388 17:22:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:24.388 17:22:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:24.388 17:22:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:24.388 17:22:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:24.388 17:22:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:24.388 17:22:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:24.388 17:22:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:24.388 17:22:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:24.388 17:22:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:24.388 17:22:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:24.388 17:22:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:24.388 17:22:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:24.388 17:22:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:24.388 17:22:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:24.388 17:22:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:24.388 17:22:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:24.388 17:22:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:24.388 17:22:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:24.388 17:22:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.388 17:22:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.388 17:22:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.388 17:22:20 -- paths/export.sh@5 -- # export PATH 00:29:24.388 17:22:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.388 17:22:20 -- nvmf/common.sh@46 -- # : 0 00:29:24.388 17:22:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:24.388 17:22:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:24.388 17:22:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:24.388 17:22:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:24.388 17:22:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:24.388 17:22:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:24.388 17:22:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:24.388 17:22:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:24.388 17:22:20 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:24.388 17:22:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:24.388 17:22:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:24.388 17:22:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:24.388 17:22:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:24.388 17:22:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:24.388 17:22:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:24.388 17:22:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:24.388 17:22:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.388 17:22:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:24.388 17:22:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:24.388 17:22:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:24.388 17:22:20 -- common/autotest_common.sh@10 -- # set +x 00:29:26.288 17:22:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:26.289 17:22:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:26.289 17:22:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:26.289 17:22:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:26.289 17:22:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:26.289 17:22:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:26.289 17:22:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:26.289 17:22:22 -- nvmf/common.sh@294 -- # net_devs=() 00:29:26.289 17:22:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:26.289 17:22:22 -- nvmf/common.sh@295 -- # e810=() 00:29:26.289 17:22:22 -- nvmf/common.sh@295 -- # local -ga e810 00:29:26.289 17:22:22 -- nvmf/common.sh@296 -- # x722=() 00:29:26.289 17:22:22 -- nvmf/common.sh@296 -- # local -ga x722 00:29:26.289 17:22:22 -- nvmf/common.sh@297 -- # mlx=() 00:29:26.289 17:22:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:26.289 17:22:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:26.289 17:22:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:26.289 17:22:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:26.289 17:22:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:26.289 17:22:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:26.289 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:26.289 17:22:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:26.289 17:22:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:26.289 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:26.289 17:22:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:26.289 17:22:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:26.289 17:22:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:26.289 17:22:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:26.289 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:26.289 17:22:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:26.289 17:22:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:26.289 17:22:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:26.289 17:22:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:26.289 17:22:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:26.289 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:26.289 17:22:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:26.289 17:22:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:26.289 17:22:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:26.289 17:22:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:26.289 17:22:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:26.289 17:22:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:26.289 17:22:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:26.289 17:22:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:26.289 17:22:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:26.289 17:22:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:26.289 17:22:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:26.289 17:22:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:26.289 17:22:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:26.289 17:22:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:26.289 17:22:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:26.289 17:22:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:26.289 17:22:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:26.289 17:22:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:26.289 17:22:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:26.289 17:22:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:26.289 17:22:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:26.289 17:22:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:26.289 17:22:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:26.289 17:22:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:26.289 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:26.289 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.324 ms 00:29:26.289 00:29:26.289 --- 10.0.0.2 ping statistics --- 00:29:26.289 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:26.289 rtt min/avg/max/mdev = 0.324/0.324/0.324/0.000 ms 00:29:26.289 17:22:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:26.289 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:26.289 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:29:26.289 00:29:26.289 --- 10.0.0.1 ping statistics --- 00:29:26.289 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:26.289 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:29:26.289 17:22:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:26.289 17:22:23 -- nvmf/common.sh@410 -- # return 0 00:29:26.289 17:22:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:26.289 17:22:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:26.289 17:22:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:26.289 17:22:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:26.289 17:22:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:26.289 17:22:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:26.289 17:22:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:26.289 17:22:23 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:26.289 17:22:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:26.289 17:22:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:26.289 17:22:23 -- common/autotest_common.sh@10 -- # set +x 00:29:26.289 17:22:23 -- nvmf/common.sh@469 -- # nvmfpid=1860927 00:29:26.289 17:22:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:26.289 17:22:23 -- nvmf/common.sh@470 -- # waitforlisten 1860927 00:29:26.289 17:22:23 -- common/autotest_common.sh@829 -- # '[' -z 1860927 ']' 00:29:26.289 17:22:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:26.289 17:22:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:26.289 17:22:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:26.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:26.289 17:22:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:26.289 17:22:23 -- common/autotest_common.sh@10 -- # set +x 00:29:26.289 [2024-11-27 17:22:23.184759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:26.289 [2024-11-27 17:22:23.184845] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:26.289 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.547 [2024-11-27 17:22:23.252648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:26.547 [2024-11-27 17:22:23.339642] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:26.547 [2024-11-27 17:22:23.339815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:26.547 [2024-11-27 17:22:23.339833] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:26.547 [2024-11-27 17:22:23.339847] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:26.547 [2024-11-27 17:22:23.339877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:27.481 17:22:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:27.481 17:22:24 -- common/autotest_common.sh@862 -- # return 0 00:29:27.481 17:22:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:27.481 17:22:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:27.481 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:27.481 17:22:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:27.481 17:22:24 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:27.481 17:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.481 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:27.481 [2024-11-27 17:22:24.212370] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:27.481 [2024-11-27 17:22:24.220569] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:27.481 null0 00:29:27.481 [2024-11-27 17:22:24.252516] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:27.481 17:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.481 17:22:24 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1861084 00:29:27.481 17:22:24 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:27.481 17:22:24 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1861084 /tmp/host.sock 00:29:27.481 17:22:24 -- common/autotest_common.sh@829 -- # '[' -z 1861084 ']' 00:29:27.481 17:22:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:27.481 17:22:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:27.481 17:22:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:27.481 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:27.481 17:22:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:27.481 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:27.481 [2024-11-27 17:22:24.315874] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:27.481 [2024-11-27 17:22:24.315949] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1861084 ] 00:29:27.481 EAL: No free 2048 kB hugepages reported on node 1 00:29:27.481 [2024-11-27 17:22:24.381923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:27.739 [2024-11-27 17:22:24.470411] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:27.739 [2024-11-27 17:22:24.470606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:27.739 17:22:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:27.739 17:22:24 -- common/autotest_common.sh@862 -- # return 0 00:29:27.739 17:22:24 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:27.739 17:22:24 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:27.740 17:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.740 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:27.740 17:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.740 17:22:24 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:27.740 17:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.740 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:27.740 17:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.740 17:22:24 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:27.740 17:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.740 17:22:24 -- common/autotest_common.sh@10 -- # set +x 00:29:29.113 [2024-11-27 17:22:25.680711] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:29.113 [2024-11-27 17:22:25.680739] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:29.113 [2024-11-27 17:22:25.680763] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:29.113 [2024-11-27 17:22:25.767052] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:29.113 [2024-11-27 17:22:25.830608] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:29.113 [2024-11-27 17:22:25.830654] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:29.113 [2024-11-27 17:22:25.830691] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:29.113 [2024-11-27 17:22:25.830715] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:29.113 [2024-11-27 17:22:25.830738] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:29.113 17:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.113 17:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.113 17:22:25 -- common/autotest_common.sh@10 -- # set +x 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.113 [2024-11-27 17:22:25.838372] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x24384b0 was disconnected and freed. delete nvme_qpair. 00:29:29.113 17:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.113 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.114 17:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.114 17:22:25 -- common/autotest_common.sh@10 -- # set +x 00:29:29.114 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.114 17:22:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.114 17:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.114 17:22:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:29.114 17:22:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:30.048 17:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.048 17:22:26 -- common/autotest_common.sh@10 -- # set +x 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:30.048 17:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:30.048 17:22:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:31.421 17:22:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:31.421 17:22:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:31.421 17:22:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:31.421 17:22:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.421 17:22:27 -- common/autotest_common.sh@10 -- # set +x 00:29:31.421 17:22:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:31.421 17:22:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:31.421 17:22:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.421 17:22:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:31.421 17:22:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:32.354 17:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.354 17:22:29 -- common/autotest_common.sh@10 -- # set +x 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:32.354 17:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:32.354 17:22:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:33.286 17:22:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.286 17:22:30 -- common/autotest_common.sh@10 -- # set +x 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:33.286 17:22:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:33.286 17:22:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:34.220 17:22:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.220 17:22:31 -- common/autotest_common.sh@10 -- # set +x 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:34.220 17:22:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:34.220 17:22:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:34.478 [2024-11-27 17:22:31.271796] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:34.478 [2024-11-27 17:22:31.271871] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:34.478 [2024-11-27 17:22:31.271893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:34.478 [2024-11-27 17:22:31.271925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:34.478 [2024-11-27 17:22:31.271938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:34.478 [2024-11-27 17:22:31.271951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:34.478 [2024-11-27 17:22:31.271979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:34.478 [2024-11-27 17:22:31.271995] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:34.478 [2024-11-27 17:22:31.272010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:34.478 [2024-11-27 17:22:31.272035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:34.478 [2024-11-27 17:22:31.272050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:34.478 [2024-11-27 17:22:31.272065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ff790 is same with the state(5) to be set 00:29:34.478 [2024-11-27 17:22:31.281827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ff790 (9): Bad file descriptor 00:29:34.478 [2024-11-27 17:22:31.291880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:35.412 17:22:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:35.412 17:22:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:35.412 17:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.412 17:22:32 -- common/autotest_common.sh@10 -- # set +x 00:29:35.412 17:22:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:35.412 17:22:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:35.412 17:22:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:35.412 [2024-11-27 17:22:32.340680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:36.786 [2024-11-27 17:22:33.364565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:36.786 [2024-11-27 17:22:33.364621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ff790 with addr=10.0.0.2, port=4420 00:29:36.786 [2024-11-27 17:22:33.364649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ff790 is same with the state(5) to be set 00:29:36.786 [2024-11-27 17:22:33.364686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:36.786 [2024-11-27 17:22:33.364706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:36.786 [2024-11-27 17:22:33.364720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:36.786 [2024-11-27 17:22:33.364736] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:36.786 [2024-11-27 17:22:33.365151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ff790 (9): Bad file descriptor 00:29:36.786 [2024-11-27 17:22:33.365194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.786 [2024-11-27 17:22:33.365233] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:36.786 [2024-11-27 17:22:33.365273] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:36.786 [2024-11-27 17:22:33.365297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.786 [2024-11-27 17:22:33.365318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:36.786 [2024-11-27 17:22:33.365333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.786 [2024-11-27 17:22:33.365348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:36.786 [2024-11-27 17:22:33.365363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.786 [2024-11-27 17:22:33.365378] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:36.786 [2024-11-27 17:22:33.365392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.786 [2024-11-27 17:22:33.365408] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:36.786 [2024-11-27 17:22:33.365429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.786 [2024-11-27 17:22:33.365445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:36.786 [2024-11-27 17:22:33.365686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23fec40 (9): Bad file descriptor 00:29:36.786 [2024-11-27 17:22:33.366706] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:36.786 [2024-11-27 17:22:33.366727] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:36.786 17:22:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.786 17:22:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:36.786 17:22:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:37.719 17:22:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.719 17:22:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:37.719 17:22:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:37.719 17:22:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:37.719 17:22:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:37.719 17:22:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:37.719 17:22:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:38.651 [2024-11-27 17:22:35.416254] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:38.651 [2024-11-27 17:22:35.416282] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:38.651 [2024-11-27 17:22:35.416306] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:38.651 17:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.651 17:22:35 -- common/autotest_common.sh@10 -- # set +x 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:38.651 17:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.651 [2024-11-27 17:22:35.543733] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:38.651 17:22:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:38.908 [2024-11-27 17:22:35.726948] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:38.908 [2024-11-27 17:22:35.727002] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:38.908 [2024-11-27 17:22:35.727039] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:38.908 [2024-11-27 17:22:35.727062] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:38.908 [2024-11-27 17:22:35.727088] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:38.908 [2024-11-27 17:22:35.734743] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x241cc20 was disconnected and freed. delete nvme_qpair. 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:39.840 17:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:39.840 17:22:36 -- common/autotest_common.sh@10 -- # set +x 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:39.840 17:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:39.840 17:22:36 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1861084 00:29:39.840 17:22:36 -- common/autotest_common.sh@936 -- # '[' -z 1861084 ']' 00:29:39.840 17:22:36 -- common/autotest_common.sh@940 -- # kill -0 1861084 00:29:39.840 17:22:36 -- common/autotest_common.sh@941 -- # uname 00:29:39.840 17:22:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:39.840 17:22:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1861084 00:29:39.840 17:22:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:39.840 17:22:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:39.840 17:22:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1861084' 00:29:39.840 killing process with pid 1861084 00:29:39.840 17:22:36 -- common/autotest_common.sh@955 -- # kill 1861084 00:29:39.840 17:22:36 -- common/autotest_common.sh@960 -- # wait 1861084 00:29:40.098 17:22:36 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:40.098 17:22:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:40.098 17:22:36 -- nvmf/common.sh@116 -- # sync 00:29:40.098 17:22:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:40.098 17:22:36 -- nvmf/common.sh@119 -- # set +e 00:29:40.098 17:22:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:40.098 17:22:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:40.098 rmmod nvme_tcp 00:29:40.098 rmmod nvme_fabrics 00:29:40.098 rmmod nvme_keyring 00:29:40.098 17:22:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:40.098 17:22:36 -- nvmf/common.sh@123 -- # set -e 00:29:40.098 17:22:36 -- nvmf/common.sh@124 -- # return 0 00:29:40.098 17:22:36 -- nvmf/common.sh@477 -- # '[' -n 1860927 ']' 00:29:40.098 17:22:36 -- nvmf/common.sh@478 -- # killprocess 1860927 00:29:40.098 17:22:36 -- common/autotest_common.sh@936 -- # '[' -z 1860927 ']' 00:29:40.098 17:22:36 -- common/autotest_common.sh@940 -- # kill -0 1860927 00:29:40.098 17:22:36 -- common/autotest_common.sh@941 -- # uname 00:29:40.098 17:22:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.098 17:22:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1860927 00:29:40.098 17:22:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:40.098 17:22:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:40.098 17:22:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1860927' 00:29:40.098 killing process with pid 1860927 00:29:40.098 17:22:36 -- common/autotest_common.sh@955 -- # kill 1860927 00:29:40.098 17:22:36 -- common/autotest_common.sh@960 -- # wait 1860927 00:29:40.356 17:22:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:40.356 17:22:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:40.356 17:22:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:40.356 17:22:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:40.356 17:22:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:40.356 17:22:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:40.356 17:22:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:40.356 17:22:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:42.251 17:22:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:42.251 00:29:42.251 real 0m18.407s 00:29:42.251 user 0m25.472s 00:29:42.251 sys 0m2.958s 00:29:42.251 17:22:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:42.251 17:22:39 -- common/autotest_common.sh@10 -- # set +x 00:29:42.251 ************************************ 00:29:42.251 END TEST nvmf_discovery_remove_ifc 00:29:42.251 ************************************ 00:29:42.509 17:22:39 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:42.509 17:22:39 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:42.509 17:22:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:42.509 17:22:39 -- common/autotest_common.sh@10 -- # set +x 00:29:42.509 ************************************ 00:29:42.509 START TEST nvmf_digest 00:29:42.509 ************************************ 00:29:42.509 17:22:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:42.509 * Looking for test storage... 00:29:42.509 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:42.509 17:22:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:42.509 17:22:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:42.509 17:22:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:42.509 17:22:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:42.509 17:22:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:42.509 17:22:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:42.509 17:22:39 -- scripts/common.sh@335 -- # IFS=.-: 00:29:42.509 17:22:39 -- scripts/common.sh@335 -- # read -ra ver1 00:29:42.509 17:22:39 -- scripts/common.sh@336 -- # IFS=.-: 00:29:42.509 17:22:39 -- scripts/common.sh@336 -- # read -ra ver2 00:29:42.509 17:22:39 -- scripts/common.sh@337 -- # local 'op=<' 00:29:42.509 17:22:39 -- scripts/common.sh@339 -- # ver1_l=2 00:29:42.509 17:22:39 -- scripts/common.sh@340 -- # ver2_l=1 00:29:42.509 17:22:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:42.509 17:22:39 -- scripts/common.sh@343 -- # case "$op" in 00:29:42.509 17:22:39 -- scripts/common.sh@344 -- # : 1 00:29:42.509 17:22:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:42.509 17:22:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:42.509 17:22:39 -- scripts/common.sh@364 -- # decimal 1 00:29:42.509 17:22:39 -- scripts/common.sh@352 -- # local d=1 00:29:42.509 17:22:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:42.509 17:22:39 -- scripts/common.sh@354 -- # echo 1 00:29:42.509 17:22:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:42.509 17:22:39 -- scripts/common.sh@365 -- # decimal 2 00:29:42.509 17:22:39 -- scripts/common.sh@352 -- # local d=2 00:29:42.509 17:22:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:42.509 17:22:39 -- scripts/common.sh@354 -- # echo 2 00:29:42.509 17:22:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:42.509 17:22:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:42.509 17:22:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:42.509 17:22:39 -- scripts/common.sh@367 -- # return 0 00:29:42.509 17:22:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:42.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:42.509 --rc genhtml_branch_coverage=1 00:29:42.509 --rc genhtml_function_coverage=1 00:29:42.509 --rc genhtml_legend=1 00:29:42.509 --rc geninfo_all_blocks=1 00:29:42.509 --rc geninfo_unexecuted_blocks=1 00:29:42.509 00:29:42.509 ' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:42.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:42.509 --rc genhtml_branch_coverage=1 00:29:42.509 --rc genhtml_function_coverage=1 00:29:42.509 --rc genhtml_legend=1 00:29:42.509 --rc geninfo_all_blocks=1 00:29:42.509 --rc geninfo_unexecuted_blocks=1 00:29:42.509 00:29:42.509 ' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:42.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:42.509 --rc genhtml_branch_coverage=1 00:29:42.509 --rc genhtml_function_coverage=1 00:29:42.509 --rc genhtml_legend=1 00:29:42.509 --rc geninfo_all_blocks=1 00:29:42.509 --rc geninfo_unexecuted_blocks=1 00:29:42.509 00:29:42.509 ' 00:29:42.509 17:22:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:42.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:42.509 --rc genhtml_branch_coverage=1 00:29:42.509 --rc genhtml_function_coverage=1 00:29:42.509 --rc genhtml_legend=1 00:29:42.509 --rc geninfo_all_blocks=1 00:29:42.509 --rc geninfo_unexecuted_blocks=1 00:29:42.509 00:29:42.509 ' 00:29:42.509 17:22:39 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:42.509 17:22:39 -- nvmf/common.sh@7 -- # uname -s 00:29:42.509 17:22:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:42.509 17:22:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:42.509 17:22:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:42.509 17:22:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:42.509 17:22:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:42.509 17:22:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:42.509 17:22:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:42.509 17:22:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:42.509 17:22:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:42.509 17:22:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:42.509 17:22:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:42.509 17:22:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:42.509 17:22:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:42.509 17:22:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:42.509 17:22:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:42.509 17:22:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:42.509 17:22:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:42.509 17:22:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:42.509 17:22:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:42.509 17:22:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:42.509 17:22:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:42.509 17:22:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:42.509 17:22:39 -- paths/export.sh@5 -- # export PATH 00:29:42.509 17:22:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:42.509 17:22:39 -- nvmf/common.sh@46 -- # : 0 00:29:42.509 17:22:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:42.509 17:22:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:42.509 17:22:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:42.509 17:22:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:42.509 17:22:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:42.509 17:22:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:42.509 17:22:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:42.509 17:22:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:42.509 17:22:39 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:42.509 17:22:39 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:42.509 17:22:39 -- host/digest.sh@16 -- # runtime=2 00:29:42.509 17:22:39 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:42.509 17:22:39 -- host/digest.sh@132 -- # nvmftestinit 00:29:42.509 17:22:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:42.509 17:22:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:42.509 17:22:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:42.509 17:22:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:42.509 17:22:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:42.509 17:22:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:42.509 17:22:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:42.509 17:22:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:42.509 17:22:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:42.509 17:22:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:42.510 17:22:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:42.510 17:22:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.036 17:22:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:45.036 17:22:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:45.036 17:22:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:45.036 17:22:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:45.036 17:22:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:45.036 17:22:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:45.036 17:22:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:45.036 17:22:41 -- nvmf/common.sh@294 -- # net_devs=() 00:29:45.036 17:22:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:45.036 17:22:41 -- nvmf/common.sh@295 -- # e810=() 00:29:45.036 17:22:41 -- nvmf/common.sh@295 -- # local -ga e810 00:29:45.036 17:22:41 -- nvmf/common.sh@296 -- # x722=() 00:29:45.036 17:22:41 -- nvmf/common.sh@296 -- # local -ga x722 00:29:45.036 17:22:41 -- nvmf/common.sh@297 -- # mlx=() 00:29:45.036 17:22:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:45.036 17:22:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:45.036 17:22:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:45.036 17:22:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:45.036 17:22:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:45.036 17:22:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:45.036 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:45.036 17:22:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:45.036 17:22:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:45.036 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:45.036 17:22:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:45.036 17:22:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:45.036 17:22:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:45.036 17:22:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:45.036 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:45.036 17:22:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:45.036 17:22:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:45.036 17:22:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:45.036 17:22:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:45.036 17:22:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:45.036 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:45.036 17:22:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:45.036 17:22:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:45.036 17:22:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:45.036 17:22:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:45.036 17:22:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:45.036 17:22:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:45.036 17:22:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:45.036 17:22:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:45.036 17:22:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:45.037 17:22:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:45.037 17:22:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:45.037 17:22:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:45.037 17:22:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:45.037 17:22:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:45.037 17:22:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:45.037 17:22:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:45.037 17:22:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:45.037 17:22:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:45.037 17:22:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:45.037 17:22:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:45.037 17:22:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:45.037 17:22:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:45.037 17:22:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:45.037 17:22:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:45.037 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:45.037 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:29:45.037 00:29:45.037 --- 10.0.0.2 ping statistics --- 00:29:45.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:45.037 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:29:45.037 17:22:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:45.037 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:45.037 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:29:45.037 00:29:45.037 --- 10.0.0.1 ping statistics --- 00:29:45.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:45.037 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:29:45.037 17:22:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:45.037 17:22:41 -- nvmf/common.sh@410 -- # return 0 00:29:45.037 17:22:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:45.037 17:22:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:45.037 17:22:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:45.037 17:22:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:45.037 17:22:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:45.037 17:22:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:45.037 17:22:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:45.037 17:22:41 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:45.037 17:22:41 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:45.037 17:22:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:45.037 17:22:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.037 ************************************ 00:29:45.037 START TEST nvmf_digest_clean 00:29:45.037 ************************************ 00:29:45.037 17:22:41 -- common/autotest_common.sh@1114 -- # run_digest 00:29:45.037 17:22:41 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:45.037 17:22:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:45.037 17:22:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.037 17:22:41 -- nvmf/common.sh@469 -- # nvmfpid=1864603 00:29:45.037 17:22:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:45.037 17:22:41 -- nvmf/common.sh@470 -- # waitforlisten 1864603 00:29:45.037 17:22:41 -- common/autotest_common.sh@829 -- # '[' -z 1864603 ']' 00:29:45.037 17:22:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:45.037 17:22:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.037 17:22:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:45.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:45.037 17:22:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.037 [2024-11-27 17:22:41.578343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:45.037 [2024-11-27 17:22:41.578438] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:45.037 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.037 [2024-11-27 17:22:41.643897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.037 [2024-11-27 17:22:41.732260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:45.037 [2024-11-27 17:22:41.732441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:45.037 [2024-11-27 17:22:41.732458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:45.037 [2024-11-27 17:22:41.732470] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:45.037 [2024-11-27 17:22:41.732521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:45.037 17:22:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:45.037 17:22:41 -- common/autotest_common.sh@862 -- # return 0 00:29:45.037 17:22:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:45.037 17:22:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.037 17:22:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:45.037 17:22:41 -- host/digest.sh@120 -- # common_target_config 00:29:45.037 17:22:41 -- host/digest.sh@43 -- # rpc_cmd 00:29:45.037 17:22:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.037 null0 00:29:45.037 [2024-11-27 17:22:41.937853] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:45.037 [2024-11-27 17:22:41.962100] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:45.037 17:22:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.037 17:22:41 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:45.037 17:22:41 -- host/digest.sh@77 -- # local rw bs qd 00:29:45.037 17:22:41 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:45.037 17:22:41 -- host/digest.sh@80 -- # rw=randread 00:29:45.037 17:22:41 -- host/digest.sh@80 -- # bs=4096 00:29:45.037 17:22:41 -- host/digest.sh@80 -- # qd=128 00:29:45.037 17:22:41 -- host/digest.sh@82 -- # bperfpid=1864743 00:29:45.037 17:22:41 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:45.037 17:22:41 -- host/digest.sh@83 -- # waitforlisten 1864743 /var/tmp/bperf.sock 00:29:45.037 17:22:41 -- common/autotest_common.sh@829 -- # '[' -z 1864743 ']' 00:29:45.037 17:22:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:45.037 17:22:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.037 17:22:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:45.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:45.037 17:22:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.037 17:22:41 -- common/autotest_common.sh@10 -- # set +x 00:29:45.295 [2024-11-27 17:22:42.007620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:45.295 [2024-11-27 17:22:42.007695] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1864743 ] 00:29:45.295 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.295 [2024-11-27 17:22:42.068735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.295 [2024-11-27 17:22:42.157638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:45.295 17:22:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:45.295 17:22:42 -- common/autotest_common.sh@862 -- # return 0 00:29:45.295 17:22:42 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:45.295 17:22:42 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:45.295 17:22:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:45.862 17:22:42 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:45.862 17:22:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.120 nvme0n1 00:29:46.120 17:22:42 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:46.120 17:22:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:46.377 Running I/O for 2 seconds... 00:29:48.276 00:29:48.276 Latency(us) 00:29:48.276 [2024-11-27T16:22:45.227Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.276 [2024-11-27T16:22:45.227Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:48.276 nvme0n1 : 2.00 18017.37 70.38 0.00 0.00 7094.21 2949.12 16796.63 00:29:48.276 [2024-11-27T16:22:45.227Z] =================================================================================================================== 00:29:48.276 [2024-11-27T16:22:45.227Z] Total : 18017.37 70.38 0.00 0.00 7094.21 2949.12 16796.63 00:29:48.276 0 00:29:48.276 17:22:45 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:48.276 17:22:45 -- host/digest.sh@92 -- # get_accel_stats 00:29:48.276 17:22:45 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:48.276 17:22:45 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:48.276 | select(.opcode=="crc32c") 00:29:48.276 | "\(.module_name) \(.executed)"' 00:29:48.276 17:22:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:48.534 17:22:45 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:48.535 17:22:45 -- host/digest.sh@93 -- # exp_module=software 00:29:48.535 17:22:45 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:48.535 17:22:45 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:48.535 17:22:45 -- host/digest.sh@97 -- # killprocess 1864743 00:29:48.535 17:22:45 -- common/autotest_common.sh@936 -- # '[' -z 1864743 ']' 00:29:48.535 17:22:45 -- common/autotest_common.sh@940 -- # kill -0 1864743 00:29:48.535 17:22:45 -- common/autotest_common.sh@941 -- # uname 00:29:48.535 17:22:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.535 17:22:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1864743 00:29:48.535 17:22:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:48.535 17:22:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:48.535 17:22:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1864743' 00:29:48.535 killing process with pid 1864743 00:29:48.535 17:22:45 -- common/autotest_common.sh@955 -- # kill 1864743 00:29:48.535 Received shutdown signal, test time was about 2.000000 seconds 00:29:48.535 00:29:48.535 Latency(us) 00:29:48.535 [2024-11-27T16:22:45.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.535 [2024-11-27T16:22:45.486Z] =================================================================================================================== 00:29:48.535 [2024-11-27T16:22:45.486Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:48.535 17:22:45 -- common/autotest_common.sh@960 -- # wait 1864743 00:29:48.793 17:22:45 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:48.793 17:22:45 -- host/digest.sh@77 -- # local rw bs qd 00:29:48.793 17:22:45 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:48.793 17:22:45 -- host/digest.sh@80 -- # rw=randread 00:29:48.793 17:22:45 -- host/digest.sh@80 -- # bs=131072 00:29:48.793 17:22:45 -- host/digest.sh@80 -- # qd=16 00:29:48.793 17:22:45 -- host/digest.sh@82 -- # bperfpid=1865168 00:29:48.793 17:22:45 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:48.793 17:22:45 -- host/digest.sh@83 -- # waitforlisten 1865168 /var/tmp/bperf.sock 00:29:48.793 17:22:45 -- common/autotest_common.sh@829 -- # '[' -z 1865168 ']' 00:29:48.793 17:22:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:48.793 17:22:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:48.793 17:22:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:48.793 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:48.793 17:22:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:48.793 17:22:45 -- common/autotest_common.sh@10 -- # set +x 00:29:48.793 [2024-11-27 17:22:45.712493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:48.793 [2024-11-27 17:22:45.712580] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1865168 ] 00:29:48.793 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:48.793 Zero copy mechanism will not be used. 00:29:48.793 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.052 [2024-11-27 17:22:45.774287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.052 [2024-11-27 17:22:45.860261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:49.052 17:22:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:49.052 17:22:45 -- common/autotest_common.sh@862 -- # return 0 00:29:49.052 17:22:45 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:49.052 17:22:45 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:49.052 17:22:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:49.619 17:22:46 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:49.619 17:22:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:49.877 nvme0n1 00:29:49.877 17:22:46 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:49.877 17:22:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:49.877 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:49.877 Zero copy mechanism will not be used. 00:29:49.877 Running I/O for 2 seconds... 00:29:52.472 00:29:52.472 Latency(us) 00:29:52.472 [2024-11-27T16:22:49.423Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:52.472 [2024-11-27T16:22:49.423Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:52.472 nvme0n1 : 2.00 6019.95 752.49 0.00 0.00 2653.74 770.65 4441.88 00:29:52.472 [2024-11-27T16:22:49.423Z] =================================================================================================================== 00:29:52.472 [2024-11-27T16:22:49.423Z] Total : 6019.95 752.49 0.00 0.00 2653.74 770.65 4441.88 00:29:52.472 0 00:29:52.472 17:22:48 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:52.472 17:22:48 -- host/digest.sh@92 -- # get_accel_stats 00:29:52.473 17:22:48 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:52.473 17:22:48 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:52.473 | select(.opcode=="crc32c") 00:29:52.473 | "\(.module_name) \(.executed)"' 00:29:52.473 17:22:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:52.473 17:22:49 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:52.473 17:22:49 -- host/digest.sh@93 -- # exp_module=software 00:29:52.473 17:22:49 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:52.473 17:22:49 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:52.473 17:22:49 -- host/digest.sh@97 -- # killprocess 1865168 00:29:52.473 17:22:49 -- common/autotest_common.sh@936 -- # '[' -z 1865168 ']' 00:29:52.473 17:22:49 -- common/autotest_common.sh@940 -- # kill -0 1865168 00:29:52.473 17:22:49 -- common/autotest_common.sh@941 -- # uname 00:29:52.473 17:22:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:52.473 17:22:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1865168 00:29:52.473 17:22:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:52.473 17:22:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:52.473 17:22:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1865168' 00:29:52.473 killing process with pid 1865168 00:29:52.473 17:22:49 -- common/autotest_common.sh@955 -- # kill 1865168 00:29:52.473 Received shutdown signal, test time was about 2.000000 seconds 00:29:52.473 00:29:52.473 Latency(us) 00:29:52.473 [2024-11-27T16:22:49.424Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:52.473 [2024-11-27T16:22:49.424Z] =================================================================================================================== 00:29:52.473 [2024-11-27T16:22:49.424Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:52.473 17:22:49 -- common/autotest_common.sh@960 -- # wait 1865168 00:29:52.791 17:22:49 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:52.791 17:22:49 -- host/digest.sh@77 -- # local rw bs qd 00:29:52.791 17:22:49 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:52.791 17:22:49 -- host/digest.sh@80 -- # rw=randwrite 00:29:52.791 17:22:49 -- host/digest.sh@80 -- # bs=4096 00:29:52.791 17:22:49 -- host/digest.sh@80 -- # qd=128 00:29:52.791 17:22:49 -- host/digest.sh@82 -- # bperfpid=1865592 00:29:52.791 17:22:49 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:52.791 17:22:49 -- host/digest.sh@83 -- # waitforlisten 1865592 /var/tmp/bperf.sock 00:29:52.791 17:22:49 -- common/autotest_common.sh@829 -- # '[' -z 1865592 ']' 00:29:52.791 17:22:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:52.791 17:22:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:52.791 17:22:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:52.791 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:52.791 17:22:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:52.791 17:22:49 -- common/autotest_common.sh@10 -- # set +x 00:29:52.791 [2024-11-27 17:22:49.420573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:52.791 [2024-11-27 17:22:49.420650] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1865592 ] 00:29:52.791 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.791 [2024-11-27 17:22:49.481841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.791 [2024-11-27 17:22:49.569049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:52.791 17:22:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:52.791 17:22:49 -- common/autotest_common.sh@862 -- # return 0 00:29:52.791 17:22:49 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:52.791 17:22:49 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:52.791 17:22:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:53.064 17:22:49 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.064 17:22:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.630 nvme0n1 00:29:53.630 17:22:50 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:53.630 17:22:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:53.630 Running I/O for 2 seconds... 00:29:56.159 00:29:56.159 Latency(us) 00:29:56.159 [2024-11-27T16:22:53.110Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.159 [2024-11-27T16:22:53.110Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:56.159 nvme0n1 : 2.01 20729.10 80.97 0.00 0.00 6161.46 2949.12 16019.91 00:29:56.159 [2024-11-27T16:22:53.110Z] =================================================================================================================== 00:29:56.159 [2024-11-27T16:22:53.110Z] Total : 20729.10 80.97 0.00 0.00 6161.46 2949.12 16019.91 00:29:56.159 0 00:29:56.159 17:22:52 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:56.159 17:22:52 -- host/digest.sh@92 -- # get_accel_stats 00:29:56.159 17:22:52 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:56.159 17:22:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:56.159 17:22:52 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:56.159 | select(.opcode=="crc32c") 00:29:56.159 | "\(.module_name) \(.executed)"' 00:29:56.159 17:22:52 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:56.159 17:22:52 -- host/digest.sh@93 -- # exp_module=software 00:29:56.159 17:22:52 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:56.159 17:22:52 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:56.160 17:22:52 -- host/digest.sh@97 -- # killprocess 1865592 00:29:56.160 17:22:52 -- common/autotest_common.sh@936 -- # '[' -z 1865592 ']' 00:29:56.160 17:22:52 -- common/autotest_common.sh@940 -- # kill -0 1865592 00:29:56.160 17:22:52 -- common/autotest_common.sh@941 -- # uname 00:29:56.160 17:22:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:56.160 17:22:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1865592 00:29:56.160 17:22:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:56.160 17:22:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:56.160 17:22:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1865592' 00:29:56.160 killing process with pid 1865592 00:29:56.160 17:22:52 -- common/autotest_common.sh@955 -- # kill 1865592 00:29:56.160 Received shutdown signal, test time was about 2.000000 seconds 00:29:56.160 00:29:56.160 Latency(us) 00:29:56.160 [2024-11-27T16:22:53.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.160 [2024-11-27T16:22:53.111Z] =================================================================================================================== 00:29:56.160 [2024-11-27T16:22:53.111Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:56.160 17:22:52 -- common/autotest_common.sh@960 -- # wait 1865592 00:29:56.160 17:22:53 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:56.160 17:22:53 -- host/digest.sh@77 -- # local rw bs qd 00:29:56.160 17:22:53 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:56.160 17:22:53 -- host/digest.sh@80 -- # rw=randwrite 00:29:56.160 17:22:53 -- host/digest.sh@80 -- # bs=131072 00:29:56.160 17:22:53 -- host/digest.sh@80 -- # qd=16 00:29:56.160 17:22:53 -- host/digest.sh@82 -- # bperfpid=1866012 00:29:56.160 17:22:53 -- host/digest.sh@83 -- # waitforlisten 1866012 /var/tmp/bperf.sock 00:29:56.160 17:22:53 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:56.160 17:22:53 -- common/autotest_common.sh@829 -- # '[' -z 1866012 ']' 00:29:56.160 17:22:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:56.160 17:22:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.160 17:22:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:56.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:56.160 17:22:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.160 17:22:53 -- common/autotest_common.sh@10 -- # set +x 00:29:56.419 [2024-11-27 17:22:53.136727] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:56.419 [2024-11-27 17:22:53.136820] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1866012 ] 00:29:56.419 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.419 Zero copy mechanism will not be used. 00:29:56.419 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.419 [2024-11-27 17:22:53.199101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:56.419 [2024-11-27 17:22:53.287838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:56.677 17:22:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:56.677 17:22:53 -- common/autotest_common.sh@862 -- # return 0 00:29:56.677 17:22:53 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:56.677 17:22:53 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:56.677 17:22:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:56.936 17:22:53 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:56.936 17:22:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.194 nvme0n1 00:29:57.452 17:22:54 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:57.452 17:22:54 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:57.452 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:57.452 Zero copy mechanism will not be used. 00:29:57.452 Running I/O for 2 seconds... 00:29:59.352 00:29:59.352 Latency(us) 00:29:59.352 [2024-11-27T16:22:56.303Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.352 [2024-11-27T16:22:56.303Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:59.352 nvme0n1 : 2.00 6945.10 868.14 0.00 0.00 2297.17 1820.44 11893.57 00:29:59.352 [2024-11-27T16:22:56.303Z] =================================================================================================================== 00:29:59.352 [2024-11-27T16:22:56.303Z] Total : 6945.10 868.14 0.00 0.00 2297.17 1820.44 11893.57 00:29:59.352 0 00:29:59.352 17:22:56 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:59.610 17:22:56 -- host/digest.sh@92 -- # get_accel_stats 00:29:59.610 17:22:56 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:59.610 17:22:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:59.610 17:22:56 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:59.610 | select(.opcode=="crc32c") 00:29:59.610 | "\(.module_name) \(.executed)"' 00:29:59.610 17:22:56 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:59.610 17:22:56 -- host/digest.sh@93 -- # exp_module=software 00:29:59.610 17:22:56 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:59.610 17:22:56 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:59.610 17:22:56 -- host/digest.sh@97 -- # killprocess 1866012 00:29:59.610 17:22:56 -- common/autotest_common.sh@936 -- # '[' -z 1866012 ']' 00:29:59.610 17:22:56 -- common/autotest_common.sh@940 -- # kill -0 1866012 00:29:59.610 17:22:56 -- common/autotest_common.sh@941 -- # uname 00:29:59.867 17:22:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:59.867 17:22:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1866012 00:29:59.867 17:22:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:59.867 17:22:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:59.867 17:22:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1866012' 00:29:59.867 killing process with pid 1866012 00:29:59.867 17:22:56 -- common/autotest_common.sh@955 -- # kill 1866012 00:29:59.867 Received shutdown signal, test time was about 2.000000 seconds 00:29:59.867 00:29:59.867 Latency(us) 00:29:59.867 [2024-11-27T16:22:56.818Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.867 [2024-11-27T16:22:56.818Z] =================================================================================================================== 00:29:59.867 [2024-11-27T16:22:56.818Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:59.867 17:22:56 -- common/autotest_common.sh@960 -- # wait 1866012 00:30:00.125 17:22:56 -- host/digest.sh@126 -- # killprocess 1864603 00:30:00.125 17:22:56 -- common/autotest_common.sh@936 -- # '[' -z 1864603 ']' 00:30:00.125 17:22:56 -- common/autotest_common.sh@940 -- # kill -0 1864603 00:30:00.125 17:22:56 -- common/autotest_common.sh@941 -- # uname 00:30:00.125 17:22:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.125 17:22:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1864603 00:30:00.125 17:22:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:00.125 17:22:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:00.125 17:22:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1864603' 00:30:00.125 killing process with pid 1864603 00:30:00.125 17:22:56 -- common/autotest_common.sh@955 -- # kill 1864603 00:30:00.125 17:22:56 -- common/autotest_common.sh@960 -- # wait 1864603 00:30:00.383 00:30:00.383 real 0m15.558s 00:30:00.383 user 0m30.605s 00:30:00.383 sys 0m4.559s 00:30:00.383 17:22:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:00.383 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.383 ************************************ 00:30:00.383 END TEST nvmf_digest_clean 00:30:00.383 ************************************ 00:30:00.383 17:22:57 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:30:00.383 17:22:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:00.383 17:22:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.383 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.383 ************************************ 00:30:00.383 START TEST nvmf_digest_error 00:30:00.383 ************************************ 00:30:00.383 17:22:57 -- common/autotest_common.sh@1114 -- # run_digest_error 00:30:00.383 17:22:57 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:30:00.383 17:22:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:00.383 17:22:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:00.383 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.383 17:22:57 -- nvmf/common.sh@469 -- # nvmfpid=1866581 00:30:00.383 17:22:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:00.383 17:22:57 -- nvmf/common.sh@470 -- # waitforlisten 1866581 00:30:00.383 17:22:57 -- common/autotest_common.sh@829 -- # '[' -z 1866581 ']' 00:30:00.383 17:22:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:00.383 17:22:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.383 17:22:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:00.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:00.383 17:22:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.383 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.383 [2024-11-27 17:22:57.166362] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:00.383 [2024-11-27 17:22:57.166454] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:00.383 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.383 [2024-11-27 17:22:57.231333] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:00.383 [2024-11-27 17:22:57.319722] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:00.383 [2024-11-27 17:22:57.319891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:00.383 [2024-11-27 17:22:57.319908] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:00.384 [2024-11-27 17:22:57.319920] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:00.384 [2024-11-27 17:22:57.319961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:00.642 17:22:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:00.642 17:22:57 -- common/autotest_common.sh@862 -- # return 0 00:30:00.642 17:22:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:00.642 17:22:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:00.642 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.642 17:22:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:00.642 17:22:57 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:30:00.642 17:22:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.642 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.642 [2024-11-27 17:22:57.412643] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:30:00.642 17:22:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.642 17:22:57 -- host/digest.sh@104 -- # common_target_config 00:30:00.642 17:22:57 -- host/digest.sh@43 -- # rpc_cmd 00:30:00.642 17:22:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.642 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.642 null0 00:30:00.642 [2024-11-27 17:22:57.530401] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:00.642 [2024-11-27 17:22:57.554673] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:00.642 17:22:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.642 17:22:57 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:30:00.642 17:22:57 -- host/digest.sh@54 -- # local rw bs qd 00:30:00.642 17:22:57 -- host/digest.sh@56 -- # rw=randread 00:30:00.642 17:22:57 -- host/digest.sh@56 -- # bs=4096 00:30:00.642 17:22:57 -- host/digest.sh@56 -- # qd=128 00:30:00.642 17:22:57 -- host/digest.sh@58 -- # bperfpid=1866610 00:30:00.642 17:22:57 -- host/digest.sh@60 -- # waitforlisten 1866610 /var/tmp/bperf.sock 00:30:00.642 17:22:57 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:30:00.642 17:22:57 -- common/autotest_common.sh@829 -- # '[' -z 1866610 ']' 00:30:00.642 17:22:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:00.642 17:22:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.642 17:22:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:00.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:00.642 17:22:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.642 17:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:00.900 [2024-11-27 17:22:57.600049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:00.900 [2024-11-27 17:22:57.600123] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1866610 ] 00:30:00.900 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.900 [2024-11-27 17:22:57.660998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:00.900 [2024-11-27 17:22:57.759947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:01.833 17:22:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.833 17:22:58 -- common/autotest_common.sh@862 -- # return 0 00:30:01.833 17:22:58 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:01.833 17:22:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:02.091 17:22:58 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:02.091 17:22:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.091 17:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:02.091 17:22:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.091 17:22:58 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:02.091 17:22:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:02.349 nvme0n1 00:30:02.349 17:22:59 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:02.349 17:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.349 17:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:02.349 17:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.349 17:22:59 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:02.349 17:22:59 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:02.349 Running I/O for 2 seconds... 00:30:02.606 [2024-11-27 17:22:59.314073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.314124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:24455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.314146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.329823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.329876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.329896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.346620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.346668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:15841 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.346685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.362746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.362774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:702 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.362805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.379536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.379585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.379602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.395950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.395977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:3070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.396008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.413080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.413114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:21195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.413133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.430225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.430259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:21843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.430278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.446143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.446171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:16858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.446202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.462968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.606 [2024-11-27 17:22:59.463002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:798 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.606 [2024-11-27 17:22:59.463021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.606 [2024-11-27 17:22:59.486790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.607 [2024-11-27 17:22:59.486824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.607 [2024-11-27 17:22:59.486855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.607 [2024-11-27 17:22:59.502920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.607 [2024-11-27 17:22:59.502947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:2150 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.607 [2024-11-27 17:22:59.502977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.607 [2024-11-27 17:22:59.519207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.607 [2024-11-27 17:22:59.519234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:11615 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.607 [2024-11-27 17:22:59.519265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.607 [2024-11-27 17:22:59.535183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.607 [2024-11-27 17:22:59.535216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:21130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.607 [2024-11-27 17:22:59.535235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.607 [2024-11-27 17:22:59.551716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.607 [2024-11-27 17:22:59.551743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:3966 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.607 [2024-11-27 17:22:59.551779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.566376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.566409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:1006 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.566427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.577502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.577545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5588 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.577565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.594107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.594134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:13743 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.594165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.611001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.611044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:3274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.611060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.627249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.627283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.627301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.643199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.643226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:6953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.643258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.659940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.659974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:22379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.659992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.676430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.676457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:4937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.676489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.692818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.692872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:97 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.692892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.709489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.709523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:21313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.709551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.725847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.725880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:21515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.725899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.742736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.742763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:8214 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.742794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.759015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.759042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:23400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.759072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.775256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.775284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.775314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.791386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.791413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:4941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.791444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.865 [2024-11-27 17:22:59.807782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:02.865 [2024-11-27 17:22:59.807809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22329 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.865 [2024-11-27 17:22:59.807840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.824321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.824350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.824381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.841008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.841036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:16621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.841066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.857908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.857942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:19038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.857961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.874561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.874589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.874605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.891137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.891170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:8601 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.891189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.907723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.907750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15861 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.907780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.918882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.918915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.918934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.934856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.934891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:18265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.934910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.958482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.958518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25471 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.958549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.975548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.975592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:4262 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.975614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:22:59.991907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:22:59.991934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:22:59.991965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:23:00.008893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:23:00.008946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6425 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:23:00.008976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:23:00.028680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:23:00.028733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:25039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:23:00.028761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:23:00.047660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:23:00.047711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:22160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:23:00.047731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.124 [2024-11-27 17:23:00.062712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.124 [2024-11-27 17:23:00.062749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:4547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.124 [2024-11-27 17:23:00.062769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.074464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.074500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:2742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.074537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.091723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.091759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.091778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.109302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.109353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:20278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.109372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.126421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.126455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.126475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.149709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.149738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:18664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.149770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.165241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.165289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:22009 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.165306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.177368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.177402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.177421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.194726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.194761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.194780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.212080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.212108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.212123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.228850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.228884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6668 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.228902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.246097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.246130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:24681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.246149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.263009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.263042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:23511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.263068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.279576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.279610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22182 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.279628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.296370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.296405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.296424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.383 [2024-11-27 17:23:00.313274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.383 [2024-11-27 17:23:00.313322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.383 [2024-11-27 17:23:00.313342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.384 [2024-11-27 17:23:00.330115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.384 [2024-11-27 17:23:00.330146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:10061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.384 [2024-11-27 17:23:00.330163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.346475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.346512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.346539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.362773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.362805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:12810 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.362823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.379663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.379691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4875 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.379721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.396419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.396453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.396472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.413056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.413097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:14046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.413117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.429951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.429986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:12497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.430005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.446870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.446898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:12736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.446928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.463773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.463819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:3399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.463842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.480820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.480848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:1967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.480863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.497503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.497543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:24425 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.497562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.514425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.514453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.514469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.531549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.531595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:7544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.531612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.548007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.548034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.548064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.565087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.565121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.565140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.642 [2024-11-27 17:23:00.582033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.642 [2024-11-27 17:23:00.582067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14744 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.642 [2024-11-27 17:23:00.582086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.598841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.901 [2024-11-27 17:23:00.598886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:19787 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.901 [2024-11-27 17:23:00.598906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.615613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.901 [2024-11-27 17:23:00.615641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.901 [2024-11-27 17:23:00.615672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.632874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.901 [2024-11-27 17:23:00.632918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:24724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.901 [2024-11-27 17:23:00.632934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.649489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.901 [2024-11-27 17:23:00.649523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.901 [2024-11-27 17:23:00.649551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.665815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.901 [2024-11-27 17:23:00.665863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3888 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.901 [2024-11-27 17:23:00.665882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.901 [2024-11-27 17:23:00.682455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.682485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:1006 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.682516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.699801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.699834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:7554 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.699875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.716608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.716636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:13181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.716666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.733184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.733211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.733242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.749768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.749810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:20659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.749827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.766233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.766266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:16118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.766285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.782772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.782800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:8327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.782831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.793381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.793415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15891 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.793433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.808420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.808453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24798 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.808471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.825249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.825282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:25400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.825301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.902 [2024-11-27 17:23:00.842119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:03.902 [2024-11-27 17:23:00.842158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17084 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.902 [2024-11-27 17:23:00.842177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.161 [2024-11-27 17:23:00.859167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.161 [2024-11-27 17:23:00.859204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.161 [2024-11-27 17:23:00.859223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.161 [2024-11-27 17:23:00.876680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.161 [2024-11-27 17:23:00.876724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:16247 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.161 [2024-11-27 17:23:00.876739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.161 [2024-11-27 17:23:00.892381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.161 [2024-11-27 17:23:00.892416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.161 [2024-11-27 17:23:00.892434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.909593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.909621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.909637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.925772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.925800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:25165 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.925834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.942340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.942374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.942394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.958716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.958744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.958774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.975690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.975717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:16800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.975749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:00.992904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:00.992937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13635 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:00.992956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.009120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.009147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:11978 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.009178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.025170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.025197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:2067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.025227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.041723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.041750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.041781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.059122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.059156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.059176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.076162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.076196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.076216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.092229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.092263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.092282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.162 [2024-11-27 17:23:01.108774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.162 [2024-11-27 17:23:01.108811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:1398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.162 [2024-11-27 17:23:01.108829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.119638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.119670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.119692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.135120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.135149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.135179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.151544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.151593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:14501 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.151609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.175609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.175638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:16286 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.175667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.192413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.192441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:3703 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.192472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.209010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.209038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:13531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.209068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.225290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.225318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:11752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.225348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.240020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.240066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:23178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.240082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.251178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.251205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:11110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.251235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.267954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.267988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:21075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.268006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.283188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.283215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:7712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.283246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 [2024-11-27 17:23:01.299376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd70400) 00:30:04.421 [2024-11-27 17:23:01.299409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:25244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.421 [2024-11-27 17:23:01.299428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.421 00:30:04.421 Latency(us) 00:30:04.421 [2024-11-27T16:23:01.372Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:04.421 [2024-11-27T16:23:01.372Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:04.421 nvme0n1 : 2.01 15420.87 60.24 0.00 0.00 8293.58 3616.62 32039.82 00:30:04.421 [2024-11-27T16:23:01.372Z] =================================================================================================================== 00:30:04.421 [2024-11-27T16:23:01.372Z] Total : 15420.87 60.24 0.00 0.00 8293.58 3616.62 32039.82 00:30:04.421 0 00:30:04.421 17:23:01 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:04.421 17:23:01 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:04.421 17:23:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:04.421 17:23:01 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:04.421 | .driver_specific 00:30:04.421 | .nvme_error 00:30:04.421 | .status_code 00:30:04.421 | .command_transient_transport_error' 00:30:04.680 17:23:01 -- host/digest.sh@71 -- # (( 121 > 0 )) 00:30:04.680 17:23:01 -- host/digest.sh@73 -- # killprocess 1866610 00:30:04.680 17:23:01 -- common/autotest_common.sh@936 -- # '[' -z 1866610 ']' 00:30:04.680 17:23:01 -- common/autotest_common.sh@940 -- # kill -0 1866610 00:30:04.680 17:23:01 -- common/autotest_common.sh@941 -- # uname 00:30:04.680 17:23:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:04.680 17:23:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1866610 00:30:04.680 17:23:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:04.680 17:23:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:04.680 17:23:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1866610' 00:30:04.680 killing process with pid 1866610 00:30:04.680 17:23:01 -- common/autotest_common.sh@955 -- # kill 1866610 00:30:04.680 Received shutdown signal, test time was about 2.000000 seconds 00:30:04.680 00:30:04.680 Latency(us) 00:30:04.680 [2024-11-27T16:23:01.631Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:04.680 [2024-11-27T16:23:01.631Z] =================================================================================================================== 00:30:04.680 [2024-11-27T16:23:01.631Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:04.680 17:23:01 -- common/autotest_common.sh@960 -- # wait 1866610 00:30:04.938 17:23:01 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:04.938 17:23:01 -- host/digest.sh@54 -- # local rw bs qd 00:30:04.938 17:23:01 -- host/digest.sh@56 -- # rw=randread 00:30:04.938 17:23:01 -- host/digest.sh@56 -- # bs=131072 00:30:04.938 17:23:01 -- host/digest.sh@56 -- # qd=16 00:30:04.938 17:23:01 -- host/digest.sh@58 -- # bperfpid=1867162 00:30:04.938 17:23:01 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:04.938 17:23:01 -- host/digest.sh@60 -- # waitforlisten 1867162 /var/tmp/bperf.sock 00:30:04.938 17:23:01 -- common/autotest_common.sh@829 -- # '[' -z 1867162 ']' 00:30:04.938 17:23:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:04.938 17:23:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:04.938 17:23:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:04.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:04.938 17:23:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:04.938 17:23:01 -- common/autotest_common.sh@10 -- # set +x 00:30:04.938 [2024-11-27 17:23:01.855523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:04.938 [2024-11-27 17:23:01.855625] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1867162 ] 00:30:04.938 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:04.938 Zero copy mechanism will not be used. 00:30:04.938 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.197 [2024-11-27 17:23:01.916420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:05.197 [2024-11-27 17:23:02.006019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:06.131 17:23:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:06.131 17:23:02 -- common/autotest_common.sh@862 -- # return 0 00:30:06.131 17:23:02 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:06.131 17:23:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:06.389 17:23:03 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:06.389 17:23:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.389 17:23:03 -- common/autotest_common.sh@10 -- # set +x 00:30:06.389 17:23:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.389 17:23:03 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:06.389 17:23:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:06.648 nvme0n1 00:30:06.648 17:23:03 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:06.648 17:23:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.648 17:23:03 -- common/autotest_common.sh@10 -- # set +x 00:30:06.648 17:23:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.648 17:23:03 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:06.648 17:23:03 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:06.648 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:06.648 Zero copy mechanism will not be used. 00:30:06.648 Running I/O for 2 seconds... 00:30:06.648 [2024-11-27 17:23:03.584129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.648 [2024-11-27 17:23:03.584196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.648 [2024-11-27 17:23:03.584221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.648 [2024-11-27 17:23:03.592081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.648 [2024-11-27 17:23:03.592119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.648 [2024-11-27 17:23:03.592149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.907 [2024-11-27 17:23:03.600082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.907 [2024-11-27 17:23:03.600121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.907 [2024-11-27 17:23:03.600141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.907 [2024-11-27 17:23:03.607973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.907 [2024-11-27 17:23:03.608010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.907 [2024-11-27 17:23:03.608030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.907 [2024-11-27 17:23:03.614488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.907 [2024-11-27 17:23:03.614535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.907 [2024-11-27 17:23:03.614559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.907 [2024-11-27 17:23:03.621059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.907 [2024-11-27 17:23:03.621095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.907 [2024-11-27 17:23:03.621115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.907 [2024-11-27 17:23:03.628304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.907 [2024-11-27 17:23:03.628339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.628358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.635490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.635534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.635557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.642630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.642665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.642685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.649051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.649086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.649105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.654716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.654755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.654773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.661246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.661280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.661300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.667056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.667092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.667111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.673842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.673874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.673891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.681586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.681618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.681636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.690003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.690038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.690058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.696473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.696508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.696536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.703626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.703671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.703688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.709189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.709225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.709245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.714869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.714904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.714925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.719880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.719914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.719933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.725318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.725351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.725370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.730672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.730702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.730719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.735794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.735824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.735841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.741201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.741234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.741254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.746572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.746603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.746620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.751782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.751830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.751850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.758171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.758205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.758232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.765178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.765213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.765232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.772238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.772273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.772292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.777913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.777948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.777968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.783883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.783919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.908 [2024-11-27 17:23:03.783938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.908 [2024-11-27 17:23:03.789428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.908 [2024-11-27 17:23:03.789463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.789482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.796261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.796298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.796318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.803113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.803149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.803168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.808319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.808354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.808373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.813983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.814027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.814047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.819100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.819133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.819152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.824648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.824678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.824696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.830179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.830213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.830232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.835543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.835592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.835609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.841092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.841125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.841144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.846469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.846503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.846521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.909 [2024-11-27 17:23:03.851358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:06.909 [2024-11-27 17:23:03.851392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.909 [2024-11-27 17:23:03.851411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.857028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.857066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.857085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.862016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.862053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.862074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.865382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.865417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.865436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.870868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.870903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.870922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.876298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.876332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.876351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.881805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.881835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.881870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.887605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.887633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.887664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.893159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.893193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.893212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.898696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.898742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.898759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.904283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.904315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.904342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.909954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.909989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.910009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.915488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.915521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.915550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.920868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.920902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.920921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.926195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.926229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.926248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.933012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.933047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.933067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.938478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.938510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.938539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.943374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.943408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.943427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.948170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.948204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.948224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.952950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.952991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.953011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.957081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.957115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.957134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.961291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.961325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.961343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.965473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.965507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.965534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.970049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.970083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.970102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.975092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.975126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.170 [2024-11-27 17:23:03.975145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.170 [2024-11-27 17:23:03.979470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.170 [2024-11-27 17:23:03.979503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:03.979522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:03.983970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:03.984004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:03.984022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:03.988131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:03.988164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:03.988190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:03.992914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:03.992947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:03.992966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:03.998007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:03.998041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:03.998060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.002385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.002417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.002436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.007035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.007069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.007088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.011983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.012016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.012035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.016546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.016592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.016609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.021290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.021325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.021344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.025945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.025980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.025999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.030597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.030633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.030652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.034893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.034926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.034945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.039861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.039895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.039913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.044049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.044081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.044100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.048958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.048992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.049010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.054430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.054462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.054479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.059649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.059679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.059697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.064735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.064779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.064795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.070006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.070039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.070057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.075391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.075424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.075442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.080739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.080768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.080800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.086022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.086055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.086074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.091470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.091504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.091530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.095779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.095826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.095845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.100162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.100194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.100213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.104585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.104615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.171 [2024-11-27 17:23:04.104632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.171 [2024-11-27 17:23:04.109709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.171 [2024-11-27 17:23:04.109739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.172 [2024-11-27 17:23:04.109756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.172 [2024-11-27 17:23:04.115141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.172 [2024-11-27 17:23:04.115176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.172 [2024-11-27 17:23:04.115203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.120660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.120693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.120712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.125975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.126012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.126033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.131542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.131592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.131610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.137103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.137136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.137155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.142626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.142656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.142673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.147916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.147948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.147967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.152935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.152969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.152988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.157613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.157642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.157659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.162717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.431 [2024-11-27 17:23:04.162752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.431 [2024-11-27 17:23:04.162770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.431 [2024-11-27 17:23:04.167941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.167974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.167993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.173760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.173789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.173819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.179505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.179548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.179584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.185086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.185119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.185138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.190788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.190818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.190835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.196493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.196534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.196555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.202095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.202127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.202146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.207738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.207784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.207802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.213878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.213913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.213932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.221094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.221129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.221149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.228649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.228681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.228699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.235747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.235779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.235796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.243258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.243292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.243312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.250748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.250779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.250796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.258386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.258420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.258440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.266004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.266039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.266058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.273718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.273749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.273773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.280868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.280898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.280915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.287407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.287442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.287461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.294281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.294312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.294330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.300496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.300539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.300561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.307388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.307423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.307443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.313780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.313811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.313847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.320449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.320483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.320503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.326625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.326656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.326673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.332660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.432 [2024-11-27 17:23:04.332697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.432 [2024-11-27 17:23:04.332715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.432 [2024-11-27 17:23:04.338320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.338354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.338374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.344216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.344250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.344269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.348798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.348829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.348862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.353314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.353346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.353364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.357663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.357693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.357710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.361774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.361803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.361820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.366104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.366136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.366155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.370799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.370845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.370863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.433 [2024-11-27 17:23:04.376435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.433 [2024-11-27 17:23:04.376477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.433 [2024-11-27 17:23:04.376509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.381941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.381976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.381997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.386692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.386724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.386742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.389950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.389983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.390003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.395129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.395163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.395182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.400830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.400876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.400895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.406544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.406592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.406609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.412262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.412296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.412315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.417746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.417774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.417811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.423430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.423464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.423483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.428709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.428737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.428768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.434061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.434094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.434114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.439042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.439076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.439095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.443729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.443759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.443776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.448011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.448044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.448062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.452930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.452963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.452981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.457311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.457344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.457363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.461547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.461595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.693 [2024-11-27 17:23:04.461612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.693 [2024-11-27 17:23:04.465708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.693 [2024-11-27 17:23:04.465737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.465755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.469792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.469820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.469837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.474107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.474139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.474158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.478498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.478538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.478558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.483080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.483112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.483131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.487496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.487537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.487559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.492117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.492151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.492169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.496842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.496877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.496902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.501390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.501423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.501443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.506183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.506215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.506235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.510719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.510751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.510768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.514958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.514993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.515014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.519628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.519659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.519675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.524790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.524834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.524850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.529967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.530009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.530029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.535677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.535707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.535724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.540721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.540758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.540776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.545550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.545584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.545617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.549934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.549966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.549984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.554614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.554646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.554663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.559214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.559246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.559265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.563599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.563629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.563645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.568235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.568267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.568286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.573031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.573065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.573084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.577636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.577667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.577684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.582499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.582540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.582561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.587009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.587041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.587060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.694 [2024-11-27 17:23:04.591626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.694 [2024-11-27 17:23:04.591657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.694 [2024-11-27 17:23:04.591673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.596572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.596619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.596636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.601132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.601175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.601194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.606123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.606157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.606176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.610603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.610634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.610651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.616546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.616605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.616624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.622710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.622741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.622764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.628931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.628965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.628984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.634501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.634543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.634565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.695 [2024-11-27 17:23:04.639667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.695 [2024-11-27 17:23:04.639700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.695 [2024-11-27 17:23:04.639718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.645143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.645179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.645199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.650819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.650851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.650869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.656538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.656594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.656611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.663688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.663717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.663734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.671250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.671285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.671304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.678140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.678182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.678203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.684802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.684848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.684868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.691480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.691514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.691544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.699388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.699423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.699443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.707417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.707451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.707471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.715162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.715197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.715217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.721697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.721727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.721759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.728643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.728687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.728705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.735423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.735457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.735476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.739880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.739914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.739933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.744627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.744657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.744675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.749203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.749236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.749254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.753797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.753825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.753842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.758503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.758546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.758582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.762967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.763000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.763018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.767476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.767508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.767534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.772026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.772059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.772078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.776625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.776655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.776678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.781179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.955 [2024-11-27 17:23:04.781213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.955 [2024-11-27 17:23:04.781231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.955 [2024-11-27 17:23:04.785677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.785708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.785725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.789804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.789833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.789850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.794492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.794532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.794552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.799985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.800017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.800036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.805473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.805503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.805520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.810951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.810984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.811004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.816226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.816256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.816272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.821600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.821636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.821653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.827597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.827641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.827659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.832751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.832780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.832798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.837934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.837963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.837980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.843584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.843615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.843632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.848604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.848633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.848651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.853412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.853441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.853457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.858653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.858687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.858703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.863948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.863980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.863998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.869330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.869365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.869384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.874749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.874779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.874796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.879860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.879892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.879910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.884434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.884466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.884485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.889180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.889212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.889231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.894769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.894800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.894817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.956 [2024-11-27 17:23:04.900354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:07.956 [2024-11-27 17:23:04.900390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.956 [2024-11-27 17:23:04.900410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.216 [2024-11-27 17:23:04.905978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.906026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.906044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.911446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.911482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.911512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.917043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.917077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.917096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.922616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.922647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.922664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.928112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.928145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.928164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.933516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.933557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.933577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.939102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.939136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.939154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.945074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.945110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.945130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.951400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.951436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.951455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.957226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.957260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.957280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.962797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.962851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.962871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.968388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.968422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.968441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.974166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.974200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.974220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.979051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.979085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.979105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.984017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.984051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.984070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.988523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.988581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.988599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.993193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.993227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.993246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:04.997694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:04.997724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:04.997741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.002299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.002332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.002365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.006967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.007002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.007021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.011494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.011537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.011560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.016069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.016103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.016122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.021072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.021105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.021125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.025981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.026015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.026034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.030667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.030696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.030713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.035267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.217 [2024-11-27 17:23:05.035299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.217 [2024-11-27 17:23:05.035318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.217 [2024-11-27 17:23:05.039590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.039619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.039636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.044120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.044160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.044179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.049345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.049376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.049395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.055018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.055052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.055071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.060606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.060636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.060653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.066328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.066362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.066382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.071897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.071931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.071951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.077217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.077251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.077270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.083308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.083343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.083363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.088992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.089026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.089045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.094542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.094589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.094607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.098950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.098980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.098997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.103964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.103996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.104015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.108592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.108622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.108640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.114054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.114088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.114107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.119545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.119591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.119608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.124979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.125012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.125031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.130518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.130575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.130593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.135995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.136042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.136065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.141711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.141742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.141759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.147440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.147473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.147492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.152948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.152980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.152999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.158217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.158249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.158268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.218 [2024-11-27 17:23:05.163723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.218 [2024-11-27 17:23:05.163755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.218 [2024-11-27 17:23:05.163772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.169407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.169442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.169462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.175112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.175148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.175168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.180571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.180602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.180620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.185941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.185980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.186001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.191075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.191107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.191125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.196224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.196255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.196274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.201481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.201514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.201542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.207456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.207489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.207508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.212980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.213013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.213031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.218379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.218411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.218430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.223602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.223631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.223647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.228672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.228701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.479 [2024-11-27 17:23:05.228720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.479 [2024-11-27 17:23:05.233759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.479 [2024-11-27 17:23:05.233789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.233806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.239154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.239185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.239204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.244425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.244457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.244476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.249546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.249591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.249608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.255172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.255205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.255224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.260432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.260464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.260483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.265939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.265968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.265985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.271376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.271409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.271427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.276626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.276656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.276678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.281951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.281984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.282003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.287131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.287164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.287183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.292316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.292349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.292368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.297440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.297472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.297490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.302892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.302927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.302945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.308372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.308404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.308422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.313779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.313808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.313824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.319435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.319467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.319486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.325182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.325220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.325239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.330387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.330419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.330438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.335768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.335798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.335815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.341100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.341133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.341151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.346439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.346471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.346489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.351921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.351954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.351973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.357420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.357452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.357471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.362810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.362857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.362876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.480 [2024-11-27 17:23:05.368509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.480 [2024-11-27 17:23:05.368549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.480 [2024-11-27 17:23:05.368583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.373815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.373863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.373883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.378589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.378619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.378636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.381955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.381987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.382005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.387146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.387177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.387195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.392296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.392340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.392359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.397555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.397601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.397617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.402857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.402901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.402920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.407994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.408026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.408045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.413450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.413483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.413508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.418699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.418727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.418743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.481 [2024-11-27 17:23:05.424174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.481 [2024-11-27 17:23:05.424210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.481 [2024-11-27 17:23:05.424230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.429745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.429775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.429809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.435274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.435309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.435329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.440842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.440887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.440906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.446127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.446161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.446180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.451205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.451237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.451255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.456502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.740 [2024-11-27 17:23:05.456552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.740 [2024-11-27 17:23:05.456572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.740 [2024-11-27 17:23:05.461820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.461867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.461886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.466939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.466971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.466989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.472140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.472173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.472192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.477364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.477397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.477415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.482443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.482472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.482505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.487787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.487814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.487829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.493254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.493286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.493305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.498680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.498709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.498726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.504173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.504206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.504230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.509453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.509485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.509504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.514768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.514809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.514825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.520287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.520320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.520338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.525401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.525448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.525466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.530857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.530910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.530929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.536423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.536457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.536476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.542007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.542041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.542060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.547203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.547235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.547254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.552705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.552739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.552756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.558252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.558284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.558303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.563534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.563566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.563598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.569056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.569088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.569106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.574406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.574438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.574456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.741 [2024-11-27 17:23:05.579868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xec72f0) 00:30:08.741 [2024-11-27 17:23:05.579901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.741 [2024-11-27 17:23:05.579919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.741 00:30:08.741 Latency(us) 00:30:08.741 [2024-11-27T16:23:05.692Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:08.741 [2024-11-27T16:23:05.692Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:08.741 nvme0n1 : 2.00 5735.85 716.98 0.00 0.00 2785.35 609.85 8252.68 00:30:08.741 [2024-11-27T16:23:05.692Z] =================================================================================================================== 00:30:08.741 [2024-11-27T16:23:05.692Z] Total : 5735.85 716.98 0.00 0.00 2785.35 609.85 8252.68 00:30:08.741 0 00:30:08.741 17:23:05 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:08.741 17:23:05 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:08.741 17:23:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:08.741 17:23:05 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:08.741 | .driver_specific 00:30:08.742 | .nvme_error 00:30:08.742 | .status_code 00:30:08.742 | .command_transient_transport_error' 00:30:09.000 17:23:05 -- host/digest.sh@71 -- # (( 370 > 0 )) 00:30:09.000 17:23:05 -- host/digest.sh@73 -- # killprocess 1867162 00:30:09.000 17:23:05 -- common/autotest_common.sh@936 -- # '[' -z 1867162 ']' 00:30:09.000 17:23:05 -- common/autotest_common.sh@940 -- # kill -0 1867162 00:30:09.000 17:23:05 -- common/autotest_common.sh@941 -- # uname 00:30:09.000 17:23:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:09.000 17:23:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1867162 00:30:09.000 17:23:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:09.000 17:23:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:09.000 17:23:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1867162' 00:30:09.000 killing process with pid 1867162 00:30:09.000 17:23:05 -- common/autotest_common.sh@955 -- # kill 1867162 00:30:09.000 Received shutdown signal, test time was about 2.000000 seconds 00:30:09.000 00:30:09.000 Latency(us) 00:30:09.000 [2024-11-27T16:23:05.951Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:09.000 [2024-11-27T16:23:05.951Z] =================================================================================================================== 00:30:09.000 [2024-11-27T16:23:05.951Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:09.000 17:23:05 -- common/autotest_common.sh@960 -- # wait 1867162 00:30:09.258 17:23:06 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:09.258 17:23:06 -- host/digest.sh@54 -- # local rw bs qd 00:30:09.258 17:23:06 -- host/digest.sh@56 -- # rw=randwrite 00:30:09.258 17:23:06 -- host/digest.sh@56 -- # bs=4096 00:30:09.258 17:23:06 -- host/digest.sh@56 -- # qd=128 00:30:09.258 17:23:06 -- host/digest.sh@58 -- # bperfpid=1867710 00:30:09.258 17:23:06 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:09.258 17:23:06 -- host/digest.sh@60 -- # waitforlisten 1867710 /var/tmp/bperf.sock 00:30:09.258 17:23:06 -- common/autotest_common.sh@829 -- # '[' -z 1867710 ']' 00:30:09.258 17:23:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:09.258 17:23:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:09.258 17:23:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:09.258 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:09.258 17:23:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:09.258 17:23:06 -- common/autotest_common.sh@10 -- # set +x 00:30:09.258 [2024-11-27 17:23:06.173744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:09.258 [2024-11-27 17:23:06.173836] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1867710 ] 00:30:09.258 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.516 [2024-11-27 17:23:06.249457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:09.516 [2024-11-27 17:23:06.349458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:09.774 17:23:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:09.774 17:23:06 -- common/autotest_common.sh@862 -- # return 0 00:30:09.774 17:23:06 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:09.774 17:23:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:10.032 17:23:06 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:10.032 17:23:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.032 17:23:06 -- common/autotest_common.sh@10 -- # set +x 00:30:10.032 17:23:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.032 17:23:06 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:10.032 17:23:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:10.598 nvme0n1 00:30:10.598 17:23:07 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:10.598 17:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.598 17:23:07 -- common/autotest_common.sh@10 -- # set +x 00:30:10.598 17:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.598 17:23:07 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:10.598 17:23:07 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:10.598 Running I/O for 2 seconds... 00:30:10.598 [2024-11-27 17:23:07.430382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee5c8 00:30:10.598 [2024-11-27 17:23:07.431468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:2236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.598 [2024-11-27 17:23:07.431512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:30:10.598 [2024-11-27 17:23:07.443749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee5c8 00:30:10.598 [2024-11-27 17:23:07.444126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.598 [2024-11-27 17:23:07.444160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:30:10.598 [2024-11-27 17:23:07.456522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190eff18 00:30:10.598 [2024-11-27 17:23:07.457124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:20573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.598 [2024-11-27 17:23:07.457157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:10.598 [2024-11-27 17:23:07.469088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190f4f40 00:30:10.598 [2024-11-27 17:23:07.469638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:23357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.598 [2024-11-27 17:23:07.469668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:10.598 [2024-11-27 17:23:07.481489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190e7818 00:30:10.598 [2024-11-27 17:23:07.482011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:75 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.482045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:10.599 [2024-11-27 17:23:07.494011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ea680 00:30:10.599 [2024-11-27 17:23:07.494476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:16492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.494509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:10.599 [2024-11-27 17:23:07.506304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ec840 00:30:10.599 [2024-11-27 17:23:07.506737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:15286 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.506767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:10.599 [2024-11-27 17:23:07.518668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ef270 00:30:10.599 [2024-11-27 17:23:07.519101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:6016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.519133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:30:10.599 [2024-11-27 17:23:07.532430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.599 [2024-11-27 17:23:07.532732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:6098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.532761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.599 [2024-11-27 17:23:07.546219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.599 [2024-11-27 17:23:07.546481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:16901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.599 [2024-11-27 17:23:07.546509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.559842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.560132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:1421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.560162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.573314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.573585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.573614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.587030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.587284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:11831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.587315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.600663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.600936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:16291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.600968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.614472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.614753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:9022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.614782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.628242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.628488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:6013 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.628518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.641958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.642214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:11472 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.642244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.655750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.857 [2024-11-27 17:23:07.656004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:12712 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.857 [2024-11-27 17:23:07.656036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.857 [2024-11-27 17:23:07.669475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.669748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:13208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.669775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.683338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.683606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:23929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.683649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.695748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.696000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:8547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.696031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.709471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.709722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.709764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.723230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.723477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:19671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.723508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.737051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.737307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.737337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.750745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.750997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:6178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.751028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.764495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.764746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.764780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.778212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.778459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:21162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.778489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.792027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.792280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:7192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.792311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:10.858 [2024-11-27 17:23:07.805707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:10.858 [2024-11-27 17:23:07.805959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:10679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.858 [2024-11-27 17:23:07.805989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.819310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.819580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.819608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.833107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.833362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:2093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.833392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.846774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.847058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15008 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.847089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.860510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.860775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:11573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.860817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.874214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.874465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:7463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.874495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.887898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.888160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:16879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.888191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.901670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.901924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:23070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.901955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.915235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.915490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:23073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.915521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.928880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.929137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:15026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.929167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.942515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.942798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.942841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.956192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.956444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:2269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.956474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.970007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.970253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:24178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.970283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.983793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.984060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.984091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:07.997625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:07.997917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:20370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:07.997949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:08.011376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:08.011655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:08.011683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:08.025197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:08.025478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:08.025506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:08.038549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:08.038820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:08.038847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:08.051789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:08.052013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:7616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:08.052056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.117 [2024-11-27 17:23:08.064570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.117 [2024-11-27 17:23:08.064794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:11251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.117 [2024-11-27 17:23:08.064822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.078099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.078347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.078378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.091751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.092008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:7492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.092039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.105459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.105749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.105778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.119219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.119466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15758 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.119505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.132959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.133215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.133248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.146714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.146982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.147014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.160457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.160728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1621 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.160757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.174209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.174456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:14575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.174487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.187967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.188219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.188250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.201734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.201998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:11500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.202030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.215204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.215451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:11687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.215479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.228568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.228792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.228835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.241331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.241613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.241641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.254919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.255172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.255204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.268621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.376 [2024-11-27 17:23:08.268877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:8534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.376 [2024-11-27 17:23:08.268908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.376 [2024-11-27 17:23:08.282373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.377 [2024-11-27 17:23:08.282641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.377 [2024-11-27 17:23:08.282670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.377 [2024-11-27 17:23:08.296091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.377 [2024-11-27 17:23:08.296334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:16492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.377 [2024-11-27 17:23:08.296365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.377 [2024-11-27 17:23:08.309775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.377 [2024-11-27 17:23:08.310033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:13407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.377 [2024-11-27 17:23:08.310064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.377 [2024-11-27 17:23:08.323417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.377 [2024-11-27 17:23:08.323676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:18800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.377 [2024-11-27 17:23:08.323704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.337002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.337253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:24616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.337283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.350736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.350998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.351029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.364327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.364596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:10191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.364624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.377926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.378177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:18801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.378209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.391651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.391916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:961 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.391948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.405453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.405740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:5778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.405783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.419179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.419432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:9322 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.419463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.432906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.433150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.635 [2024-11-27 17:23:08.433178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.635 [2024-11-27 17:23:08.446412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.635 [2024-11-27 17:23:08.446669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:18786 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.446698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.460183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.460429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.460459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.473255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.473506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:11170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.473551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.486983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.487235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.487266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.500629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.500904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:21169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.500935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.514330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.514598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:8704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.514627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.528118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.528371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.528402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.541888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.542141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:24922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.542172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.555579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.555813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.555854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.569180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.569426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20494 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.569457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.636 [2024-11-27 17:23:08.582803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.636 [2024-11-27 17:23:08.583068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:22366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.636 [2024-11-27 17:23:08.583099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.894 [2024-11-27 17:23:08.596164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.894 [2024-11-27 17:23:08.596427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10913 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.894 [2024-11-27 17:23:08.596457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.894 [2024-11-27 17:23:08.609941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.894 [2024-11-27 17:23:08.610188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:1462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.894 [2024-11-27 17:23:08.610219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.894 [2024-11-27 17:23:08.623672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.623920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.623952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.637408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.637659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:24694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.637702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.651152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.651396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:7892 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.651428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.664976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.665228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.665259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.678688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.678961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:19170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.678992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.692516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.692887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.692918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.706273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.706536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:5134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.706588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.720034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.720284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:11483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.720315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.733504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.733772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.733816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.747350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.747627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:9486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.747655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.761046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.761299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.761329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.774808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.775070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:12375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.775101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.788620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.788928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:4396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.788958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.802413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.802685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.802713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.816182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.816437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:14149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.816468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.829983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.830226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:812 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.830262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.895 [2024-11-27 17:23:08.843534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:11.895 [2024-11-27 17:23:08.843823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:10033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.895 [2024-11-27 17:23:08.843866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.153 [2024-11-27 17:23:08.857111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.153 [2024-11-27 17:23:08.857362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:12143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.153 [2024-11-27 17:23:08.857392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.153 [2024-11-27 17:23:08.870934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.153 [2024-11-27 17:23:08.871204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:22699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.153 [2024-11-27 17:23:08.871234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.153 [2024-11-27 17:23:08.884613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.884892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:18323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.884923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.898372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.898656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:6360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.898684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.912197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.912447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:16387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.912477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.925943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.926195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:5616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.926226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.939581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.939835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.939865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.953236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.953498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:24054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.953536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.966729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.966983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:13154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.967013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.980129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.980389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:19553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.980417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:08.993494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:08.993768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:8877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:08.993810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.007322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.007599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.007628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.021109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.021364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:15453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.021395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.034907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.035161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:20669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.035193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.048648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.048921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.048952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.062356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.062628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:21023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.062656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.075838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.076099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.076130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.089594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.154 [2024-11-27 17:23:09.089848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:8495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.154 [2024-11-27 17:23:09.089893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.154 [2024-11-27 17:23:09.103274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.103522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:7731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.103558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.117021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.117277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1798 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.117308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.130781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.131046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:23069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.131077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.144655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.144897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:4950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.144928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.158261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.158508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5283 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.158547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.172100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.172346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:13081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.172377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.185914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.186169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:10804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.186205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.199635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.199877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.199907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.213349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.213612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.213655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.227192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.227459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:95 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.227489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.240905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.241160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:17038 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.411 [2024-11-27 17:23:09.241203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.411 [2024-11-27 17:23:09.254497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.411 [2024-11-27 17:23:09.254766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.254809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.268201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.268449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.268479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.282005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.282257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:25422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.282287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.295767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.296040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.296070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.309502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.309813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.309859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.323330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.323601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9132 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.323627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.337068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.337321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:22731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.337351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.412 [2024-11-27 17:23:09.350897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.412 [2024-11-27 17:23:09.351152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.412 [2024-11-27 17:23:09.351183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 [2024-11-27 17:23:09.364505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.668 [2024-11-27 17:23:09.364765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:14751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.668 [2024-11-27 17:23:09.364793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 [2024-11-27 17:23:09.378261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.668 [2024-11-27 17:23:09.378535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:24321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.668 [2024-11-27 17:23:09.378580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 [2024-11-27 17:23:09.391969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.668 [2024-11-27 17:23:09.392218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:22571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.668 [2024-11-27 17:23:09.392248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 [2024-11-27 17:23:09.405764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.668 [2024-11-27 17:23:09.406033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:13284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.668 [2024-11-27 17:23:09.406064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 [2024-11-27 17:23:09.419505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aa920) with pdu=0x2000190ee190 00:30:12.668 [2024-11-27 17:23:09.419765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:24792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.668 [2024-11-27 17:23:09.419792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.668 00:30:12.669 Latency(us) 00:30:12.669 [2024-11-27T16:23:09.620Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.669 [2024-11-27T16:23:09.620Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:12.669 nvme0n1 : 2.01 18722.61 73.14 0.00 0.00 6821.29 3155.44 13981.01 00:30:12.669 [2024-11-27T16:23:09.620Z] =================================================================================================================== 00:30:12.669 [2024-11-27T16:23:09.620Z] Total : 18722.61 73.14 0.00 0.00 6821.29 3155.44 13981.01 00:30:12.669 0 00:30:12.669 17:23:09 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:12.669 17:23:09 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:12.669 17:23:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:12.669 17:23:09 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:12.669 | .driver_specific 00:30:12.669 | .nvme_error 00:30:12.669 | .status_code 00:30:12.669 | .command_transient_transport_error' 00:30:12.926 17:23:09 -- host/digest.sh@71 -- # (( 147 > 0 )) 00:30:12.926 17:23:09 -- host/digest.sh@73 -- # killprocess 1867710 00:30:12.926 17:23:09 -- common/autotest_common.sh@936 -- # '[' -z 1867710 ']' 00:30:12.926 17:23:09 -- common/autotest_common.sh@940 -- # kill -0 1867710 00:30:12.926 17:23:09 -- common/autotest_common.sh@941 -- # uname 00:30:12.926 17:23:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.926 17:23:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1867710 00:30:12.926 17:23:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:12.926 17:23:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:12.926 17:23:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1867710' 00:30:12.926 killing process with pid 1867710 00:30:12.926 17:23:09 -- common/autotest_common.sh@955 -- # kill 1867710 00:30:12.926 Received shutdown signal, test time was about 2.000000 seconds 00:30:12.926 00:30:12.926 Latency(us) 00:30:12.926 [2024-11-27T16:23:09.877Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.926 [2024-11-27T16:23:09.877Z] =================================================================================================================== 00:30:12.926 [2024-11-27T16:23:09.877Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:12.926 17:23:09 -- common/autotest_common.sh@960 -- # wait 1867710 00:30:13.184 17:23:09 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:13.184 17:23:09 -- host/digest.sh@54 -- # local rw bs qd 00:30:13.184 17:23:09 -- host/digest.sh@56 -- # rw=randwrite 00:30:13.184 17:23:09 -- host/digest.sh@56 -- # bs=131072 00:30:13.184 17:23:09 -- host/digest.sh@56 -- # qd=16 00:30:13.184 17:23:09 -- host/digest.sh@58 -- # bperfpid=1868136 00:30:13.184 17:23:09 -- host/digest.sh@60 -- # waitforlisten 1868136 /var/tmp/bperf.sock 00:30:13.184 17:23:09 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:13.184 17:23:09 -- common/autotest_common.sh@829 -- # '[' -z 1868136 ']' 00:30:13.184 17:23:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:13.184 17:23:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:13.184 17:23:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:13.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:13.184 17:23:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:13.184 17:23:09 -- common/autotest_common.sh@10 -- # set +x 00:30:13.184 [2024-11-27 17:23:10.021175] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:13.184 [2024-11-27 17:23:10.021261] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1868136 ] 00:30:13.184 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:13.184 Zero copy mechanism will not be used. 00:30:13.184 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.184 [2024-11-27 17:23:10.084398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:13.443 [2024-11-27 17:23:10.173971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:14.377 17:23:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:14.377 17:23:11 -- common/autotest_common.sh@862 -- # return 0 00:30:14.377 17:23:11 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:14.377 17:23:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:14.635 17:23:11 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:14.635 17:23:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.635 17:23:11 -- common/autotest_common.sh@10 -- # set +x 00:30:14.635 17:23:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.635 17:23:11 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.635 17:23:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.893 nvme0n1 00:30:14.893 17:23:11 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:14.893 17:23:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.893 17:23:11 -- common/autotest_common.sh@10 -- # set +x 00:30:14.893 17:23:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.893 17:23:11 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:14.893 17:23:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:15.152 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:15.152 Zero copy mechanism will not be used. 00:30:15.152 Running I/O for 2 seconds... 00:30:15.152 [2024-11-27 17:23:11.889127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.889457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.889500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.893989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.894160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.894196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.898490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.898648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.898680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.902931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.903053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.903084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.907066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.907183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.907223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.911488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.911625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.152 [2024-11-27 17:23:11.911655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.152 [2024-11-27 17:23:11.915967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.152 [2024-11-27 17:23:11.916116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.916145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.920554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.920808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.920839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.925260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.925447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.925477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.930490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.930679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.930709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.935812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.935910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.935953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.941401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.941494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.941531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.946663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.946754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.946782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.951919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.952053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.952082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.957227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.957392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.957422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.962345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.962576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.962605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.967000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.967210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.967239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.971099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.971233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.971262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.975315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.975446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.975475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.979390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.979505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.979542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.983512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.983646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.983675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.987610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.987757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.987789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.991754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.991911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.991940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:11.995930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:11.996156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:11.996185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.000048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.000261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.000290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.004373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.004503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.004539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.008631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.008745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.008773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.012834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.012961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.013009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.016918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.017043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.017072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.020969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.021120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.021148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.025049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.025196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.025231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.029226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.029463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.029496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.033307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.033547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.033576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.037480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.037654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.037684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.041594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.041711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.041744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.045642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.045761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.045789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.049758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.049873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.049902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.053879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.054028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.054057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.057967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.153 [2024-11-27 17:23:12.058116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.153 [2024-11-27 17:23:12.058145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.153 [2024-11-27 17:23:12.062253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.062498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.062534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.066375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.066598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.066628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.070563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.070708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.070737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.074696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.074828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.074857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.078756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.078878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.078909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.082885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.083015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.083044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.087054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.087203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.087232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.091273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.091468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.091497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.154 [2024-11-27 17:23:12.096475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.154 [2024-11-27 17:23:12.096764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.154 [2024-11-27 17:23:12.096793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.102237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.413 [2024-11-27 17:23:12.102430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.413 [2024-11-27 17:23:12.102458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.108097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.413 [2024-11-27 17:23:12.108277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.413 [2024-11-27 17:23:12.108310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.113892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.413 [2024-11-27 17:23:12.114077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.413 [2024-11-27 17:23:12.114109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.119479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.413 [2024-11-27 17:23:12.119611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.413 [2024-11-27 17:23:12.119641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.123930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.413 [2024-11-27 17:23:12.124036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.413 [2024-11-27 17:23:12.124064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.413 [2024-11-27 17:23:12.128432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.128614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.128648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.132718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.132872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.132901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.136944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.137186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.137215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.141660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.141960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.141995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.147026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.147219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.147250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.152142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.152297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.152329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.157176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.157348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.157378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.162398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.162553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.162586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.167646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.167858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.167887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.172732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.172955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.172984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.178100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.178415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.178444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.182724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.182941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.182972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.187840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.188090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.188123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.193385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.193499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.193539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.199485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.199632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.199659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.205996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.206106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.206131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.212322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.212498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.212553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.218881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.219116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.219145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.225762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.226050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.226080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.232044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.232345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.232374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.238664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.238916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.238950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.244953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.245153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.245182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.251462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.251682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.251712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.257906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.258037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.258066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.414 [2024-11-27 17:23:12.264284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.414 [2024-11-27 17:23:12.264434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.414 [2024-11-27 17:23:12.264462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.270965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.271180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.271209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.277408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.277556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.277585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.284025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.284185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.284214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.290404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.290541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.290573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.296913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.297070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.297101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.303450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.303630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.303659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.310123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.310288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.310317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.316709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.316988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.317017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.322232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.322415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.322445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.327194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.327316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.327344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.332591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.332835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.332864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.338484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.338688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.338717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.344048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.344291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.344320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.349510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.349703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.349732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.355279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.355423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.355452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.415 [2024-11-27 17:23:12.360822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.415 [2024-11-27 17:23:12.361032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.415 [2024-11-27 17:23:12.361061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.367086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.367225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.367254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.373131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.373301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.373329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.379313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.379592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.379621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.385790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.385932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.385961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.392748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.392955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.392985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.399209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.399290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.399326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.404513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.404625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.404654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.408717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.408839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.408871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.412764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.412866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.412896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.416887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.417016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.417046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.420980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.421166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.421196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.426103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.426301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.426333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.430868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.431087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.431121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.435011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.435174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.435204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.439311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.439483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.439514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.444250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.444370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.444403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.448959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.449111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.449145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.453185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.453301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.453336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.457472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.457652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.457683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.461721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.676 [2024-11-27 17:23:12.461945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.676 [2024-11-27 17:23:12.461980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.676 [2024-11-27 17:23:12.466026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.466248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.466283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.470633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.470751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.470784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.475174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.475331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.475362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.479385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.479532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.479576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.483759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.483941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.483986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.487988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.488111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.488143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.492558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.492743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.492775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.498235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.498518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.498572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.503676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.503926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.503956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.509122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.509298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.509330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.514659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.514857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.514886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.519985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.520146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.520181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.526318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.526480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.526509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.532359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.532538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.532568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.537986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.538195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.538226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.543658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.543904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.543933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.549406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.549557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.549586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.555443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.555689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.555718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.561338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.561500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.561536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.567006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.567205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.567234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.573227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.573451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.573480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.579043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.579180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.579209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.584326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.584453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.584482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.588779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.588997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.589025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.593094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.593343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.593372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.597835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.597957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.677 [2024-11-27 17:23:12.597986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.677 [2024-11-27 17:23:12.602700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.677 [2024-11-27 17:23:12.602842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.678 [2024-11-27 17:23:12.602869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.678 [2024-11-27 17:23:12.606944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.678 [2024-11-27 17:23:12.607089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.678 [2024-11-27 17:23:12.607119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.678 [2024-11-27 17:23:12.611222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.678 [2024-11-27 17:23:12.611379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.678 [2024-11-27 17:23:12.611416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.678 [2024-11-27 17:23:12.615717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.678 [2024-11-27 17:23:12.615859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.678 [2024-11-27 17:23:12.615889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.678 [2024-11-27 17:23:12.620911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.678 [2024-11-27 17:23:12.621192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.678 [2024-11-27 17:23:12.621221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.626105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.626311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.626341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.631757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.631915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.631944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.637191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.637470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.637500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.642374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.642610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.642640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.647917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.648147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.648178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.653958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.654155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.654189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.659577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.659740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.659769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.663857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.663968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.663997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.668264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.938 [2024-11-27 17:23:12.668414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.938 [2024-11-27 17:23:12.668443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.938 [2024-11-27 17:23:12.673304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.673386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.673413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.678223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.678407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.678441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.683734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.683927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.683956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.689940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.690166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.690196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.695899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.696076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.696106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.701976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.702135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.702163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.708245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.708441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.708470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.714367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.714509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.714549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.720157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.720342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.720371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.725790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.725947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.725979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.732336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.732652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.732682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.738420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.738711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.738740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.744920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.745047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.745077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.750654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.750808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.750838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.756351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.756504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.756548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.761593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.761743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.761772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.766752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.766918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.766952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.770913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.771014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.771043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.775216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.775422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.775451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.779844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.780067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.780095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.785077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.785198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.785227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.789765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.789872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.789904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.793980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.794091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.794120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.798216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.798356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.798384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.802535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.802614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.802641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.939 [2024-11-27 17:23:12.806830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.939 [2024-11-27 17:23:12.806982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.939 [2024-11-27 17:23:12.807013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.811507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.811688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.811721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.815725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.815910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.815939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.819953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.820109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.820138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.824137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.824237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.824266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.828253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.828352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.828381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.832433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.832592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.832622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.836692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.836805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.836834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.841030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.841163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.841192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.845426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.845631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.845660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.849722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.849887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.849915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.853964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.854119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.854149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.858185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.858304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.858333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.862486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.862598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.862627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.866758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.866892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.866921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.870945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.871045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.871081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.875085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.875222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.875252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.879241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.879440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.879469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.940 [2024-11-27 17:23:12.883464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:15.940 [2024-11-27 17:23:12.883637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.940 [2024-11-27 17:23:12.883667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.201 [2024-11-27 17:23:12.887723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.201 [2024-11-27 17:23:12.887878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.201 [2024-11-27 17:23:12.887907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.201 [2024-11-27 17:23:12.892031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.201 [2024-11-27 17:23:12.892193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.201 [2024-11-27 17:23:12.892221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.201 [2024-11-27 17:23:12.897033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.201 [2024-11-27 17:23:12.897197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.201 [2024-11-27 17:23:12.897225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.201 [2024-11-27 17:23:12.902998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.201 [2024-11-27 17:23:12.903226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.201 [2024-11-27 17:23:12.903254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.908570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.908701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.908729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.914011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.914178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.914207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.920323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.920578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.920609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.926084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.926329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.926361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.932074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.932237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.932265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.937574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.937795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.937824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.943148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.943351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.943379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.948920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.949076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.949104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.954774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.954928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.954956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.960522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.960680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.960708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.966607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.966742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.966770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.972410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.972562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.972601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.978109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.978381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.978411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.984036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.984236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.984264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.989740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.989903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.989931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:12.995508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:12.995689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:12.995721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.001349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.001537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.001567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.007041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.007304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.007333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.012833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.013020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.013052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.018743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.019050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.019079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.024345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.024651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.024683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.029514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.029794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.029822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.035290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.035369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.035400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.040992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.041100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.041127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.047023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.202 [2024-11-27 17:23:13.047234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.202 [2024-11-27 17:23:13.047263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.202 [2024-11-27 17:23:13.053324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.053585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.053613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.059287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.059477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.059505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.065684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.065989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.066018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.071867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.072081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.072114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.078001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.078144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.078172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.084518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.084705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.084733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.091017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.091191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.091221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.097314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.097394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.097421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.102650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.102813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.102842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.106832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.106982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.107012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.111173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.111401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.111441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.115430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.115660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.115689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.119766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.119945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.119974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.123851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.123975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.124004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.128001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.128118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.128147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.132093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.132199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.132227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.136196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.136362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.136391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.140336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.140512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.140549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.144665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.144891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.144920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.203 [2024-11-27 17:23:13.148908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.203 [2024-11-27 17:23:13.149122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.203 [2024-11-27 17:23:13.149151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.153133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.153318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.153349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.157270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.157402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.157433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.161372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.161493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.161522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.165440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.165549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.165582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.169697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.169865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.169895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.173920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.174053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.174083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.178101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.178329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.178358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.182203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.182410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.182439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.186296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.186447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.186479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.190360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.190482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.190511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.194569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.194681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.462 [2024-11-27 17:23:13.194710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.462 [2024-11-27 17:23:13.198688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.462 [2024-11-27 17:23:13.198791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.198819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.203045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.203210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.203238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.207245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.207415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.207445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.212111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.212377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.212406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.217833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.218077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.218106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.222988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.223181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.223220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.228067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.228247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.228277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.233085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.233244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.233273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.238826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.238958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.238986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.244597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.244800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.244829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.250590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.250719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.250748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.256806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.257114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.257162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.263197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.263387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.263416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.268602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.268766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.268795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.272969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.273113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.273143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.277211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.277365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.277394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.281517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.281649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.281677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.285920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.286072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.286105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.290562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.290694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.290727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.294889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.295091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.295120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.300023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.300289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.300318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.305339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.305484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.305513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.311025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.311160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.311190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.316977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.317163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.317192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.322325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.322517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.322554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.327657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.327871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.327904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.332782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.332984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.333012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.338474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.338766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.338795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.344908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.345103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.345131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.349774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.349941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.349970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.354186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.354342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.354371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.358627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.358748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.358786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.362794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.362915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.362945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.367065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.367230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.367258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.371270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.371418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.371446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.375623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.375853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.375887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.379847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.380073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.380102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.384135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.463 [2024-11-27 17:23:13.384321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.463 [2024-11-27 17:23:13.384352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.463 [2024-11-27 17:23:13.388334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.464 [2024-11-27 17:23:13.388441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.464 [2024-11-27 17:23:13.388469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.464 [2024-11-27 17:23:13.392886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.464 [2024-11-27 17:23:13.392990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.464 [2024-11-27 17:23:13.393018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.464 [2024-11-27 17:23:13.397356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.464 [2024-11-27 17:23:13.397432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.464 [2024-11-27 17:23:13.397459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.464 [2024-11-27 17:23:13.401605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.464 [2024-11-27 17:23:13.401768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.464 [2024-11-27 17:23:13.401796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.464 [2024-11-27 17:23:13.406612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.464 [2024-11-27 17:23:13.406735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.464 [2024-11-27 17:23:13.406763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.412013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.412323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.412355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.418363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.418665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.418696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.423901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.424042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.424075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.429338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.429493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.429522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.434239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.434377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.434407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.438601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.438744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.438781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.442966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.443149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.443178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.447285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.447432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.447463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.451652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.451884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.451914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.455986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.456177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.456206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.460388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.460536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.460565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.464948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.465082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.465110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.470010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.470188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.470218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.475634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.475777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.475806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.480477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.480665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.480694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.485110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.485268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.485298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.489854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.490061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.490090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.494542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.494748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.494780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.723 [2024-11-27 17:23:13.499709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.723 [2024-11-27 17:23:13.499887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.723 [2024-11-27 17:23:13.499917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.504151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.504289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.504318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.509497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.509673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.509703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.514741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.514911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.514940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.519987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.520196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.520225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.525302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.525467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.525497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.531032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.531226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.531256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.537002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.537228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.537258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.543175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.543295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.543326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.549693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.549845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.549874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.556184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.556303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.556332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.562567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.562718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.562747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.568896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.569054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.569083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.573637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.573806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.573846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.578098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.578324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.578353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.582239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.582457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.582486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.586548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.586725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.586755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.590940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.591086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.591115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.595197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.595286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.595314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.599469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.599576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.599608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.603858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.604023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.604053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.608177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.608281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.608311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.612542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.612765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.612795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.616909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.617105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.617134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.621228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.621353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.621387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.724 [2024-11-27 17:23:13.625735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.724 [2024-11-27 17:23:13.625873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.724 [2024-11-27 17:23:13.625901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.630025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.630141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.630170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.634208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.634308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.634337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.638506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.638683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.638712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.642822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.642975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.643004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.647191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.647384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.647412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.651626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.651801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.651830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.655946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.656066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.656095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.660252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.660402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.660434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.664627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.664727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.664754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.725 [2024-11-27 17:23:13.668860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.725 [2024-11-27 17:23:13.668942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.725 [2024-11-27 17:23:13.668974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.673451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.673602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.673633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.678053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.678204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.678237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.682507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.682743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.682773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.687130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.687271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.687307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.691538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.691686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.691716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.695896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.696041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.696070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.700402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.700510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.700545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.705089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.705166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.705195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.709811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.709968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.709997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.714388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.714562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.714601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.719406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.719636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.719668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.723909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.724099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.724127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.729044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.729254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.729283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.734948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.735214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.735258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.740169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.740372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.740416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.744810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.744947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.744976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.749768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.749973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.750006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.754812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.754997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.755026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.758993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.759130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.759159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.763263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.763443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.763472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.767485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.767704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.984 [2024-11-27 17:23:13.767733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.984 [2024-11-27 17:23:13.771850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.984 [2024-11-27 17:23:13.772021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.772050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.776625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.776720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.776747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.781521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.781646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.781675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.786314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.786510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.786547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.790538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.790710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.790739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.794733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.794964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.794994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.798858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.799049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.799079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.803054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.803199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.803232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.807275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.807425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.807460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.811956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.812091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.812120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.816081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.816194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.816224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.820214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.820393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.820423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.824269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.824428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.824457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.828424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.828689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.828718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.832582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.832727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.832756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.837718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.837832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.837860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.841997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.842166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.842196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.846069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.846214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.846242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.850222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.850360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.850389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.855362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.855575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.855604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.860748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.861015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.861044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.866908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.867217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.867246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.873228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.873435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.873464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.985 [2024-11-27 17:23:13.879271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17aaac0) with pdu=0x2000190fef90 00:30:16.985 [2024-11-27 17:23:13.879470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.985 [2024-11-27 17:23:13.879500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.985 00:30:16.985 Latency(us) 00:30:16.985 [2024-11-27T16:23:13.936Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.985 [2024-11-27T16:23:13.936Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:16.985 nvme0n1 : 2.00 6201.00 775.13 0.00 0.00 2572.73 1686.95 10922.67 00:30:16.985 [2024-11-27T16:23:13.936Z] =================================================================================================================== 00:30:16.986 [2024-11-27T16:23:13.937Z] Total : 6201.00 775.13 0.00 0.00 2572.73 1686.95 10922.67 00:30:16.986 0 00:30:16.986 17:23:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:16.986 17:23:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:16.986 17:23:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:16.986 | .driver_specific 00:30:16.986 | .nvme_error 00:30:16.986 | .status_code 00:30:16.986 | .command_transient_transport_error' 00:30:16.986 17:23:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:17.243 17:23:14 -- host/digest.sh@71 -- # (( 400 > 0 )) 00:30:17.243 17:23:14 -- host/digest.sh@73 -- # killprocess 1868136 00:30:17.243 17:23:14 -- common/autotest_common.sh@936 -- # '[' -z 1868136 ']' 00:30:17.243 17:23:14 -- common/autotest_common.sh@940 -- # kill -0 1868136 00:30:17.243 17:23:14 -- common/autotest_common.sh@941 -- # uname 00:30:17.243 17:23:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:17.243 17:23:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1868136 00:30:17.500 17:23:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:17.500 17:23:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:17.500 17:23:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1868136' 00:30:17.500 killing process with pid 1868136 00:30:17.500 17:23:14 -- common/autotest_common.sh@955 -- # kill 1868136 00:30:17.500 Received shutdown signal, test time was about 2.000000 seconds 00:30:17.500 00:30:17.500 Latency(us) 00:30:17.500 [2024-11-27T16:23:14.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:17.500 [2024-11-27T16:23:14.451Z] =================================================================================================================== 00:30:17.500 [2024-11-27T16:23:14.451Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:17.500 17:23:14 -- common/autotest_common.sh@960 -- # wait 1868136 00:30:17.500 17:23:14 -- host/digest.sh@115 -- # killprocess 1866581 00:30:17.500 17:23:14 -- common/autotest_common.sh@936 -- # '[' -z 1866581 ']' 00:30:17.500 17:23:14 -- common/autotest_common.sh@940 -- # kill -0 1866581 00:30:17.500 17:23:14 -- common/autotest_common.sh@941 -- # uname 00:30:17.500 17:23:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:17.500 17:23:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1866581 00:30:17.761 17:23:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:17.761 17:23:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:17.761 17:23:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1866581' 00:30:17.761 killing process with pid 1866581 00:30:17.761 17:23:14 -- common/autotest_common.sh@955 -- # kill 1866581 00:30:17.761 17:23:14 -- common/autotest_common.sh@960 -- # wait 1866581 00:30:18.024 00:30:18.024 real 0m17.594s 00:30:18.024 user 0m35.817s 00:30:18.024 sys 0m4.494s 00:30:18.024 17:23:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:18.024 17:23:14 -- common/autotest_common.sh@10 -- # set +x 00:30:18.024 ************************************ 00:30:18.024 END TEST nvmf_digest_error 00:30:18.024 ************************************ 00:30:18.024 17:23:14 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:18.024 17:23:14 -- host/digest.sh@139 -- # nvmftestfini 00:30:18.024 17:23:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:18.024 17:23:14 -- nvmf/common.sh@116 -- # sync 00:30:18.024 17:23:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:18.024 17:23:14 -- nvmf/common.sh@119 -- # set +e 00:30:18.024 17:23:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:18.024 17:23:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:18.024 rmmod nvme_tcp 00:30:18.024 rmmod nvme_fabrics 00:30:18.024 rmmod nvme_keyring 00:30:18.024 17:23:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:18.024 17:23:14 -- nvmf/common.sh@123 -- # set -e 00:30:18.024 17:23:14 -- nvmf/common.sh@124 -- # return 0 00:30:18.024 17:23:14 -- nvmf/common.sh@477 -- # '[' -n 1866581 ']' 00:30:18.024 17:23:14 -- nvmf/common.sh@478 -- # killprocess 1866581 00:30:18.024 17:23:14 -- common/autotest_common.sh@936 -- # '[' -z 1866581 ']' 00:30:18.024 17:23:14 -- common/autotest_common.sh@940 -- # kill -0 1866581 00:30:18.024 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1866581) - No such process 00:30:18.024 17:23:14 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1866581 is not found' 00:30:18.024 Process with pid 1866581 is not found 00:30:18.024 17:23:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:18.024 17:23:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:18.024 17:23:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:18.024 17:23:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:18.024 17:23:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:18.024 17:23:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:18.024 17:23:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:18.024 17:23:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:19.926 17:23:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:19.926 00:30:19.926 real 0m37.644s 00:30:19.926 user 1m7.308s 00:30:19.926 sys 0m10.655s 00:30:19.926 17:23:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:19.926 17:23:16 -- common/autotest_common.sh@10 -- # set +x 00:30:19.926 ************************************ 00:30:19.926 END TEST nvmf_digest 00:30:19.926 ************************************ 00:30:20.186 17:23:16 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:20.186 17:23:16 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:20.186 17:23:16 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:20.186 17:23:16 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:20.186 17:23:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:20.186 17:23:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:20.186 17:23:16 -- common/autotest_common.sh@10 -- # set +x 00:30:20.186 ************************************ 00:30:20.186 START TEST nvmf_bdevperf 00:30:20.186 ************************************ 00:30:20.186 17:23:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:20.186 * Looking for test storage... 00:30:20.186 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:20.186 17:23:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:20.186 17:23:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:20.186 17:23:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:20.186 17:23:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:20.186 17:23:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:20.186 17:23:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:20.186 17:23:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:20.186 17:23:17 -- scripts/common.sh@335 -- # IFS=.-: 00:30:20.186 17:23:17 -- scripts/common.sh@335 -- # read -ra ver1 00:30:20.186 17:23:17 -- scripts/common.sh@336 -- # IFS=.-: 00:30:20.186 17:23:17 -- scripts/common.sh@336 -- # read -ra ver2 00:30:20.186 17:23:17 -- scripts/common.sh@337 -- # local 'op=<' 00:30:20.186 17:23:17 -- scripts/common.sh@339 -- # ver1_l=2 00:30:20.186 17:23:17 -- scripts/common.sh@340 -- # ver2_l=1 00:30:20.186 17:23:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:20.186 17:23:17 -- scripts/common.sh@343 -- # case "$op" in 00:30:20.186 17:23:17 -- scripts/common.sh@344 -- # : 1 00:30:20.186 17:23:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:20.186 17:23:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:20.186 17:23:17 -- scripts/common.sh@364 -- # decimal 1 00:30:20.186 17:23:17 -- scripts/common.sh@352 -- # local d=1 00:30:20.186 17:23:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:20.186 17:23:17 -- scripts/common.sh@354 -- # echo 1 00:30:20.186 17:23:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:20.186 17:23:17 -- scripts/common.sh@365 -- # decimal 2 00:30:20.186 17:23:17 -- scripts/common.sh@352 -- # local d=2 00:30:20.186 17:23:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:20.186 17:23:17 -- scripts/common.sh@354 -- # echo 2 00:30:20.186 17:23:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:20.186 17:23:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:20.186 17:23:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:20.186 17:23:17 -- scripts/common.sh@367 -- # return 0 00:30:20.186 17:23:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:20.186 17:23:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:20.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.186 --rc genhtml_branch_coverage=1 00:30:20.186 --rc genhtml_function_coverage=1 00:30:20.186 --rc genhtml_legend=1 00:30:20.186 --rc geninfo_all_blocks=1 00:30:20.186 --rc geninfo_unexecuted_blocks=1 00:30:20.186 00:30:20.186 ' 00:30:20.186 17:23:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:20.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.186 --rc genhtml_branch_coverage=1 00:30:20.186 --rc genhtml_function_coverage=1 00:30:20.186 --rc genhtml_legend=1 00:30:20.186 --rc geninfo_all_blocks=1 00:30:20.186 --rc geninfo_unexecuted_blocks=1 00:30:20.186 00:30:20.186 ' 00:30:20.186 17:23:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:20.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.186 --rc genhtml_branch_coverage=1 00:30:20.186 --rc genhtml_function_coverage=1 00:30:20.186 --rc genhtml_legend=1 00:30:20.186 --rc geninfo_all_blocks=1 00:30:20.186 --rc geninfo_unexecuted_blocks=1 00:30:20.186 00:30:20.186 ' 00:30:20.186 17:23:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:20.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.186 --rc genhtml_branch_coverage=1 00:30:20.186 --rc genhtml_function_coverage=1 00:30:20.186 --rc genhtml_legend=1 00:30:20.186 --rc geninfo_all_blocks=1 00:30:20.186 --rc geninfo_unexecuted_blocks=1 00:30:20.186 00:30:20.186 ' 00:30:20.186 17:23:17 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:20.186 17:23:17 -- nvmf/common.sh@7 -- # uname -s 00:30:20.186 17:23:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:20.186 17:23:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:20.186 17:23:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:20.186 17:23:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:20.186 17:23:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:20.186 17:23:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:20.186 17:23:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:20.186 17:23:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:20.186 17:23:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:20.186 17:23:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:20.186 17:23:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:20.186 17:23:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:20.186 17:23:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:20.186 17:23:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:20.186 17:23:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:20.186 17:23:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:20.186 17:23:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:20.186 17:23:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:20.186 17:23:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:20.186 17:23:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.186 17:23:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.186 17:23:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.186 17:23:17 -- paths/export.sh@5 -- # export PATH 00:30:20.186 17:23:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.186 17:23:17 -- nvmf/common.sh@46 -- # : 0 00:30:20.187 17:23:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:20.187 17:23:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:20.187 17:23:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:20.187 17:23:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:20.187 17:23:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:20.187 17:23:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:20.187 17:23:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:20.187 17:23:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:20.187 17:23:17 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:20.187 17:23:17 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:20.187 17:23:17 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:20.187 17:23:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:20.187 17:23:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:20.187 17:23:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:20.187 17:23:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:20.187 17:23:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:20.187 17:23:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:20.187 17:23:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:20.187 17:23:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:20.187 17:23:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:20.187 17:23:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:20.187 17:23:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:20.187 17:23:17 -- common/autotest_common.sh@10 -- # set +x 00:30:22.803 17:23:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:22.803 17:23:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:22.803 17:23:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:22.803 17:23:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:22.803 17:23:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:22.803 17:23:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:22.803 17:23:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:22.803 17:23:19 -- nvmf/common.sh@294 -- # net_devs=() 00:30:22.803 17:23:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:22.803 17:23:19 -- nvmf/common.sh@295 -- # e810=() 00:30:22.803 17:23:19 -- nvmf/common.sh@295 -- # local -ga e810 00:30:22.803 17:23:19 -- nvmf/common.sh@296 -- # x722=() 00:30:22.803 17:23:19 -- nvmf/common.sh@296 -- # local -ga x722 00:30:22.803 17:23:19 -- nvmf/common.sh@297 -- # mlx=() 00:30:22.803 17:23:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:22.803 17:23:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:22.803 17:23:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:22.803 17:23:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:22.803 17:23:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:22.803 17:23:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:22.803 17:23:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:22.803 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:22.803 17:23:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:22.803 17:23:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:22.803 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:22.803 17:23:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:22.803 17:23:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:22.803 17:23:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:22.804 17:23:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:22.804 17:23:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:22.804 17:23:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:22.804 17:23:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:22.804 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:22.804 17:23:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:22.804 17:23:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:22.804 17:23:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:22.804 17:23:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:22.804 17:23:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:22.804 17:23:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:22.804 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:22.804 17:23:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:22.804 17:23:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:22.804 17:23:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:22.804 17:23:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:22.804 17:23:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:22.804 17:23:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:22.804 17:23:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:22.804 17:23:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:22.804 17:23:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:22.804 17:23:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:22.804 17:23:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:22.804 17:23:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:22.804 17:23:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:22.804 17:23:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:22.804 17:23:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:22.804 17:23:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:22.804 17:23:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:22.804 17:23:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:22.804 17:23:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:22.804 17:23:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:22.804 17:23:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:22.804 17:23:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:22.804 17:23:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:22.804 17:23:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:22.804 17:23:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:22.804 17:23:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:22.804 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:22.804 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:30:22.804 00:30:22.804 --- 10.0.0.2 ping statistics --- 00:30:22.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:22.804 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:30:22.804 17:23:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:22.804 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:22.804 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:30:22.804 00:30:22.804 --- 10.0.0.1 ping statistics --- 00:30:22.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:22.804 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:30:22.804 17:23:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:22.804 17:23:19 -- nvmf/common.sh@410 -- # return 0 00:30:22.804 17:23:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:22.804 17:23:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:22.804 17:23:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:22.804 17:23:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:22.804 17:23:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:22.804 17:23:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:22.804 17:23:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:22.804 17:23:19 -- host/bdevperf.sh@25 -- # tgt_init 00:30:22.804 17:23:19 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:22.804 17:23:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:22.804 17:23:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:22.804 17:23:19 -- common/autotest_common.sh@10 -- # set +x 00:30:22.804 17:23:19 -- nvmf/common.sh@469 -- # nvmfpid=1870772 00:30:22.804 17:23:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:22.804 17:23:19 -- nvmf/common.sh@470 -- # waitforlisten 1870772 00:30:22.804 17:23:19 -- common/autotest_common.sh@829 -- # '[' -z 1870772 ']' 00:30:22.804 17:23:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:22.804 17:23:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:22.804 17:23:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:22.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:22.804 17:23:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:22.804 17:23:19 -- common/autotest_common.sh@10 -- # set +x 00:30:22.804 [2024-11-27 17:23:19.494729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:22.804 [2024-11-27 17:23:19.494799] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:22.804 EAL: No free 2048 kB hugepages reported on node 1 00:30:22.804 [2024-11-27 17:23:19.561177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:22.804 [2024-11-27 17:23:19.653057] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:22.804 [2024-11-27 17:23:19.653226] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:22.804 [2024-11-27 17:23:19.653243] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:22.804 [2024-11-27 17:23:19.653255] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:22.804 [2024-11-27 17:23:19.653348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:22.804 [2024-11-27 17:23:19.653466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:22.804 [2024-11-27 17:23:19.653468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:23.738 17:23:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:23.738 17:23:20 -- common/autotest_common.sh@862 -- # return 0 00:30:23.738 17:23:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:23.738 17:23:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 17:23:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:23.738 17:23:20 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:23.738 17:23:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 [2024-11-27 17:23:20.568685] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:23.738 17:23:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.738 17:23:20 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:23.738 17:23:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 Malloc0 00:30:23.738 17:23:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.738 17:23:20 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:23.738 17:23:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 17:23:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.738 17:23:20 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:23.738 17:23:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 17:23:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.738 17:23:20 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:23.738 17:23:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.738 17:23:20 -- common/autotest_common.sh@10 -- # set +x 00:30:23.738 [2024-11-27 17:23:20.630519] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:23.738 17:23:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.738 17:23:20 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:23.738 17:23:20 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:23.738 17:23:20 -- nvmf/common.sh@520 -- # config=() 00:30:23.738 17:23:20 -- nvmf/common.sh@520 -- # local subsystem config 00:30:23.739 17:23:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:23.739 17:23:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:23.739 { 00:30:23.739 "params": { 00:30:23.739 "name": "Nvme$subsystem", 00:30:23.739 "trtype": "$TEST_TRANSPORT", 00:30:23.739 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:23.739 "adrfam": "ipv4", 00:30:23.739 "trsvcid": "$NVMF_PORT", 00:30:23.739 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:23.739 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:23.739 "hdgst": ${hdgst:-false}, 00:30:23.739 "ddgst": ${ddgst:-false} 00:30:23.739 }, 00:30:23.739 "method": "bdev_nvme_attach_controller" 00:30:23.739 } 00:30:23.739 EOF 00:30:23.739 )") 00:30:23.739 17:23:20 -- nvmf/common.sh@542 -- # cat 00:30:23.739 17:23:20 -- nvmf/common.sh@544 -- # jq . 00:30:23.739 17:23:20 -- nvmf/common.sh@545 -- # IFS=, 00:30:23.739 17:23:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:23.739 "params": { 00:30:23.739 "name": "Nvme1", 00:30:23.739 "trtype": "tcp", 00:30:23.739 "traddr": "10.0.0.2", 00:30:23.739 "adrfam": "ipv4", 00:30:23.739 "trsvcid": "4420", 00:30:23.739 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:23.739 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:23.739 "hdgst": false, 00:30:23.739 "ddgst": false 00:30:23.739 }, 00:30:23.739 "method": "bdev_nvme_attach_controller" 00:30:23.739 }' 00:30:23.739 [2024-11-27 17:23:20.677583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:23.739 [2024-11-27 17:23:20.677650] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1870928 ] 00:30:23.997 EAL: No free 2048 kB hugepages reported on node 1 00:30:23.997 [2024-11-27 17:23:20.736924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:23.997 [2024-11-27 17:23:20.823979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:24.255 Running I/O for 1 seconds... 00:30:25.630 00:30:25.630 Latency(us) 00:30:25.630 [2024-11-27T16:23:22.581Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.630 [2024-11-27T16:23:22.581Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:25.630 Verification LBA range: start 0x0 length 0x4000 00:30:25.630 Nvme1n1 : 1.01 12637.20 49.36 0.00 0.00 10081.25 1377.47 17476.27 00:30:25.630 [2024-11-27T16:23:22.581Z] =================================================================================================================== 00:30:25.630 [2024-11-27T16:23:22.581Z] Total : 12637.20 49.36 0.00 0.00 10081.25 1377.47 17476.27 00:30:25.630 17:23:22 -- host/bdevperf.sh@30 -- # bdevperfpid=1871082 00:30:25.630 17:23:22 -- host/bdevperf.sh@32 -- # sleep 3 00:30:25.630 17:23:22 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:25.630 17:23:22 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:25.630 17:23:22 -- nvmf/common.sh@520 -- # config=() 00:30:25.630 17:23:22 -- nvmf/common.sh@520 -- # local subsystem config 00:30:25.630 17:23:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:25.630 17:23:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:25.630 { 00:30:25.631 "params": { 00:30:25.631 "name": "Nvme$subsystem", 00:30:25.631 "trtype": "$TEST_TRANSPORT", 00:30:25.631 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:25.631 "adrfam": "ipv4", 00:30:25.631 "trsvcid": "$NVMF_PORT", 00:30:25.631 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:25.631 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:25.631 "hdgst": ${hdgst:-false}, 00:30:25.631 "ddgst": ${ddgst:-false} 00:30:25.631 }, 00:30:25.631 "method": "bdev_nvme_attach_controller" 00:30:25.631 } 00:30:25.631 EOF 00:30:25.631 )") 00:30:25.631 17:23:22 -- nvmf/common.sh@542 -- # cat 00:30:25.631 17:23:22 -- nvmf/common.sh@544 -- # jq . 00:30:25.631 17:23:22 -- nvmf/common.sh@545 -- # IFS=, 00:30:25.631 17:23:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:25.631 "params": { 00:30:25.631 "name": "Nvme1", 00:30:25.631 "trtype": "tcp", 00:30:25.631 "traddr": "10.0.0.2", 00:30:25.631 "adrfam": "ipv4", 00:30:25.631 "trsvcid": "4420", 00:30:25.631 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:25.631 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:25.631 "hdgst": false, 00:30:25.631 "ddgst": false 00:30:25.631 }, 00:30:25.631 "method": "bdev_nvme_attach_controller" 00:30:25.631 }' 00:30:25.631 [2024-11-27 17:23:22.432690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:25.631 [2024-11-27 17:23:22.432766] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1871082 ] 00:30:25.631 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.631 [2024-11-27 17:23:22.491710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:25.631 [2024-11-27 17:23:22.577405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:26.197 Running I/O for 15 seconds... 00:30:28.729 17:23:25 -- host/bdevperf.sh@33 -- # kill -9 1870772 00:30:28.729 17:23:25 -- host/bdevperf.sh@35 -- # sleep 3 00:30:28.729 [2024-11-27 17:23:25.402987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:121600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:121640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:121648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:121656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:121664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:121672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:121680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:121688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:121696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:121704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:121712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:121720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.729 [2024-11-27 17:23:25.403452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:121728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.729 [2024-11-27 17:23:25.403484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.729 [2024-11-27 17:23:25.403501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:121736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:121744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.403560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:121752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:121760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:121768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.403667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:121008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:121024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:121040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:121056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:121064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:121072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:121080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:121088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.403971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:121776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.403986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:121784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:121792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:121800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:121808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:121816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:121824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:121832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:121840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:121848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:121856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:121864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.730 [2024-11-27 17:23:25.404336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:121872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:121112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:121120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:121136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:121160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.730 [2024-11-27 17:23:25.404492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.730 [2024-11-27 17:23:25.404509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:121184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:121192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:121200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:121208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:121240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:121256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:121272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:121280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:121304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:121320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:121328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:121336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:121888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.404957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.404973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:121896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.404988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:121904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:121912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:121920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:121928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:121936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:121944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:121952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:121960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:121968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:121976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:121984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:121992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.731 [2024-11-27 17:23:25.405373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:122000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:122008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.731 [2024-11-27 17:23:25.405488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:122024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.731 [2024-11-27 17:23:25.405502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:122032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:122040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:122048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:122056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:122064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:122072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:122080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:122088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:122096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:122104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:122112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:122120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:122128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:122136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.405968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.405985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:122144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.405999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:122152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.406031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:122160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.406062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:122168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.732 [2024-11-27 17:23:25.406094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:121344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:121360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:121368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:121376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:121392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:121400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:121408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:121416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:121424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:121440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:121448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.732 [2024-11-27 17:23:25.406459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:121464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.732 [2024-11-27 17:23:25.406473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:121472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:121480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:121488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:121528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:122176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:122192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:122200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:122208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:122216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:122224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:122232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:122240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:122248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:122256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:28.733 [2024-11-27 17:23:25.406968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.406984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:122264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.406999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:121568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:121576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:121584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:121592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:121608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:121616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:121624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.733 [2024-11-27 17:23:25.407225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13a99a0 is same with the state(5) to be set 00:30:28.733 [2024-11-27 17:23:25.407259] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:28.733 [2024-11-27 17:23:25.407271] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:28.733 [2024-11-27 17:23:25.407284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:121632 len:8 PRP1 0x0 PRP2 0x0 00:30:28.733 [2024-11-27 17:23:25.407299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407364] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13a99a0 was disconnected and freed. reset controller. 00:30:28.733 [2024-11-27 17:23:25.407439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:28.733 [2024-11-27 17:23:25.407463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:28.733 [2024-11-27 17:23:25.407506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:28.733 [2024-11-27 17:23:25.407540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:28.733 [2024-11-27 17:23:25.407583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:28.733 [2024-11-27 17:23:25.407595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.733 [2024-11-27 17:23:25.409797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.733 [2024-11-27 17:23:25.409843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.733 [2024-11-27 17:23:25.410411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.733 [2024-11-27 17:23:25.410564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.733 [2024-11-27 17:23:25.410590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.410606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.410772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.410953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.410975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.410994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.413367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.422576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.422988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.423184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.423209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.423224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.423401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.423574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.423598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.423614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.425935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.435299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.435636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.435803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.435829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.435844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.436050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.436218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.436241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.436256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.438678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.448052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.448377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.448504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.448539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.448557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.448734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.448920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.448943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.448957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.451291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.460466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.460760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.460931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.460960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.460977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.461176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.461380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.461403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.461418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.463749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.473045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.473385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.473507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.473545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.473564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.473781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.473932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.473955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.473970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.476379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.485625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.485940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.486082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.486111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.734 [2024-11-27 17:23:25.486128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.734 [2024-11-27 17:23:25.486238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.734 [2024-11-27 17:23:25.486424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.734 [2024-11-27 17:23:25.486447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.734 [2024-11-27 17:23:25.486462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.734 [2024-11-27 17:23:25.488791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.734 [2024-11-27 17:23:25.498114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.734 [2024-11-27 17:23:25.498418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.498588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.734 [2024-11-27 17:23:25.498614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.498630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.498792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.498975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.498998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.499013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.501261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.510703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.511028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.511187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.511212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.511227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.511383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.511516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.511550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.511566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.513922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.523616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.523956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.524109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.524143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.524162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.524326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.524458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.524481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.524496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.526752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.536161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.536499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.536643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.536672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.536689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.536889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.537021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.537044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.537059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.539383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.548560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.548875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.549013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.549041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.549059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.549188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.549374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.549397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.549412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.551654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.560974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.561316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.561432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.735 [2024-11-27 17:23:25.561460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.735 [2024-11-27 17:23:25.561483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.735 [2024-11-27 17:23:25.561642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.735 [2024-11-27 17:23:25.561793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.735 [2024-11-27 17:23:25.561816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.735 [2024-11-27 17:23:25.561831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.735 [2024-11-27 17:23:25.564028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.735 [2024-11-27 17:23:25.573516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.735 [2024-11-27 17:23:25.573801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.573946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.573972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.573987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.574159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.574254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.574277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.574292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.576720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.586227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.586510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.586669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.586697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.586714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.586861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.587046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.587069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.587084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.589556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.598817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.599077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.599249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.599277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.599295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.599465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.599609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.599633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.599648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.602005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.611617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.611955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.612069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.612100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.612118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.612264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.612450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.612474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.612489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.614835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.624127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.624349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.624517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.624556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.624575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.624720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.624907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.624930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.624945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.627175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.636725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.637025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.637152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.637180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.637198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.637325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.637547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.637571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.637587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.640072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.649271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.649570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.649735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.649760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.649775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.649986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.736 [2024-11-27 17:23:25.650172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.736 [2024-11-27 17:23:25.650195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.736 [2024-11-27 17:23:25.650210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.736 [2024-11-27 17:23:25.652738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.736 [2024-11-27 17:23:25.661770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.736 [2024-11-27 17:23:25.662084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.662219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.736 [2024-11-27 17:23:25.662259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.736 [2024-11-27 17:23:25.662276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.736 [2024-11-27 17:23:25.662441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.737 [2024-11-27 17:23:25.662622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.737 [2024-11-27 17:23:25.662647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.737 [2024-11-27 17:23:25.662663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.737 [2024-11-27 17:23:25.664856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.737 [2024-11-27 17:23:25.674501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.737 [2024-11-27 17:23:25.674855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.737 [2024-11-27 17:23:25.674997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.737 [2024-11-27 17:23:25.675029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.737 [2024-11-27 17:23:25.675046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.737 [2024-11-27 17:23:25.675227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.675427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.675460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.675477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.678027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.686978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.687395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.687516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.687569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.997 [2024-11-27 17:23:25.687588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.997 [2024-11-27 17:23:25.687768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.687943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.687967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.687983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.690360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.699383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.699679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.699821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.699850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.997 [2024-11-27 17:23:25.699868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.997 [2024-11-27 17:23:25.700069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.700238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.700262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.700277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.702458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.712060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.712343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.712478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.712506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.997 [2024-11-27 17:23:25.712523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.997 [2024-11-27 17:23:25.712701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.712868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.712892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.712912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.715331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.724709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.725009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.725157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.725182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.997 [2024-11-27 17:23:25.725198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.997 [2024-11-27 17:23:25.725328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.725459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.725483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.725497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.727938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.737236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.737520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.737659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.997 [2024-11-27 17:23:25.737688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.997 [2024-11-27 17:23:25.737705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.997 [2024-11-27 17:23:25.737887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.997 [2024-11-27 17:23:25.738037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.997 [2024-11-27 17:23:25.738060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.997 [2024-11-27 17:23:25.738075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.997 [2024-11-27 17:23:25.740453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.997 [2024-11-27 17:23:25.749692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.997 [2024-11-27 17:23:25.750008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.750153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.750179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.750194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.750421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.750601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.750625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.750640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.752915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.762419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.762754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.762862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.762888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.762903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.763059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.763244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.763268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.763282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.765462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.774924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.775355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.775383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.775400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.775560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.775747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.775770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.775785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.778211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.787556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.787903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.788062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.788090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.788107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.788289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.788475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.788498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.788513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.790753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.800099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.800384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.800540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.800571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.800602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.800792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.800994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.801018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.801034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.803462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.812776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.813119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.813257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.813287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.813305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.813432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.813631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.813655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.813671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.815926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.825377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.825787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.825926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.825954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.998 [2024-11-27 17:23:25.825971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.998 [2024-11-27 17:23:25.826135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.998 [2024-11-27 17:23:25.826320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.998 [2024-11-27 17:23:25.826343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.998 [2024-11-27 17:23:25.826358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.998 [2024-11-27 17:23:25.828635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.998 [2024-11-27 17:23:25.838047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.998 [2024-11-27 17:23:25.838430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.998 [2024-11-27 17:23:25.838674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.838704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.838721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.838940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.839126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.839148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.839163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.841400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.850497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.850763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.850916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.850941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.850956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.851068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.851255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.851278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.851293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.853692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.863061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.863345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.863508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.863547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.863566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.863766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.863934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.863957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.863972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.866238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.875309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.875650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.875802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.875832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.875848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.876008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.876166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.876189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.876203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.878555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.887741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.888057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.888222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.888250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.888268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.888468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.888719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.888743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.888758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.891077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.900341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.900702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.900832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.900857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.900873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.901047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.901233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.901256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.901270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.903327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.913132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.913423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.913588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.913618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.913641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.913806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.913938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.913961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.913977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.916266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.925689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.999 [2024-11-27 17:23:25.926055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.926198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.999 [2024-11-27 17:23:25.926226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:28.999 [2024-11-27 17:23:25.926244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:28.999 [2024-11-27 17:23:25.926390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:28.999 [2024-11-27 17:23:25.926503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.999 [2024-11-27 17:23:25.926536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.999 [2024-11-27 17:23:25.926554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.999 [2024-11-27 17:23:25.928659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.999 [2024-11-27 17:23:25.938257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.000 [2024-11-27 17:23:25.938594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.000 [2024-11-27 17:23:25.938734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.000 [2024-11-27 17:23:25.938763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.000 [2024-11-27 17:23:25.938780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.000 [2024-11-27 17:23:25.938962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.000 [2024-11-27 17:23:25.939112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.000 [2024-11-27 17:23:25.939135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.000 [2024-11-27 17:23:25.939150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.000 [2024-11-27 17:23:25.941568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.260 [2024-11-27 17:23:25.950648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.260 [2024-11-27 17:23:25.950991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.951137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.260 [2024-11-27 17:23:25.951154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.260 [2024-11-27 17:23:25.951353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.260 [2024-11-27 17:23:25.951504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.260 [2024-11-27 17:23:25.951540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.260 [2024-11-27 17:23:25.951558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.260 [2024-11-27 17:23:25.953828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.260 [2024-11-27 17:23:25.963266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.260 [2024-11-27 17:23:25.963583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.963699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.963727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.260 [2024-11-27 17:23:25.963745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.260 [2024-11-27 17:23:25.963945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.260 [2024-11-27 17:23:25.964131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.260 [2024-11-27 17:23:25.964154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.260 [2024-11-27 17:23:25.964170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.260 [2024-11-27 17:23:25.966458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.260 [2024-11-27 17:23:25.975967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.260 [2024-11-27 17:23:25.976261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.976398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.976426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.260 [2024-11-27 17:23:25.976443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.260 [2024-11-27 17:23:25.976637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.260 [2024-11-27 17:23:25.976787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.260 [2024-11-27 17:23:25.976810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.260 [2024-11-27 17:23:25.976825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.260 [2024-11-27 17:23:25.979200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.260 [2024-11-27 17:23:25.988395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.260 [2024-11-27 17:23:25.988757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.988897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.260 [2024-11-27 17:23:25.988924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.260 [2024-11-27 17:23:25.988941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.260 [2024-11-27 17:23:25.989141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.260 [2024-11-27 17:23:25.989315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.260 [2024-11-27 17:23:25.989339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.260 [2024-11-27 17:23:25.989354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.260 [2024-11-27 17:23:25.991759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.260 [2024-11-27 17:23:26.000891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.001202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.001388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.001414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.001429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.001620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.001772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.001795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.001810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.004094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.013468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.013809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.013965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.013990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.014006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.014198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.014327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.014350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.014365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.016715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.026046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.026341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.026577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.026604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.026619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.026771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.026903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.026932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.026947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.029050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.038611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.038892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.039057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.039074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.039256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.039424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.039447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.039461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.041798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.051329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.051656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.051792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.051834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.051850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.051964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.052144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.052167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.052182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.054621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.063768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.064099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.064278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.064304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.064319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.064459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.064657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.064681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.064702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.066990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.076314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.076624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.076804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.261 [2024-11-27 17:23:26.076830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.261 [2024-11-27 17:23:26.076846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.261 [2024-11-27 17:23:26.077054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.261 [2024-11-27 17:23:26.077234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.261 [2024-11-27 17:23:26.077258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.261 [2024-11-27 17:23:26.077273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.261 [2024-11-27 17:23:26.079588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.261 [2024-11-27 17:23:26.089094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.261 [2024-11-27 17:23:26.089446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.089589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.089616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.089632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.089812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.090009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.090032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.090047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.092421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.101906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.102191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.102356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.102384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.102402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.102560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.102720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.102743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.102757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.105161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.114641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.114987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.115118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.115143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.115158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.115334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.115521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.115556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.115572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.117922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.127454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.127713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.127841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.127866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.127881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.128033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.128165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.128187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.128202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.130347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.140149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.140538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.140645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.140669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.140684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.140847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.141071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.141095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.141110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.143543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.152848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.153168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.153276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.153318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.153334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.153494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.153667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.153691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.153705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.156034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.165549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.165862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.166032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.262 [2024-11-27 17:23:26.166057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.262 [2024-11-27 17:23:26.166072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.262 [2024-11-27 17:23:26.166247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.262 [2024-11-27 17:23:26.166430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.262 [2024-11-27 17:23:26.166454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.262 [2024-11-27 17:23:26.166469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.262 [2024-11-27 17:23:26.168856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.262 [2024-11-27 17:23:26.178213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.262 [2024-11-27 17:23:26.178562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.178676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.178702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.263 [2024-11-27 17:23:26.178718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.263 [2024-11-27 17:23:26.178866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.263 [2024-11-27 17:23:26.179058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.263 [2024-11-27 17:23:26.179081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.263 [2024-11-27 17:23:26.179096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.263 [2024-11-27 17:23:26.181206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.263 [2024-11-27 17:23:26.190777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.263 [2024-11-27 17:23:26.191100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.191230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.191259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.263 [2024-11-27 17:23:26.191276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.263 [2024-11-27 17:23:26.191440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.263 [2024-11-27 17:23:26.191645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.263 [2024-11-27 17:23:26.191667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.263 [2024-11-27 17:23:26.191681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.263 [2024-11-27 17:23:26.194079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.263 [2024-11-27 17:23:26.203502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.263 [2024-11-27 17:23:26.203865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.204092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.263 [2024-11-27 17:23:26.204120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.263 [2024-11-27 17:23:26.204136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.263 [2024-11-27 17:23:26.204353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.263 [2024-11-27 17:23:26.204554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.263 [2024-11-27 17:23:26.204596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.263 [2024-11-27 17:23:26.204609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.263 [2024-11-27 17:23:26.206998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.523 [2024-11-27 17:23:26.216252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.523 [2024-11-27 17:23:26.216598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.216732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.216760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.523 [2024-11-27 17:23:26.216777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.523 [2024-11-27 17:23:26.216954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.523 [2024-11-27 17:23:26.217105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.523 [2024-11-27 17:23:26.217129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.523 [2024-11-27 17:23:26.217143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.523 [2024-11-27 17:23:26.219398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.523 [2024-11-27 17:23:26.228895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.523 [2024-11-27 17:23:26.229174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.229337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.229371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.523 [2024-11-27 17:23:26.229389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.523 [2024-11-27 17:23:26.229621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.523 [2024-11-27 17:23:26.229754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.523 [2024-11-27 17:23:26.229777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.523 [2024-11-27 17:23:26.229793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.523 [2024-11-27 17:23:26.232022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.523 [2024-11-27 17:23:26.241554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.523 [2024-11-27 17:23:26.241870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.242028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.242056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.523 [2024-11-27 17:23:26.242073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.523 [2024-11-27 17:23:26.242236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.523 [2024-11-27 17:23:26.242367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.523 [2024-11-27 17:23:26.242390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.523 [2024-11-27 17:23:26.242405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.523 [2024-11-27 17:23:26.244781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.523 [2024-11-27 17:23:26.254277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.523 [2024-11-27 17:23:26.254563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.254723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.523 [2024-11-27 17:23:26.254751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.523 [2024-11-27 17:23:26.254769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.523 [2024-11-27 17:23:26.254915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.523 [2024-11-27 17:23:26.255064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.523 [2024-11-27 17:23:26.255087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.523 [2024-11-27 17:23:26.255103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.257391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.266716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.267056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.267195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.267238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.267262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.267407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.267615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.267640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.267655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.269939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.279470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.279792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.279951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.279994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.280010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.280172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.280342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.280366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.280381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.282732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.292136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.292415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.292555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.292584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.292602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.292730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.292898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.292921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.292937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.295366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.304832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.305128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.305293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.305322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.305340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.305540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.305692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.305715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.305730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.308066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.317275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.317639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.317751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.317796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.317812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.318003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.318183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.318206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.318222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.320610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.329957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.330290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.330402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.330431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.330448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.330588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.330739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.330761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.330776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.333186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.342239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.342579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.342717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.342746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.342764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.342946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.343154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.343177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.343191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.345349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.354703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.355044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.355157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.355186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.355204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.355367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.355500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.355531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.355549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.357882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.367468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.367816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.368022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.368047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.524 [2024-11-27 17:23:26.368063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.524 [2024-11-27 17:23:26.368276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.524 [2024-11-27 17:23:26.368444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.524 [2024-11-27 17:23:26.368467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.524 [2024-11-27 17:23:26.368481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.524 [2024-11-27 17:23:26.370887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.524 [2024-11-27 17:23:26.380029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.524 [2024-11-27 17:23:26.380365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.524 [2024-11-27 17:23:26.380475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.380500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.380516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.380706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.380921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.380949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.380965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.383396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.392591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.392920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.393065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.393093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.393110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.393292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.393423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.393446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.393461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.395631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.405213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.405494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.405615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.405645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.405662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.405809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.405976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.405999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.406014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.408172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.417723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.418041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.418188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.418215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.418231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.418389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.418602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.418622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.418640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.421039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.430166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.430488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.430637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.430666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.430684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.430866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.431033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.431056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.431071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.433390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.442792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.443109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.443235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.443261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.443276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.443455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.443646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.443670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.443685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.445698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.455099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.455455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.455618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.455647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.455664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.455810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.455996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.456019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.456034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.458433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.525 [2024-11-27 17:23:26.467581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.525 [2024-11-27 17:23:26.467907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.468052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.525 [2024-11-27 17:23:26.468091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.525 [2024-11-27 17:23:26.468118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.525 [2024-11-27 17:23:26.468248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.525 [2024-11-27 17:23:26.468397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.525 [2024-11-27 17:23:26.468420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.525 [2024-11-27 17:23:26.468434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.525 [2024-11-27 17:23:26.470818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.480186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.480485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.480603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.480635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.480653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.480853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.481021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.481044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.481059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.483317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.492703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.493147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.493291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.493320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.493337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.493483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.493663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.493686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.493702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.495949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.505291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.505604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.505719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.505747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.505764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.505946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.506114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.506137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.506152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.508418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.517976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.518341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.518451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.518479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.518495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.518654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.518769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.518792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.518807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.520947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.530509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.530859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.531026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.531054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.531071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.531235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.531404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.531427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.531442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.533905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.542938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.543259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.543412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.543440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.543455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.543668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.543820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.543843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.543858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.785 [2024-11-27 17:23:26.546106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.785 [2024-11-27 17:23:26.555519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.785 [2024-11-27 17:23:26.555881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.556018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.785 [2024-11-27 17:23:26.556046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.785 [2024-11-27 17:23:26.556063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.785 [2024-11-27 17:23:26.556245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.785 [2024-11-27 17:23:26.556412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.785 [2024-11-27 17:23:26.556435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.785 [2024-11-27 17:23:26.556450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.558744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.568104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.568414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.568555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.568585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.568602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.568784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.568951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.568975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.568990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.571292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.580581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.580934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.581082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.581113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.581129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.581293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.581476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.581498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.581513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.583823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.593153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.593440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.593559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.593586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.593601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.593795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.594000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.594022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.594037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.596479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.605700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.606003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.606110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.606152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.606167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.606312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.606501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.606535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.606552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.608817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.618383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.618702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.618837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.618863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.618883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.619040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.619208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.619231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.619245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.621609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.630938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.631259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.631392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.631421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.631438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.631613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.631800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.631823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.631838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.634242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.643541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.786 [2024-11-27 17:23:26.643840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.644035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.786 [2024-11-27 17:23:26.644060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.786 [2024-11-27 17:23:26.644075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.786 [2024-11-27 17:23:26.644264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.786 [2024-11-27 17:23:26.644459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.786 [2024-11-27 17:23:26.644481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.786 [2024-11-27 17:23:26.644496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.786 [2024-11-27 17:23:26.646877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.786 [2024-11-27 17:23:26.656095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.656429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.656579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.656607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.656623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.656839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.657025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.657048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.657062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.659362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.668653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.668933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.669070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.669099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.669116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.669335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.669485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.669508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.669523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.671780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.681045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.681366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.681547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.681573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.681590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.681786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.681953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.681976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.681990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.684181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.693629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.693995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.694137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.694179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.694194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.694355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.694560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.694599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.694612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.696801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.706347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.706679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.706815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.706846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.706862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.707021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.707207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.707230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.707245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.709703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.718869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.719218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.719353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.719381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.719399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.719556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.719743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.719766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.719781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.787 [2024-11-27 17:23:26.722153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.787 [2024-11-27 17:23:26.731710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.787 [2024-11-27 17:23:26.731999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.732150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.787 [2024-11-27 17:23:26.732179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:29.787 [2024-11-27 17:23:26.732197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:29.787 [2024-11-27 17:23:26.732362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:29.787 [2024-11-27 17:23:26.732512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.787 [2024-11-27 17:23:26.732560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.787 [2024-11-27 17:23:26.732577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.734849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.744231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.744589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.744721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.744749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.744765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.744937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.745070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.047 [2024-11-27 17:23:26.745093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.047 [2024-11-27 17:23:26.745108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.747412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.756801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.757182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.757293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.757323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.757340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.757504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.757681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.047 [2024-11-27 17:23:26.757705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.047 [2024-11-27 17:23:26.757721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.759917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.769337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.769612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.769742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.769768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.769784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.769921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.770062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.047 [2024-11-27 17:23:26.770083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.047 [2024-11-27 17:23:26.770103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.772287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.781466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.781773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.781990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.782031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.782046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.782203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.782347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.047 [2024-11-27 17:23:26.782366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.047 [2024-11-27 17:23:26.782379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.784259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.793825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.794192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.794346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.794389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.794406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.794563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.794750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.047 [2024-11-27 17:23:26.794773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.047 [2024-11-27 17:23:26.794788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.047 [2024-11-27 17:23:26.797169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.047 [2024-11-27 17:23:26.806520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.047 [2024-11-27 17:23:26.806845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.806960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.047 [2024-11-27 17:23:26.806985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.047 [2024-11-27 17:23:26.807000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.047 [2024-11-27 17:23:26.807148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.047 [2024-11-27 17:23:26.807318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.807341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.807356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.809686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.818914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.819250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.819379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.819404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.819419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.819639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.819789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.819812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.819827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.821929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.831476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.831755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.831867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.831895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.831912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.832040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.832243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.832266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.832281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.834740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.844014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.844305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.844461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.844489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.844506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.844698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.844834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.844858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.844873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.847185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.856597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.856933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.857101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.857126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.857141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.857336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.857487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.857510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.857533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.859913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.869011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.869374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.869507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.869539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.869556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.869733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.869937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.869959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.869974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.872167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.881391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.881764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.881893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.881918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.881934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.882073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.882241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.882264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.882278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.884681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.893843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.894232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.894362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.894395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.894413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.894571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.894740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.894763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.894778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.897097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.906396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.906709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.906815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.906843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.906860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.907061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.907247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.907270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.907285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.909597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.048 [2024-11-27 17:23:26.918994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.048 [2024-11-27 17:23:26.919298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.919460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.048 [2024-11-27 17:23:26.919486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.048 [2024-11-27 17:23:26.919502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.048 [2024-11-27 17:23:26.919689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.048 [2024-11-27 17:23:26.919894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.048 [2024-11-27 17:23:26.919917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.048 [2024-11-27 17:23:26.919932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.048 [2024-11-27 17:23:26.922197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.931451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.931744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.931867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.931901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.931919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.932082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.932268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.932290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.932305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.049 [2024-11-27 17:23:26.934462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.944089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.944431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.944533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.944559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.944574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.944739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.944929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.944952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.944967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.049 [2024-11-27 17:23:26.947213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.956742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.957112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.957221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.957263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.957279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.957455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.957664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.957687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.957702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.049 [2024-11-27 17:23:26.960063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.969205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.969585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.969697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.969724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.969747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.969931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.970099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.970122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.970137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.049 [2024-11-27 17:23:26.972476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.981846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.982156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.982325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.982350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.982366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.982555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.982710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.982733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.982748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.049 [2024-11-27 17:23:26.985137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.049 [2024-11-27 17:23:26.994548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.049 [2024-11-27 17:23:26.994859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.995039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.049 [2024-11-27 17:23:26.995094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.049 [2024-11-27 17:23:26.995111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.049 [2024-11-27 17:23:26.995293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.049 [2024-11-27 17:23:26.995567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.049 [2024-11-27 17:23:26.995601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.049 [2024-11-27 17:23:26.995627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.308 [2024-11-27 17:23:26.998030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.308 [2024-11-27 17:23:27.006795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.007100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.007243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.007269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.007285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.007422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.007652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.007676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.007691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.009977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.019398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.019722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.019851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.019879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.019896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.020060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.020210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.020233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.020248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.022538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.031805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.032114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.032247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.032275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.032292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.032474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.032619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.032643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.032658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.034946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.044449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.044748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.044881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.044924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.044939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.045100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.045284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.045307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.045323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.047565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.057132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.057465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.057601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.057627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.057643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.057806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.058031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.058054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.058070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.060498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.069843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.070164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.070312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.070338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.070354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.070483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.070699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.070724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.070739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.072949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.082414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.082741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.082890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.082917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.082934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.083127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.083277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.083306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.083322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.085446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.094902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.095252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.095350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.095375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.095391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.095580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.095755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.095778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.095793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.098021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.107413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.107699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.107851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.107877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.309 [2024-11-27 17:23:27.107892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.309 [2024-11-27 17:23:27.108037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.309 [2024-11-27 17:23:27.108203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.309 [2024-11-27 17:23:27.108227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.309 [2024-11-27 17:23:27.108242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.309 [2024-11-27 17:23:27.110443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.309 [2024-11-27 17:23:27.119883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.309 [2024-11-27 17:23:27.120222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.120363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.309 [2024-11-27 17:23:27.120391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.120408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.120585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.120718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.120741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.120761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.123360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.132571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.132912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.133044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.133073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.133090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.133264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.133467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.133491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.133506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.135710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.145081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.145394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.145543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.145594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.145609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.145756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.145924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.145947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.145962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.148136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.157688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.157989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.158149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.158177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.158194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.158394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.158614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.158638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.158653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.161105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.170241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.170560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.170697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.170725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.170743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.170925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.171093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.171116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.171131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.173364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.182671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.182988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.183132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.183162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.183179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.183325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.183540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.183563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.183578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.185859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.195282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.195654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.195825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.195851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.195866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.196059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.196247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.196270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.196285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.198514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.207908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.208292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.208474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.208502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.208520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.208687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.208855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.208878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.208892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.211141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.220323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.220671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.220824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.220849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.220865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.221042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.221243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.310 [2024-11-27 17:23:27.221266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.310 [2024-11-27 17:23:27.221281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.310 [2024-11-27 17:23:27.223511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.310 [2024-11-27 17:23:27.232424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.310 [2024-11-27 17:23:27.232784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.232913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.310 [2024-11-27 17:23:27.232939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.310 [2024-11-27 17:23:27.232954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.310 [2024-11-27 17:23:27.233118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.310 [2024-11-27 17:23:27.233287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.311 [2024-11-27 17:23:27.233306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.311 [2024-11-27 17:23:27.233318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.311 [2024-11-27 17:23:27.235412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.311 [2024-11-27 17:23:27.244854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.311 [2024-11-27 17:23:27.245214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.311 [2024-11-27 17:23:27.245317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.311 [2024-11-27 17:23:27.245345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.311 [2024-11-27 17:23:27.245362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.311 [2024-11-27 17:23:27.245538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.311 [2024-11-27 17:23:27.245707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.311 [2024-11-27 17:23:27.245728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.311 [2024-11-27 17:23:27.245741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.311 [2024-11-27 17:23:27.247977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.311 [2024-11-27 17:23:27.257534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.571 [2024-11-27 17:23:27.257881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.571 [2024-11-27 17:23:27.258012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.571 [2024-11-27 17:23:27.258058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.571 [2024-11-27 17:23:27.258075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.571 [2024-11-27 17:23:27.258217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.571 [2024-11-27 17:23:27.258405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.571 [2024-11-27 17:23:27.258443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.571 [2024-11-27 17:23:27.258459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.571 [2024-11-27 17:23:27.260651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.571 [2024-11-27 17:23:27.269977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.571 [2024-11-27 17:23:27.270293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.571 [2024-11-27 17:23:27.270424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.571 [2024-11-27 17:23:27.270449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.571 [2024-11-27 17:23:27.270465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.571 [2024-11-27 17:23:27.270683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.571 [2024-11-27 17:23:27.270895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.571 [2024-11-27 17:23:27.270918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.571 [2024-11-27 17:23:27.270934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.273251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.282699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.283022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.283154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.283188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.283206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.283388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.283586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.283611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.283627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.285878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.295127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.295417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.295537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.295580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.295595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.295743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.295965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.295989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.296004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.298089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.307699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.308015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.308124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.308153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.308170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.308335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.308521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.308554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.308569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.310778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.320332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.320635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.320764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.320790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.320810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.320991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.321147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.321166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.321178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.323374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.332849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.333226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.333367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.333395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.333412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.333568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.333737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.333758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.333771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.336211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.345354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.345731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.345851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.345879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.345896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.346059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.346245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.346268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.346283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.348571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.357820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.358099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.358262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.572 [2024-11-27 17:23:27.358289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.572 [2024-11-27 17:23:27.358306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.572 [2024-11-27 17:23:27.358512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.572 [2024-11-27 17:23:27.358728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.572 [2024-11-27 17:23:27.358751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.572 [2024-11-27 17:23:27.358767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.572 [2024-11-27 17:23:27.360980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.572 [2024-11-27 17:23:27.370429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.572 [2024-11-27 17:23:27.370751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.370884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.370912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.370929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.371146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.371332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.371355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.371370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.373741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.383026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.383359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.383483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.383508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.383523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.383682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.383894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.383916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.383932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.386253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.395578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.395895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.396027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.396055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.396072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.396199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.396390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.396414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.396429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.398902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.408273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.408606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.408773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.408801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.408818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.409018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.409186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.409209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.409224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.411666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.420925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.421273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.421384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.421413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.421431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.421643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.421830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.421855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.421870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.424210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.433454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.433820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.433986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.434015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.434032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.434250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.434490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.434522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.434551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.436840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.445947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.446254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.446421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.446464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.446481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.446681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.446836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.446859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.573 [2024-11-27 17:23:27.446875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.573 [2024-11-27 17:23:27.449107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.573 [2024-11-27 17:23:27.459106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.573 [2024-11-27 17:23:27.459419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.459540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.573 [2024-11-27 17:23:27.459569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.573 [2024-11-27 17:23:27.459586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.573 [2024-11-27 17:23:27.459692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.573 [2024-11-27 17:23:27.459838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.573 [2024-11-27 17:23:27.459861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.574 [2024-11-27 17:23:27.459877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.574 [2024-11-27 17:23:27.462161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.574 [2024-11-27 17:23:27.471774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.574 [2024-11-27 17:23:27.472103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.472263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.472289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.574 [2024-11-27 17:23:27.472321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.574 [2024-11-27 17:23:27.472467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.574 [2024-11-27 17:23:27.472681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.574 [2024-11-27 17:23:27.472705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.574 [2024-11-27 17:23:27.472726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.574 [2024-11-27 17:23:27.474921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.574 [2024-11-27 17:23:27.484379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.574 [2024-11-27 17:23:27.484689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.484830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.484858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.574 [2024-11-27 17:23:27.484875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.574 [2024-11-27 17:23:27.485040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.574 [2024-11-27 17:23:27.485225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.574 [2024-11-27 17:23:27.485248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.574 [2024-11-27 17:23:27.485263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.574 [2024-11-27 17:23:27.487651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.574 [2024-11-27 17:23:27.496872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.574 [2024-11-27 17:23:27.497194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.497363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.497388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.574 [2024-11-27 17:23:27.497404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.574 [2024-11-27 17:23:27.497558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.574 [2024-11-27 17:23:27.497737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.574 [2024-11-27 17:23:27.497761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.574 [2024-11-27 17:23:27.497776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.574 [2024-11-27 17:23:27.500239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.574 [2024-11-27 17:23:27.509267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.574 [2024-11-27 17:23:27.509565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.509712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.574 [2024-11-27 17:23:27.509740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.574 [2024-11-27 17:23:27.509757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.574 [2024-11-27 17:23:27.509885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.574 [2024-11-27 17:23:27.510052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.574 [2024-11-27 17:23:27.510075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.574 [2024-11-27 17:23:27.510090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.574 [2024-11-27 17:23:27.512472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.834 [2024-11-27 17:23:27.521824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.834 [2024-11-27 17:23:27.522159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.834 [2024-11-27 17:23:27.522299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.834 [2024-11-27 17:23:27.522328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.834 [2024-11-27 17:23:27.522345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.834 [2024-11-27 17:23:27.522541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.834 [2024-11-27 17:23:27.522728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.522751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.522766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.525092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.534316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.534653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.534825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.534851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.534867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.535056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.535229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.535253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.535268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.537394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.547094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.547432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.547586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.547613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.547628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.547824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.547991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.548014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.548028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.550206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.559733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.560020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.560172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.560199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.560215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.560426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.560645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.560669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.560684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.562968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.572248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.572624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.572774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.572800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.572815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.572970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.573155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.573178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.573193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.575611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.584673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.585000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.585131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.585157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.585173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.585322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.585505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.585538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.585556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.587950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.597342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.597650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.597778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.597803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.597819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.597950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.598132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.598155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.598170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.600243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.610071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.610382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.610514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.835 [2024-11-27 17:23:27.610551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.835 [2024-11-27 17:23:27.610568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.835 [2024-11-27 17:23:27.610674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.835 [2024-11-27 17:23:27.610839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.835 [2024-11-27 17:23:27.610862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.835 [2024-11-27 17:23:27.610877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.835 [2024-11-27 17:23:27.613107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.835 [2024-11-27 17:23:27.622598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.835 [2024-11-27 17:23:27.622890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.623017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.623045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.623062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.623152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.623302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.623324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.623340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.625673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.635135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.635475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.635617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.635649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.635667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.635877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.636027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.636050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.636065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.638538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.647584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.647827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.647957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.647982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.647997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.648174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.648345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.648368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.648384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.650734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.660095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.660416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.660550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.660577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.660594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.660717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.660880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.660902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.660917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.663346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.672746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.673083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.673235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.673260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.673282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.673491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.673672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.673698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.673713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.676266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.685393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.685686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.685825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.685854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.685872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.686072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.686205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.686230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.686246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.688540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.697979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.698326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.698461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.698488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.698504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.698721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.836 [2024-11-27 17:23:27.698870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.836 [2024-11-27 17:23:27.698894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.836 [2024-11-27 17:23:27.698909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.836 [2024-11-27 17:23:27.701120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.836 [2024-11-27 17:23:27.710412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.836 [2024-11-27 17:23:27.710675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.710769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.836 [2024-11-27 17:23:27.710794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.836 [2024-11-27 17:23:27.710810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.836 [2024-11-27 17:23:27.710957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.711123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.711146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.711160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.713305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.837 [2024-11-27 17:23:27.722940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.837 [2024-11-27 17:23:27.723213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.723355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.723398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.837 [2024-11-27 17:23:27.723414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.837 [2024-11-27 17:23:27.723603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.723782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.723806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.723821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.726051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.837 [2024-11-27 17:23:27.735468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.837 [2024-11-27 17:23:27.735756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.735872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.735899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.837 [2024-11-27 17:23:27.735917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.837 [2024-11-27 17:23:27.736134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.736284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.736307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.736321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.738597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.837 [2024-11-27 17:23:27.748155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.837 [2024-11-27 17:23:27.748508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.748642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.748668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.837 [2024-11-27 17:23:27.748684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.837 [2024-11-27 17:23:27.748860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.749070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.749093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.749108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.751468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.837 [2024-11-27 17:23:27.760928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.837 [2024-11-27 17:23:27.761184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.761323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.761351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.837 [2024-11-27 17:23:27.761368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.837 [2024-11-27 17:23:27.761563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.761751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.761774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.761789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.763913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.837 [2024-11-27 17:23:27.773608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.837 [2024-11-27 17:23:27.773907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.774022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.837 [2024-11-27 17:23:27.774046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:30.837 [2024-11-27 17:23:27.774061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:30.837 [2024-11-27 17:23:27.774247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:30.837 [2024-11-27 17:23:27.774421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.837 [2024-11-27 17:23:27.774444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.837 [2024-11-27 17:23:27.774459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.837 [2024-11-27 17:23:27.776908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.097 [2024-11-27 17:23:27.786201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.097 [2024-11-27 17:23:27.786487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.786630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.786660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.097 [2024-11-27 17:23:27.786678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.097 [2024-11-27 17:23:27.786861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.097 [2024-11-27 17:23:27.787047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.097 [2024-11-27 17:23:27.787076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.097 [2024-11-27 17:23:27.787092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.097 [2024-11-27 17:23:27.789434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.097 [2024-11-27 17:23:27.798903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.097 [2024-11-27 17:23:27.799175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.799294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.799323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.097 [2024-11-27 17:23:27.799340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.097 [2024-11-27 17:23:27.799504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.097 [2024-11-27 17:23:27.799720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.097 [2024-11-27 17:23:27.799744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.097 [2024-11-27 17:23:27.799759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.097 [2024-11-27 17:23:27.802279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.097 [2024-11-27 17:23:27.811460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.097 [2024-11-27 17:23:27.811716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.811894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.811919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.097 [2024-11-27 17:23:27.811935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.097 [2024-11-27 17:23:27.812066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.097 [2024-11-27 17:23:27.812304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.097 [2024-11-27 17:23:27.812341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.097 [2024-11-27 17:23:27.812356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.097 [2024-11-27 17:23:27.814706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.097 [2024-11-27 17:23:27.824033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.097 [2024-11-27 17:23:27.824316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.824455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-27 17:23:27.824483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.097 [2024-11-27 17:23:27.824500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.097 [2024-11-27 17:23:27.824639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.097 [2024-11-27 17:23:27.824808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.097 [2024-11-27 17:23:27.824831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.097 [2024-11-27 17:23:27.824853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.097 [2024-11-27 17:23:27.827140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.097 [2024-11-27 17:23:27.836292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.097 [2024-11-27 17:23:27.836558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.836660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.836685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.836700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.836832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.836950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.836970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.836984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.839161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.848710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.849090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.849205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.849233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.849251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.849416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.849605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.849627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.849640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.851930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.861183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.861512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.861630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.861658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.861673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.861858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.862044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.862068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.862082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.864195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.873658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.873997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.874103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.874130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.874145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.874355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.874551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.874580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.874595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.876961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.886087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.886434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.886544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.886573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.886590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.886773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.886959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.886982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.886997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.889335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.898704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.899057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.899182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.899207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.899223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.899374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.899572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.899596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.899611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.901843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.911134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.911407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.911542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.911571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.911589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.911753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.911885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.911908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.911923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.914033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.923467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.923756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.923904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.923944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.923960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.924060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.924232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.924255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.924271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.926532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.935997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.936282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.936447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.936476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.936493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.936668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.098 [2024-11-27 17:23:27.936892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.098 [2024-11-27 17:23:27.936915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.098 [2024-11-27 17:23:27.936930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.098 [2024-11-27 17:23:27.939344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.098 [2024-11-27 17:23:27.948545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.098 [2024-11-27 17:23:27.948878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.949018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-27 17:23:27.949047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.098 [2024-11-27 17:23:27.949065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.098 [2024-11-27 17:23:27.949211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:27.949397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:27.949420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:27.949435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:27.951786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:27.961000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:27.961387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.961514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.961548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:27.961564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:27.961724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:27.961838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:27.961860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:27.961875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:27.964238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:27.973481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:27.973813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.973942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.973970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:27.973986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:27.974178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:27.974324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:27.974348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:27.974362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:27.976748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:27.986008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:27.986304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.986472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.986506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:27.986532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:27.986699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:27.986849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:27.986871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:27.986886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:27.989150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:27.998379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:27.998706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.998879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:27.998904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:27.998920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:27.999079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:27.999258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:27.999281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:27.999296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:28.001458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:28.010718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:28.011096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.011202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.011226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:28.011241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:28.011390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:28.011504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:28.011537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:28.011554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:28.013894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:28.023267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:28.023562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.023655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.023682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:28.023705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:28.023854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:28.023998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:28.024021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:28.024036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:28.026343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.099 [2024-11-27 17:23:28.035905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.099 [2024-11-27 17:23:28.036270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.036450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-27 17:23:28.036476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.099 [2024-11-27 17:23:28.036491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.099 [2024-11-27 17:23:28.036633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.099 [2024-11-27 17:23:28.036795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.099 [2024-11-27 17:23:28.036818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.099 [2024-11-27 17:23:28.036833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.099 [2024-11-27 17:23:28.039208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.359 [2024-11-27 17:23:28.048408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.359 [2024-11-27 17:23:28.048763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.048886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.048915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.359 [2024-11-27 17:23:28.048933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.359 [2024-11-27 17:23:28.049079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.359 [2024-11-27 17:23:28.049248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.359 [2024-11-27 17:23:28.049271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.359 [2024-11-27 17:23:28.049286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.359 [2024-11-27 17:23:28.051409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.359 [2024-11-27 17:23:28.060960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.359 [2024-11-27 17:23:28.061250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.061406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.061432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.359 [2024-11-27 17:23:28.061448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.359 [2024-11-27 17:23:28.061612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.359 [2024-11-27 17:23:28.061797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.359 [2024-11-27 17:23:28.061819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.359 [2024-11-27 17:23:28.061834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.359 [2024-11-27 17:23:28.064154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.359 [2024-11-27 17:23:28.073276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.359 [2024-11-27 17:23:28.073594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.073842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.359 [2024-11-27 17:23:28.073894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.359 [2024-11-27 17:23:28.073911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.359 [2024-11-27 17:23:28.074057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.074170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.074193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.074208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.076571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.085690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.085994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.086191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.086243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.086261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.086425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.086606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.086630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.086645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.088874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.098317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.098614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.098719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.098747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.098763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.098956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.099144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.099168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.099183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.101550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.110906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.111243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.111368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.111395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.111410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.111612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.111816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.111839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.111854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.114101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.123619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.123959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.124203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.124231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.124249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.124448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.124628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.124652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.124667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.127040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.136080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.136366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.136539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.136569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.136586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.136750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.136954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.136982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.136998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.139248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.148457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.148824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.148956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.148984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.149002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.149165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.149333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.149356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.149371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.151756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.161179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.161531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.161707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.161732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.161748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.161892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.162091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.162114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.162129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.164534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.173567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.173937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.174035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.174063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.174080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.174281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.174412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.174435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.174457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.176680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.360 [2024-11-27 17:23:28.186163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.360 [2024-11-27 17:23:28.186576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.186728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.360 [2024-11-27 17:23:28.186757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.360 [2024-11-27 17:23:28.186776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.360 [2024-11-27 17:23:28.186977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.360 [2024-11-27 17:23:28.187162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.360 [2024-11-27 17:23:28.187186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.360 [2024-11-27 17:23:28.187203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.360 [2024-11-27 17:23:28.189438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.198720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.199021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.199188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.199213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.199229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.199387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.199563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.199586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.199602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.201865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.211234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.211559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.211699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.211728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.211745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.211927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.212077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.212100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.212115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.214462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.223681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.224003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.224158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.224183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.224199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.224374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.224590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.224614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.224630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.227056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.235918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.236269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.236396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.236421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.236437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.236646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.236794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.236817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.236832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.239239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.248275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.248576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.248712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.248755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.248771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.248885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.249110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.249133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.249148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.251567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.260743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.261109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.261236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.261262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.261278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.261460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.261640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.261664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.261678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.263780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.273344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.273716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.273880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.273909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.273926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.274071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.274221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.274244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.274259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.276466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.285921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.286262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.286434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.286460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.286476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.286717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.286887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.286910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.286924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.289331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.361 [2024-11-27 17:23:28.298393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.361 [2024-11-27 17:23:28.298714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.298906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.361 [2024-11-27 17:23:28.298937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.361 [2024-11-27 17:23:28.298954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.361 [2024-11-27 17:23:28.299136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.361 [2024-11-27 17:23:28.299304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.361 [2024-11-27 17:23:28.299327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.361 [2024-11-27 17:23:28.299342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.361 [2024-11-27 17:23:28.301502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.622 [2024-11-27 17:23:28.310954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.311339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.311510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.311548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.311565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.311745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.311914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.311937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.311951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.314370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.323496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.323825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.324005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.324033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.324051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.324161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.324293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.324316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.324331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.326555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.336283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.336637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.336803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.336837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.336855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.337038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.337205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.337228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.337243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.339534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.348754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.349015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.349149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.349178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.349196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.349414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.349576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.349600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.349615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.351987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.361296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.361674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.361808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.361833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.361849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.362027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.362177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.362200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.362215] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.364749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.373921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.374272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.374462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.374491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.374513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.374711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.374879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.374900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.374913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.377224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 [2024-11-27 17:23:28.386564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.623 [2024-11-27 17:23:28.386953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.387122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.623 [2024-11-27 17:23:28.387147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.623 [2024-11-27 17:23:28.387162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.623 [2024-11-27 17:23:28.387359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.623 [2024-11-27 17:23:28.387537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.623 [2024-11-27 17:23:28.387561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.623 [2024-11-27 17:23:28.387592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.623 [2024-11-27 17:23:28.389857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.623 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1870772 Killed "${NVMF_APP[@]}" "$@" 00:30:31.623 17:23:28 -- host/bdevperf.sh@36 -- # tgt_init 00:30:31.623 17:23:28 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:31.623 17:23:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:31.623 17:23:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.623 17:23:28 -- common/autotest_common.sh@10 -- # set +x 00:30:31.623 [2024-11-27 17:23:28.399069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.399429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.399595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.399621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.399637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.399768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.399937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.399960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.399975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 17:23:28 -- nvmf/common.sh@469 -- # nvmfpid=1871829 00:30:31.624 17:23:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:31.624 17:23:28 -- nvmf/common.sh@470 -- # waitforlisten 1871829 00:30:31.624 17:23:28 -- common/autotest_common.sh@829 -- # '[' -z 1871829 ']' 00:30:31.624 17:23:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:31.624 17:23:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:31.624 17:23:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:31.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:31.624 17:23:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:31.624 17:23:28 -- common/autotest_common.sh@10 -- # set +x 00:30:31.624 [2024-11-27 17:23:28.402207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.411791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.412127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.412240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.412266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.412281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.412503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.412657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.412679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.412692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 [2024-11-27 17:23:28.415023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.424231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.424521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.424657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.424683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.424699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.424814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.424949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.424971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.424985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 [2024-11-27 17:23:28.427212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.436756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.437188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.437322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.437348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.437364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.437534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.437679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.437700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.437714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 [2024-11-27 17:23:28.439912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.445784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:31.624 [2024-11-27 17:23:28.445864] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:31.624 [2024-11-27 17:23:28.449147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.449440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.449567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.449594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.449610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.449773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.449949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.449968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.449981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 [2024-11-27 17:23:28.452091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.461465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.624 [2024-11-27 17:23:28.461715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.461823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.624 [2024-11-27 17:23:28.461849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.624 [2024-11-27 17:23:28.461865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.624 [2024-11-27 17:23:28.462029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.624 [2024-11-27 17:23:28.462206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.624 [2024-11-27 17:23:28.462224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.624 [2024-11-27 17:23:28.462237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.624 [2024-11-27 17:23:28.464195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.624 [2024-11-27 17:23:28.473876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.474259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.474388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.474415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.474431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.474596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.474765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.474786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.474799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.476911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.625 [2024-11-27 17:23:28.486144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.486508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.486641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.486667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.486682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.486863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.486998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.487019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.487033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.489138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.498979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.499333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.499473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.499500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.499517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.499709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.499902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.499925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.499940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.502298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.511488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.511798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.511981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.512005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.512020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.512189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.512367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.512390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.512405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.514700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.518497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:31.625 [2024-11-27 17:23:28.523955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.524345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.524478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.524504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.524520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.524696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.524865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.524889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.524905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.527149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.536574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.536939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.537081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.537109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.537129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.537319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.537492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.537515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.537543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.539728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.549090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.549418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.549581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.625 [2024-11-27 17:23:28.549608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.625 [2024-11-27 17:23:28.549623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.625 [2024-11-27 17:23:28.549787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.625 [2024-11-27 17:23:28.549957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.625 [2024-11-27 17:23:28.549981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.625 [2024-11-27 17:23:28.549996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.625 [2024-11-27 17:23:28.552155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.625 [2024-11-27 17:23:28.561506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.625 [2024-11-27 17:23:28.561811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.626 [2024-11-27 17:23:28.561942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.626 [2024-11-27 17:23:28.561969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.626 [2024-11-27 17:23:28.561985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.626 [2024-11-27 17:23:28.562179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.626 [2024-11-27 17:23:28.562348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.626 [2024-11-27 17:23:28.562371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.626 [2024-11-27 17:23:28.562386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.626 [2024-11-27 17:23:28.564901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.887 [2024-11-27 17:23:28.574155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.887 [2024-11-27 17:23:28.574587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.574705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.574740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.887 [2024-11-27 17:23:28.574760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.887 [2024-11-27 17:23:28.574900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.887 [2024-11-27 17:23:28.575069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.887 [2024-11-27 17:23:28.575092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.887 [2024-11-27 17:23:28.575111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.887 [2024-11-27 17:23:28.577612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.887 [2024-11-27 17:23:28.586765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.887 [2024-11-27 17:23:28.587141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.587325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.587354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.887 [2024-11-27 17:23:28.587373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.887 [2024-11-27 17:23:28.587504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.887 [2024-11-27 17:23:28.587710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.887 [2024-11-27 17:23:28.587740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.887 [2024-11-27 17:23:28.587754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.887 [2024-11-27 17:23:28.590126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.887 [2024-11-27 17:23:28.599323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.887 [2024-11-27 17:23:28.599641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.599753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.599780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.887 [2024-11-27 17:23:28.599797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.887 [2024-11-27 17:23:28.599987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.887 [2024-11-27 17:23:28.600210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.887 [2024-11-27 17:23:28.600233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.887 [2024-11-27 17:23:28.600249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.887 [2024-11-27 17:23:28.602351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.887 [2024-11-27 17:23:28.609733] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.887 [2024-11-27 17:23:28.609879] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.887 [2024-11-27 17:23:28.609898] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:31.887 [2024-11-27 17:23:28.609910] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.887 [2024-11-27 17:23:28.609959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:31.887 [2024-11-27 17:23:28.610020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:31.887 [2024-11-27 17:23:28.610023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:31.887 [2024-11-27 17:23:28.611756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.887 [2024-11-27 17:23:28.612072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.612231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.612256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.887 [2024-11-27 17:23:28.612272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.887 [2024-11-27 17:23:28.612406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.887 [2024-11-27 17:23:28.612614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.887 [2024-11-27 17:23:28.612636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.887 [2024-11-27 17:23:28.612650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.887 [2024-11-27 17:23:28.614500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.887 [2024-11-27 17:23:28.624022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.887 [2024-11-27 17:23:28.624434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.624573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.887 [2024-11-27 17:23:28.624602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.624622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.624766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.624935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.624956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.624973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.627147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.636247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.636691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.636820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.636847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.636867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.637026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.637241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.637262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.637279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.639491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.648533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.648969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.649133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.649159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.649178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.649353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.649520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.649566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.649583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.651684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.660974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.661330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.661444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.661479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.661498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.661672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.661813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.661849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.661866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.663849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.673645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.674066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.674233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.674259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.674278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.674437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.674619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.674660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.674679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.676851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.686067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.686462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.686596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.686622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.686642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.686847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.686999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.687020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.687036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.689091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.698482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.698797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.698960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.698986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.888 [2024-11-27 17:23:28.699009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.888 [2024-11-27 17:23:28.699174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.888 [2024-11-27 17:23:28.699354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.888 [2024-11-27 17:23:28.699375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.888 [2024-11-27 17:23:28.699388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.888 [2024-11-27 17:23:28.701589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.888 [2024-11-27 17:23:28.710500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.888 [2024-11-27 17:23:28.710791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.710926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.888 [2024-11-27 17:23:28.710953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.710968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.711100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.711280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.711300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.711313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.713398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.722781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.723115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.723203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.723230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.723245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.723360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.723583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.723605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.723619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.725476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.734921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.735235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.735338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.735366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.735382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.735546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.735716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.735737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.735750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.737863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.747123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.747379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.747469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.747494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.747510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.747665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.747785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.747805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.747818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.749947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.759462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.759761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.759899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.759924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.759940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.760071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.760219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.760239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.760252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.762269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.771895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.772233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.772357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.772382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.772398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.772588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.772746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.772766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.772780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.774893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.783987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.784286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.784403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.784429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.784444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.784601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.784753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.784774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.784787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.786941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.796407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.796675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.796830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.796855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.889 [2024-11-27 17:23:28.796870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.889 [2024-11-27 17:23:28.797017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.889 [2024-11-27 17:23:28.797213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.889 [2024-11-27 17:23:28.797233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.889 [2024-11-27 17:23:28.797247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.889 [2024-11-27 17:23:28.799234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.889 [2024-11-27 17:23:28.808652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.889 [2024-11-27 17:23:28.808999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.809123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.889 [2024-11-27 17:23:28.809148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.890 [2024-11-27 17:23:28.809163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.890 [2024-11-27 17:23:28.809326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.890 [2024-11-27 17:23:28.809520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.890 [2024-11-27 17:23:28.809555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.890 [2024-11-27 17:23:28.809570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.890 [2024-11-27 17:23:28.811613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.890 [2024-11-27 17:23:28.820952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.890 [2024-11-27 17:23:28.821266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.890 [2024-11-27 17:23:28.821398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.890 [2024-11-27 17:23:28.821423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.890 [2024-11-27 17:23:28.821438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.890 [2024-11-27 17:23:28.821611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.890 [2024-11-27 17:23:28.821762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.890 [2024-11-27 17:23:28.821783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.890 [2024-11-27 17:23:28.821797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.890 [2024-11-27 17:23:28.823707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.890 [2024-11-27 17:23:28.833572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.890 [2024-11-27 17:23:28.833803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.890 [2024-11-27 17:23:28.833947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.890 [2024-11-27 17:23:28.833973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:31.890 [2024-11-27 17:23:28.833988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:31.890 [2024-11-27 17:23:28.834136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:31.890 [2024-11-27 17:23:28.834316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.890 [2024-11-27 17:23:28.834337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.890 [2024-11-27 17:23:28.834359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.150 [2024-11-27 17:23:28.836694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.150 [2024-11-27 17:23:28.845981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.150 [2024-11-27 17:23:28.846276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.150 [2024-11-27 17:23:28.846388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.846416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.846432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.846579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.846716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.846737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.846756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.848757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.858236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.858546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.858656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.858682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.858697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.858812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.859008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.859028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.859041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.861080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.870491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.870803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.870937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.870963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.870978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.871109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.871290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.871311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.871324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.873344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.882751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.883053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.883185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.883211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.883227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.883359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.883582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.883604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.883618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.885888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.894848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.895149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.895275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.895300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.895315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.895447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.895624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.895646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.895659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.897631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.907024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.907325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.907479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.907505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.907520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.907644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.907795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.907830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.907843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.909861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.919278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.919575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.919695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.919721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.919736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.151 [2024-11-27 17:23:28.919883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.151 [2024-11-27 17:23:28.920064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.151 [2024-11-27 17:23:28.920084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.151 [2024-11-27 17:23:28.920097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.151 [2024-11-27 17:23:28.922145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.151 [2024-11-27 17:23:28.931739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.151 [2024-11-27 17:23:28.932087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.932183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.151 [2024-11-27 17:23:28.932208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.151 [2024-11-27 17:23:28.932224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.932371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.932505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.932549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.932565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.934763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:28.944045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:28.944315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.944443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.944468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:28.944483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.944656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.944824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.944844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.944857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.947005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:28.956323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:28.956680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.956817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.956848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:28.956864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.956995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.957159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.957179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.957193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.959172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:28.968716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:28.969005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.969115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.969141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:28.969157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.969305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.969487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.969521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.969545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.971626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:28.981002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:28.981313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.981432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.981457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:28.981473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.981612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.981765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.981785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.981799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.984004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:28.993368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:28.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.993779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:28.993806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:28.993821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:28.993953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:28.994120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:28.994141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:28.994154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:28.996254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:29.005788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:29.006088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:29.006183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:29.006214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:29.006231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:29.006444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:29.006653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.152 [2024-11-27 17:23:29.006675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.152 [2024-11-27 17:23:29.006689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.152 [2024-11-27 17:23:29.008756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.152 [2024-11-27 17:23:29.018025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.152 [2024-11-27 17:23:29.018303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:29.018425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.152 [2024-11-27 17:23:29.018450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.152 [2024-11-27 17:23:29.018466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.152 [2024-11-27 17:23:29.018624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.152 [2024-11-27 17:23:29.018777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.018798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.018811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.020688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.030339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.030674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.030762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.030788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.030803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.030983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.031115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.031135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.031149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.033166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.042594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.042898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.043026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.043051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.043071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.043252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.043400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.043420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.043434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.045483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.054867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.055143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.055265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.055290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.055306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.055485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.055629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.055651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.055664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.057715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.067344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.067632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.067757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.067783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.067798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.067945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.068125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.068146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.068159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.070210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.079707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.080024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.080155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.080180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.080196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.080334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.080469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.080504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.080518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.082698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.153 [2024-11-27 17:23:29.091896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.153 [2024-11-27 17:23:29.092202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.092296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.153 [2024-11-27 17:23:29.092321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.153 [2024-11-27 17:23:29.092337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.153 [2024-11-27 17:23:29.092451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.153 [2024-11-27 17:23:29.092612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.153 [2024-11-27 17:23:29.092634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.153 [2024-11-27 17:23:29.092648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.153 [2024-11-27 17:23:29.094790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.104193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.104497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.104641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.104667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.104683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.104852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.105045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.105067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.105080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.107311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.116546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.116878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.117002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.117028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.117044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.117207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.117378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.117399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.117412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.119396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.128758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.129087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.129172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.129198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.129213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.129409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.129582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.129604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.129617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.131788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.140978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.141281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.141404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.141429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.141445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.141573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.141738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.141758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.141771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.143822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.153315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.153604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.153723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.153749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.153765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.153945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.154129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.154155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.154170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.156230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.165658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.165984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.166106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.166131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.166146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.166261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.166441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.166461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.166474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.168625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.177984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.178293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.178403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.178428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.178444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.178602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.178754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.178775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.178788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.180983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.190346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.190707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.190837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.190863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.190879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.190994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.191175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.191195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.191217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.193369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.202912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.203207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.203330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.203355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.203370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.203576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.203743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.203763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.203777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.205970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.215137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.215446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.215570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.215596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.215612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.215776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.215940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.215960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.215973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.218084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.227473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.227805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.227913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.227939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.227954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.228101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.412 [2024-11-27 17:23:29.228251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.412 [2024-11-27 17:23:29.228271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.412 [2024-11-27 17:23:29.228284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.412 [2024-11-27 17:23:29.230323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.412 [2024-11-27 17:23:29.239700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.412 [2024-11-27 17:23:29.240028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.240122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.412 [2024-11-27 17:23:29.240147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.412 [2024-11-27 17:23:29.240162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.412 [2024-11-27 17:23:29.240260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.240409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.240430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.240443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.242668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.252184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.252478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.252580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.252606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.252622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.252754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.252886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.252906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.252919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.254913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.264422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.264739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.264869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.264894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.264910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.265057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.265205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.265225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.265238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.267287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.276780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.277093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.277188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.277213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.277229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.277360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.277478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.277498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.277511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.279607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.288994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.289290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.289420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.289445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.289461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.289617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.289753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.289774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.289788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.291852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.301186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.301466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.301611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.301637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.301653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.301816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.301964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.301984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.301998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.303924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.313465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.313802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.313965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.313991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.314007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.314139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.314321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.314341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.314355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.316419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.325942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.326257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.326384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.326409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.326424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.326565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.326684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.326705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.326719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.328807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.338095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.338366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.338495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.338520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.338544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.338692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.338827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.338848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.338862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.340867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.413 [2024-11-27 17:23:29.350346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.413 [2024-11-27 17:23:29.350612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.350766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.413 [2024-11-27 17:23:29.350796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.413 [2024-11-27 17:23:29.350812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.413 [2024-11-27 17:23:29.350993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.413 [2024-11-27 17:23:29.351158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.413 [2024-11-27 17:23:29.351179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.413 [2024-11-27 17:23:29.351193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.413 [2024-11-27 17:23:29.353114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 [2024-11-27 17:23:29.363041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.363352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.363475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.363501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.363517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.363689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.363856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.363876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.363890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.366151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 [2024-11-27 17:23:29.375174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.375455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.375579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.375607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.375623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.375787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.375983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.376004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.376017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.378102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 [2024-11-27 17:23:29.387605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.387871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.387997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.388022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.388043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.388191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.388326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.388346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.388360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.390555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 [2024-11-27 17:23:29.399908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.400145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.400250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.400274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.400290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.400469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.400645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.400667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.400681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.402608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 17:23:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:32.672 17:23:29 -- common/autotest_common.sh@862 -- # return 0 00:30:32.672 17:23:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:32.672 17:23:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:32.672 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.672 [2024-11-27 17:23:29.412338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.412607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.412696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.412721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.412736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.412868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.413019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.413041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.413054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.414930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 [2024-11-27 17:23:29.424542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.672 [2024-11-27 17:23:29.424845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.424949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.672 [2024-11-27 17:23:29.424979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.672 [2024-11-27 17:23:29.424995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.672 [2024-11-27 17:23:29.425111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.672 [2024-11-27 17:23:29.425261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.672 [2024-11-27 17:23:29.425281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.672 [2024-11-27 17:23:29.425294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.672 [2024-11-27 17:23:29.427453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.672 17:23:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:32.672 17:23:29 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:32.672 17:23:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.672 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.673 [2024-11-27 17:23:29.434070] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:32.673 [2024-11-27 17:23:29.436752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.437059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.437183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.437208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.437224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.437355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.437544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.437565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.437578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.439585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 17:23:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.673 17:23:29 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:32.673 17:23:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.673 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.673 [2024-11-27 17:23:29.449027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.449337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.449474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.449500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.449516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.449737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.449884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.449904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.449923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.452081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 [2024-11-27 17:23:29.461395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.461661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.461791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.461816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.461832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.462012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.462192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.462214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.462228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.464275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 [2024-11-27 17:23:29.473606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.474044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.474195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.474222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.474243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.474389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.474551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.474574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.474592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.476821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 Malloc0 00:30:32.673 17:23:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.673 17:23:29 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:32.673 17:23:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.673 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.673 [2024-11-27 17:23:29.486211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.486574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.486680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.486706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.486723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.486889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.487039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.487068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.487083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.489140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 17:23:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.673 17:23:29 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:32.673 17:23:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.673 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.673 17:23:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.673 17:23:29 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:32.673 17:23:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.673 [2024-11-27 17:23:29.498725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 17:23:29 -- common/autotest_common.sh@10 -- # set +x 00:30:32.673 [2024-11-27 17:23:29.499016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.499179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.673 [2024-11-27 17:23:29.499204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13841d0 with addr=10.0.0.2, port=4420 00:30:32.673 [2024-11-27 17:23:29.499221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13841d0 is same with the state(5) to be set 00:30:32.673 [2024-11-27 17:23:29.499369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13841d0 (9): Bad file descriptor 00:30:32.673 [2024-11-27 17:23:29.499489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:32.673 [2024-11-27 17:23:29.499509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:32.673 [2024-11-27 17:23:29.499523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:32.673 [2024-11-27 17:23:29.501643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:32.673 [2024-11-27 17:23:29.502252] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:32.673 17:23:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.673 17:23:29 -- host/bdevperf.sh@38 -- # wait 1871082 00:30:32.673 [2024-11-27 17:23:29.511127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:32.673 [2024-11-27 17:23:29.538786] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:42.639 00:30:42.639 Latency(us) 00:30:42.639 [2024-11-27T16:23:39.590Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:42.639 [2024-11-27T16:23:39.590Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:42.639 Verification LBA range: start 0x0 length 0x4000 00:30:42.639 Nvme1n1 : 15.01 9432.75 36.85 15918.21 0.00 5034.29 782.79 18155.90 00:30:42.639 [2024-11-27T16:23:39.590Z] =================================================================================================================== 00:30:42.639 [2024-11-27T16:23:39.590Z] Total : 9432.75 36.85 15918.21 0.00 5034.29 782.79 18155.90 00:30:42.639 17:23:38 -- host/bdevperf.sh@39 -- # sync 00:30:42.639 17:23:38 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:42.639 17:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.639 17:23:38 -- common/autotest_common.sh@10 -- # set +x 00:30:42.639 17:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.639 17:23:38 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:42.639 17:23:38 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:42.639 17:23:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:42.639 17:23:38 -- nvmf/common.sh@116 -- # sync 00:30:42.639 17:23:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:42.639 17:23:38 -- nvmf/common.sh@119 -- # set +e 00:30:42.639 17:23:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:42.639 17:23:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:42.639 rmmod nvme_tcp 00:30:42.639 rmmod nvme_fabrics 00:30:42.639 rmmod nvme_keyring 00:30:42.639 17:23:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:42.639 17:23:38 -- nvmf/common.sh@123 -- # set -e 00:30:42.639 17:23:38 -- nvmf/common.sh@124 -- # return 0 00:30:42.639 17:23:38 -- nvmf/common.sh@477 -- # '[' -n 1871829 ']' 00:30:42.639 17:23:38 -- nvmf/common.sh@478 -- # killprocess 1871829 00:30:42.639 17:23:38 -- common/autotest_common.sh@936 -- # '[' -z 1871829 ']' 00:30:42.639 17:23:38 -- common/autotest_common.sh@940 -- # kill -0 1871829 00:30:42.639 17:23:38 -- common/autotest_common.sh@941 -- # uname 00:30:42.639 17:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:42.639 17:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1871829 00:30:42.639 17:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:42.639 17:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:42.639 17:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1871829' 00:30:42.639 killing process with pid 1871829 00:30:42.639 17:23:38 -- common/autotest_common.sh@955 -- # kill 1871829 00:30:42.639 17:23:38 -- common/autotest_common.sh@960 -- # wait 1871829 00:30:42.639 17:23:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:42.639 17:23:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:42.639 17:23:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:42.639 17:23:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:42.639 17:23:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:42.639 17:23:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:42.639 17:23:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:42.639 17:23:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:44.016 17:23:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:44.016 00:30:44.016 real 0m23.651s 00:30:44.016 user 1m3.547s 00:30:44.016 sys 0m4.349s 00:30:44.016 17:23:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:44.016 17:23:40 -- common/autotest_common.sh@10 -- # set +x 00:30:44.016 ************************************ 00:30:44.016 END TEST nvmf_bdevperf 00:30:44.016 ************************************ 00:30:44.016 17:23:40 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:44.016 17:23:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:44.016 17:23:40 -- common/autotest_common.sh@10 -- # set +x 00:30:44.016 ************************************ 00:30:44.016 START TEST nvmf_target_disconnect 00:30:44.016 ************************************ 00:30:44.016 17:23:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:44.016 * Looking for test storage... 00:30:44.016 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:44.016 17:23:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:44.016 17:23:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:44.016 17:23:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:44.016 17:23:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:44.016 17:23:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:44.016 17:23:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:44.016 17:23:40 -- scripts/common.sh@335 -- # IFS=.-: 00:30:44.016 17:23:40 -- scripts/common.sh@335 -- # read -ra ver1 00:30:44.016 17:23:40 -- scripts/common.sh@336 -- # IFS=.-: 00:30:44.016 17:23:40 -- scripts/common.sh@336 -- # read -ra ver2 00:30:44.016 17:23:40 -- scripts/common.sh@337 -- # local 'op=<' 00:30:44.016 17:23:40 -- scripts/common.sh@339 -- # ver1_l=2 00:30:44.016 17:23:40 -- scripts/common.sh@340 -- # ver2_l=1 00:30:44.016 17:23:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:44.016 17:23:40 -- scripts/common.sh@343 -- # case "$op" in 00:30:44.016 17:23:40 -- scripts/common.sh@344 -- # : 1 00:30:44.016 17:23:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:44.016 17:23:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:44.016 17:23:40 -- scripts/common.sh@364 -- # decimal 1 00:30:44.016 17:23:40 -- scripts/common.sh@352 -- # local d=1 00:30:44.016 17:23:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:44.016 17:23:40 -- scripts/common.sh@354 -- # echo 1 00:30:44.016 17:23:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:44.016 17:23:40 -- scripts/common.sh@365 -- # decimal 2 00:30:44.016 17:23:40 -- scripts/common.sh@352 -- # local d=2 00:30:44.016 17:23:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:44.016 17:23:40 -- scripts/common.sh@354 -- # echo 2 00:30:44.016 17:23:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:44.016 17:23:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:44.016 17:23:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:44.016 17:23:40 -- scripts/common.sh@367 -- # return 0 00:30:44.016 17:23:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:44.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.016 --rc genhtml_branch_coverage=1 00:30:44.016 --rc genhtml_function_coverage=1 00:30:44.016 --rc genhtml_legend=1 00:30:44.016 --rc geninfo_all_blocks=1 00:30:44.016 --rc geninfo_unexecuted_blocks=1 00:30:44.016 00:30:44.016 ' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:44.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.016 --rc genhtml_branch_coverage=1 00:30:44.016 --rc genhtml_function_coverage=1 00:30:44.016 --rc genhtml_legend=1 00:30:44.016 --rc geninfo_all_blocks=1 00:30:44.016 --rc geninfo_unexecuted_blocks=1 00:30:44.016 00:30:44.016 ' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:44.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.016 --rc genhtml_branch_coverage=1 00:30:44.016 --rc genhtml_function_coverage=1 00:30:44.016 --rc genhtml_legend=1 00:30:44.016 --rc geninfo_all_blocks=1 00:30:44.016 --rc geninfo_unexecuted_blocks=1 00:30:44.016 00:30:44.016 ' 00:30:44.016 17:23:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:44.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.016 --rc genhtml_branch_coverage=1 00:30:44.016 --rc genhtml_function_coverage=1 00:30:44.016 --rc genhtml_legend=1 00:30:44.016 --rc geninfo_all_blocks=1 00:30:44.016 --rc geninfo_unexecuted_blocks=1 00:30:44.016 00:30:44.016 ' 00:30:44.016 17:23:40 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:44.016 17:23:40 -- nvmf/common.sh@7 -- # uname -s 00:30:44.016 17:23:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:44.016 17:23:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:44.016 17:23:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:44.016 17:23:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:44.016 17:23:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:44.016 17:23:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:44.016 17:23:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:44.016 17:23:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:44.016 17:23:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:44.016 17:23:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:44.016 17:23:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:44.016 17:23:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:44.016 17:23:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:44.016 17:23:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:44.017 17:23:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:44.017 17:23:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:44.017 17:23:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:44.017 17:23:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:44.017 17:23:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:44.017 17:23:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.017 17:23:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.017 17:23:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.017 17:23:40 -- paths/export.sh@5 -- # export PATH 00:30:44.017 17:23:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.017 17:23:40 -- nvmf/common.sh@46 -- # : 0 00:30:44.017 17:23:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:44.017 17:23:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:44.017 17:23:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:44.017 17:23:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:44.017 17:23:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:44.017 17:23:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:44.017 17:23:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:44.017 17:23:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:44.017 17:23:40 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:44.017 17:23:40 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:44.017 17:23:40 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:44.017 17:23:40 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:44.017 17:23:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:44.017 17:23:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:44.017 17:23:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:44.017 17:23:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:44.017 17:23:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:44.017 17:23:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:44.017 17:23:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:44.017 17:23:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:44.017 17:23:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:44.017 17:23:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:44.017 17:23:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:44.017 17:23:40 -- common/autotest_common.sh@10 -- # set +x 00:30:45.919 17:23:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:45.920 17:23:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:45.920 17:23:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:45.920 17:23:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:45.920 17:23:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:45.920 17:23:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:45.920 17:23:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:45.920 17:23:42 -- nvmf/common.sh@294 -- # net_devs=() 00:30:45.920 17:23:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:45.920 17:23:42 -- nvmf/common.sh@295 -- # e810=() 00:30:45.920 17:23:42 -- nvmf/common.sh@295 -- # local -ga e810 00:30:45.920 17:23:42 -- nvmf/common.sh@296 -- # x722=() 00:30:45.920 17:23:42 -- nvmf/common.sh@296 -- # local -ga x722 00:30:45.920 17:23:42 -- nvmf/common.sh@297 -- # mlx=() 00:30:45.920 17:23:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:45.920 17:23:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:45.920 17:23:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:45.920 17:23:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:45.920 17:23:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:45.920 17:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:45.920 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:45.920 17:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:45.920 17:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:45.920 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:45.920 17:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:45.920 17:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:45.920 17:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:45.920 17:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:45.920 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:45.920 17:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:45.920 17:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:45.920 17:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:45.920 17:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:45.920 17:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:45.920 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:45.920 17:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:45.920 17:23:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:45.920 17:23:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:45.920 17:23:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:45.920 17:23:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:45.920 17:23:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:45.920 17:23:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:45.920 17:23:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:45.920 17:23:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:45.920 17:23:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:45.920 17:23:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:45.920 17:23:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:45.920 17:23:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:45.920 17:23:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:45.920 17:23:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:45.920 17:23:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:45.920 17:23:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:45.920 17:23:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:45.920 17:23:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:45.920 17:23:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:45.920 17:23:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:45.920 17:23:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:46.207 17:23:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:46.207 17:23:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:46.207 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:46.207 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.360 ms 00:30:46.207 00:30:46.207 --- 10.0.0.2 ping statistics --- 00:30:46.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:46.207 rtt min/avg/max/mdev = 0.360/0.360/0.360/0.000 ms 00:30:46.207 17:23:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:46.207 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:46.207 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:30:46.207 00:30:46.207 --- 10.0.0.1 ping statistics --- 00:30:46.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:46.207 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:30:46.207 17:23:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:46.207 17:23:42 -- nvmf/common.sh@410 -- # return 0 00:30:46.207 17:23:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:46.207 17:23:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:46.207 17:23:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:46.207 17:23:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:46.207 17:23:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:46.207 17:23:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:46.207 17:23:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:46.207 17:23:42 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:46.207 17:23:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:46.207 17:23:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:46.207 17:23:42 -- common/autotest_common.sh@10 -- # set +x 00:30:46.207 ************************************ 00:30:46.207 START TEST nvmf_target_disconnect_tc1 00:30:46.207 ************************************ 00:30:46.207 17:23:42 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:46.207 17:23:42 -- host/target_disconnect.sh@32 -- # set +e 00:30:46.207 17:23:42 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:46.207 EAL: No free 2048 kB hugepages reported on node 1 00:30:46.207 [2024-11-27 17:23:42.999011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:46.207 [2024-11-27 17:23:42.999205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:46.207 [2024-11-27 17:23:42.999236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21a5270 with addr=10.0.0.2, port=4420 00:30:46.207 [2024-11-27 17:23:42.999275] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:46.207 [2024-11-27 17:23:42.999304] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:46.207 [2024-11-27 17:23:42.999320] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:46.207 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:46.207 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:46.207 Initializing NVMe Controllers 00:30:46.207 17:23:43 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:46.207 17:23:43 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:46.207 17:23:43 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:46.207 17:23:43 -- common/autotest_common.sh@1142 -- # return 0 00:30:46.207 17:23:43 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:46.207 17:23:43 -- host/target_disconnect.sh@41 -- # set -e 00:30:46.207 00:30:46.207 real 0m0.093s 00:30:46.207 user 0m0.034s 00:30:46.207 sys 0m0.059s 00:30:46.207 17:23:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:46.207 17:23:43 -- common/autotest_common.sh@10 -- # set +x 00:30:46.207 ************************************ 00:30:46.207 END TEST nvmf_target_disconnect_tc1 00:30:46.207 ************************************ 00:30:46.207 17:23:43 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:46.207 17:23:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:46.207 17:23:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:46.207 17:23:43 -- common/autotest_common.sh@10 -- # set +x 00:30:46.207 ************************************ 00:30:46.207 START TEST nvmf_target_disconnect_tc2 00:30:46.207 ************************************ 00:30:46.207 17:23:43 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:46.207 17:23:43 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:46.207 17:23:43 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:46.207 17:23:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:46.207 17:23:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:46.207 17:23:43 -- common/autotest_common.sh@10 -- # set +x 00:30:46.207 17:23:43 -- nvmf/common.sh@469 -- # nvmfpid=1874985 00:30:46.207 17:23:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:46.207 17:23:43 -- nvmf/common.sh@470 -- # waitforlisten 1874985 00:30:46.207 17:23:43 -- common/autotest_common.sh@829 -- # '[' -z 1874985 ']' 00:30:46.207 17:23:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:46.207 17:23:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:46.208 17:23:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:46.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:46.208 17:23:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:46.208 17:23:43 -- common/autotest_common.sh@10 -- # set +x 00:30:46.208 [2024-11-27 17:23:43.088740] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:46.208 [2024-11-27 17:23:43.088823] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:46.208 EAL: No free 2048 kB hugepages reported on node 1 00:30:46.466 [2024-11-27 17:23:43.157789] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:46.466 [2024-11-27 17:23:43.253874] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:46.466 [2024-11-27 17:23:43.254037] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:46.466 [2024-11-27 17:23:43.254057] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:46.466 [2024-11-27 17:23:43.254071] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:46.466 [2024-11-27 17:23:43.254159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:46.466 [2024-11-27 17:23:43.254234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:46.466 [2024-11-27 17:23:43.254334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:46.466 [2024-11-27 17:23:43.254336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:47.400 17:23:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:47.400 17:23:44 -- common/autotest_common.sh@862 -- # return 0 00:30:47.400 17:23:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:47.400 17:23:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 17:23:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:47.400 17:23:44 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 Malloc0 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 [2024-11-27 17:23:44.108293] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 [2024-11-27 17:23:44.136558] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:47.400 17:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:47.400 17:23:44 -- common/autotest_common.sh@10 -- # set +x 00:30:47.400 17:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:47.400 17:23:44 -- host/target_disconnect.sh@50 -- # reconnectpid=1875144 00:30:47.400 17:23:44 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:47.400 17:23:44 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:47.400 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.310 17:23:46 -- host/target_disconnect.sh@53 -- # kill -9 1874985 00:30:49.310 17:23:46 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 [2024-11-27 17:23:46.160424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Write completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.310 starting I/O failed 00:30:49.310 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 [2024-11-27 17:23:46.160857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 [2024-11-27 17:23:46.161175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Write completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 Read completed with error (sct=0, sc=8) 00:30:49.311 starting I/O failed 00:30:49.311 [2024-11-27 17:23:46.161494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:49.311 [2024-11-27 17:23:46.161686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.311 [2024-11-27 17:23:46.161859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.311 [2024-11-27 17:23:46.161889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.162047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.162310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.162633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.162779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.162882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.163166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.163489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.163762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.163877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.163975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.164198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.164440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.164728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.164848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.164969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.165268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.165566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.165728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.165855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.166205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.166475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.166699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.166821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.166948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.167201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.167470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.167693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.167814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.312 qpair failed and we were unable to recover it. 00:30:49.312 [2024-11-27 17:23:46.167917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.168123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.312 [2024-11-27 17:23:46.168148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.168298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.168590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.168809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.168983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.169106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.169434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.169655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.169777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.170012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.170374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.170663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.170792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.170911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.171146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.171427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.171717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.171827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.171934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.172207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.172509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.172832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.172977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.173100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.173363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.173618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.173781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.173931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.174075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.174099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.313 qpair failed and we were unable to recover it. 00:30:49.313 [2024-11-27 17:23:46.174198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.313 [2024-11-27 17:23:46.174319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.174349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.174438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.174565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.174591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.174696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.174810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.174836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.174931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.175237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.175496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.175822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.175968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.176058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.176291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.176557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.176805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.176954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.177082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.177326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.177627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.177772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.177931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.178261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.178502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.178732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.178881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.178973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.179212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.314 [2024-11-27 17:23:46.179501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.314 [2024-11-27 17:23:46.179678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.314 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.179776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.179893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.179918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.180064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.180298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.180545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.180747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.180867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.180983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.181271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.181547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.181824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.181981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.182108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.182376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.182688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.182833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.182989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.183229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.183491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.183728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.183846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.183996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.184204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.184466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.184725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.184846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.184972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.185063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.185088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.315 qpair failed and we were unable to recover it. 00:30:49.315 [2024-11-27 17:23:46.185190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.315 [2024-11-27 17:23:46.185314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.185340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.185429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.185565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.185591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.185711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.185838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.185863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.185985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.186279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.186490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.186772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.186903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.186996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.187267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.187568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.187846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.187989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.188113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.188379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.188632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.188781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.188938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.189208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.189479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.189735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.189846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.316 qpair failed and we were unable to recover it. 00:30:49.316 [2024-11-27 17:23:46.189933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.190028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.316 [2024-11-27 17:23:46.190053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.190175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.190460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.190717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.190869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.190988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.191258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.191511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.191692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.191787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.192696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.192731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.192885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.193132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.193398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.193707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.193864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.194002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.194257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.194515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.194797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.194978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.195127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.195372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.195620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.195795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.195919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.196135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.196408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.196719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.196871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.317 qpair failed and we were unable to recover it. 00:30:49.317 [2024-11-27 17:23:46.197002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.317 [2024-11-27 17:23:46.197097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.197252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.197531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.197799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.197944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.198095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.198367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.198664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.198785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.198885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.199156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.199452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.199731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.199868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.199971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.200208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.200441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.200706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.200850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.200969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.201226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.201465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.201700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.201848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.201946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.202239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.202479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.202774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.318 [2024-11-27 17:23:46.202926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.318 qpair failed and we were unable to recover it. 00:30:49.318 [2024-11-27 17:23:46.203054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.203284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.203599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.203774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.203933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.204198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.204495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.204715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.204857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.204952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.205229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.205500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.205751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.205896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.206023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.206349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.206648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.206815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.206954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.207230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.207470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.207727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.207915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.208009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.208248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.208517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.319 [2024-11-27 17:23:46.208776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.319 [2024-11-27 17:23:46.208905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.319 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.209000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.209266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.209503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.209752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.209903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.210028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.210292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.210543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.210851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.210972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.211093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.211381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.211663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.211771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.211906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.212203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.212447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.212705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.212829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.212927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.213150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.213448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.213690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.213837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.213957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.214082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.214107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.214256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.214353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.214377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.320 qpair failed and we were unable to recover it. 00:30:49.320 [2024-11-27 17:23:46.214529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.320 [2024-11-27 17:23:46.214624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.214648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.214770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.214898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.214923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.215009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.215280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.215521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.215806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.215934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.216027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.216298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.216543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.216784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.216944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.217095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.217335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.217613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.217737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.217895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.218191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.218505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.218827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.218971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.219061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.219359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.219644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.219790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.219941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.220064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.220089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.220209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.220334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.321 [2024-11-27 17:23:46.220359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.321 qpair failed and we were unable to recover it. 00:30:49.321 [2024-11-27 17:23:46.220479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.220592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.220622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.220776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.220905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.220929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.221018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.221317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.221591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.221804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.221956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.222105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.222350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.222565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.222831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.222971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.223085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.223356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.223554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.223819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.223944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.224065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.224342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.224641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.224881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.224997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.225111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.225213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.322 [2024-11-27 17:23:46.225239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.322 qpair failed and we were unable to recover it. 00:30:49.322 [2024-11-27 17:23:46.225337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.225429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.225453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.225589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.225688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.225713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.225852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.225999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.226122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.226357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.226616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.226858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.226972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.227120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.227346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.227609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.227803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.227925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.228194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.228447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.228696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.228822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.228920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.229151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.229411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.229645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.229793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.229921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.230182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.230444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.323 [2024-11-27 17:23:46.230593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.323 qpair failed and we were unable to recover it. 00:30:49.323 [2024-11-27 17:23:46.230715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.230804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.230829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.230924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.231192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.231455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.231696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.231885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.231983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.232257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.232498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.232739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.232885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.233032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.233281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.233521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.233784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.233957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.234076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.234324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.234600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.234772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.234898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.235172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.235441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.235666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.235791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.235913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.236063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.236088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.236192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.236305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.324 [2024-11-27 17:23:46.236330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.324 qpair failed and we were unable to recover it. 00:30:49.324 [2024-11-27 17:23:46.236430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.236514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.236543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.236665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.236790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.236815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.236905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.236991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.237110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.237361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.237678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.237804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.237893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.238171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.238416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.238702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.238856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.239002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.239273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.239574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.239846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.239958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.240043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.240285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.240497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.240731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.240879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.240966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.241200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.241441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.241737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.241866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.325 qpair failed and we were unable to recover it. 00:30:49.325 [2024-11-27 17:23:46.242014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.325 [2024-11-27 17:23:46.242096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.242120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.242277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.242422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.242446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.242574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.242676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.242700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.242837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.243179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.243464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.243675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.243822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.243970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.244215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.244513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.244812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.244937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.245029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.245270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.245510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.245721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.245839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.245972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.246245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.246464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.246781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.246952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.247072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.247393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.326 [2024-11-27 17:23:46.247678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.326 [2024-11-27 17:23:46.247824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.326 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.247948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.248210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.248445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.248673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.248842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.248946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.249158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.249431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.249677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.249800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.249926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.250171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.250431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.250724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.250848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.250971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.251167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.251417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.251653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.251897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.251990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.252163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.252457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.252773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.252919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.327 [2024-11-27 17:23:46.253073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.253191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.327 [2024-11-27 17:23:46.253217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.327 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.253316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.253567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.253815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.253929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.254051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.254310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.254517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.254752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.254879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.254979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.255244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.255461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.255691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.255863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.255952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.256238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.605 [2024-11-27 17:23:46.256459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.605 [2024-11-27 17:23:46.256587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.605 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.256701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.256792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.256821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.256929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.257141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.257395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.257653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.257894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.257996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.258109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.258376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.258680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.258800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.258920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.259158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.259429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.259661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.259878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.260021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.260286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.260581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.260823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.260950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.261075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.261340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.261607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.261819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.261952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.262067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.262092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.606 qpair failed and we were unable to recover it. 00:30:49.606 [2024-11-27 17:23:46.262245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.606 [2024-11-27 17:23:46.262367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.262392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.262487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.262610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.262636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.262752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.262897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.262922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.263014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.263337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.263614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.263850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.263998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.264112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.264381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.264631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.264875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.264986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.265111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.265407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.265707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.265850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.265949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.266216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.266451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.266751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.266900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.267029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.267277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.267519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.267739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.267884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.607 qpair failed and we were unable to recover it. 00:30:49.607 [2024-11-27 17:23:46.268006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.607 [2024-11-27 17:23:46.268125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.268280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.268571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.268815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.268968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.269085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.269357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.269595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.269827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.269948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.270049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.270317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.270557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.270853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.270966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.271114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.271436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.271654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.271766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.271887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.272179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.272462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.272750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.272872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.272971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.273208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.273425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.608 [2024-11-27 17:23:46.273567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.608 qpair failed and we were unable to recover it. 00:30:49.608 [2024-11-27 17:23:46.273687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.273783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.273808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.273935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.274148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.274401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.274667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.274782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.274919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.275132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.275403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.275682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.275906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.275997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.276173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.276489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.276742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.276855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.276975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.277269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.277512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.277786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.277949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.278088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.278331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.278584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.278855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.278999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.279119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.279215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.279240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.609 qpair failed and we were unable to recover it. 00:30:49.609 [2024-11-27 17:23:46.279364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.609 [2024-11-27 17:23:46.279488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.279512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.279634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.279762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.279789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.279902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.280142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.280382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.280656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.280782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.280915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.281171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.281372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.281597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.281819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.281940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.282068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.282321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.282590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.282705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.282849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.283171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.283496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.283716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.283835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.283982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.284252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.284537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.284767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.284929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.285064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.285189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.285213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.610 qpair failed and we were unable to recover it. 00:30:49.610 [2024-11-27 17:23:46.285384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.610 [2024-11-27 17:23:46.285486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.285512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.285673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.285771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.285801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.285936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.286151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.286471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.286757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.286899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.287019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.287309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.287588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.287814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.287954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.288044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.288370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.288667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.288783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.288909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.289231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.289546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.289761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.289942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.290062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.290182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.290206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.611 qpair failed and we were unable to recover it. 00:30:49.611 [2024-11-27 17:23:46.290345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.611 [2024-11-27 17:23:46.290478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.290505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.290614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.290732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.290757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.290877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.290993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.291108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.291418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.291686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.291831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.291963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.292257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.292552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.292861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.292983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.293146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.293399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.293648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.293812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.293946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.294249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.294496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.294751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.294873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.294988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.295315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.295621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.295759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.295906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.296026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.612 [2024-11-27 17:23:46.296050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.612 qpair failed and we were unable to recover it. 00:30:49.612 [2024-11-27 17:23:46.296204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.296463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.296767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.296904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.297051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.297304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.297606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.297858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.297988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.298186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.298446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.298705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.298868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.298969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.299269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.299539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.299804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.299941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.300115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.300332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.300605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.300842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.300988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.301136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.301418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.301687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.301859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.301991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.302122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.302164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.613 [2024-11-27 17:23:46.302285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.302380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.613 [2024-11-27 17:23:46.302423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.613 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.302589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.302677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.302706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.302874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.303217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.303495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.303744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.303878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.304037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.304293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.304583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.304815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.304965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.305108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.305402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.305690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.305849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.305977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.306258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.306535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.306837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.306981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.307093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.307412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.307697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.307841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.308016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.308140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.308164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.308276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.308375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.308401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.614 qpair failed and we were unable to recover it. 00:30:49.614 [2024-11-27 17:23:46.308552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.614 [2024-11-27 17:23:46.308684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.308709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.308853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.308952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.308979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.309080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.309410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.309646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.309777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.309892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.310219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.310488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.310727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.310885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.311068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.311358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.311614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.311861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.311984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.312132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.312431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.312715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.312856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.312980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.313274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.313555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.313824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.313966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.314083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.314330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.314540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.615 [2024-11-27 17:23:46.314708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.615 qpair failed and we were unable to recover it. 00:30:49.615 [2024-11-27 17:23:46.314849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.314980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.315115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.315398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.315690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.315858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.315978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.316261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.316587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.316847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.316968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.317089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.317355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.317667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.317783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.317908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.318227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.318458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.318750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.318876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.319041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.319291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.319498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.319818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.319974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.320123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.320347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.320593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.320836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.616 [2024-11-27 17:23:46.320972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.616 qpair failed and we were unable to recover it. 00:30:49.616 [2024-11-27 17:23:46.321142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.321406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.321649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.321887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.321999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.322127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.322423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.322707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.322870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.323016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.323361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.323624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.323850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.323984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.324156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.324434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.324715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.324888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.325032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.325297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.325603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.325829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.617 [2024-11-27 17:23:46.325978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.617 qpair failed and we were unable to recover it. 00:30:49.617 [2024-11-27 17:23:46.326073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.326393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.326706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.326817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.326959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.327194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.327503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.327811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.327982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.328100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.328462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.328702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.328890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.329020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.329274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.329510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.329803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.329947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.330118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.330396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.330675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.330903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.330992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.331167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.331493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.331762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.331884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.331998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.332157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.332181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.618 [2024-11-27 17:23:46.332300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.332398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.618 [2024-11-27 17:23:46.332422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.618 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.332518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.332654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.332679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.332817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.332942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.332969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.333106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.333339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.333680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.333809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.333946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.334302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.334631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.334879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.334996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.335142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.335382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.335604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.335840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.335980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.336135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.336364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.336702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.336850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.337022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.337268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.337574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.337791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.337908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.338054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.338174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.338199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.338290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.338440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.619 [2024-11-27 17:23:46.338464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.619 qpair failed and we were unable to recover it. 00:30:49.619 [2024-11-27 17:23:46.338599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.338731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.338758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.338850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.338975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.339148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.339432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.339748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.339891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.339979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.340293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.340559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.340827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.340943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.341108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.341338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.341622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.341888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.341986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.342144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.342412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.342708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.342828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.342935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.343229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.343544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.343994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.344144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.344389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.344706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.344877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.620 qpair failed and we were unable to recover it. 00:30:49.620 [2024-11-27 17:23:46.344988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.620 [2024-11-27 17:23:46.345079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.345273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.345510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.345812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.345957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.346077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.346282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.346530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.346814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.346986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.347102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.347382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.347639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.347803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.347917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.348222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.348475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.348774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.348910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.349053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.349392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.349696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.349899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.350041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.350371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.350715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.350871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.351017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.351106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.351130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.621 [2024-11-27 17:23:46.351249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.351406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.621 [2024-11-27 17:23:46.351433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.621 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.351597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.351727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.351753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.351898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.351978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.352119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.352371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.352684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.352832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.352978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.353227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.353463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.353714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.353858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.354000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.354245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.354587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.354830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.354949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.355064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.355352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.355671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.355835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.355976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.356236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.356549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.356843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.356990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.622 [2024-11-27 17:23:46.357075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.357195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.622 [2024-11-27 17:23:46.357219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.622 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.357303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.357392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.357434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.357547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.357695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.357720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.357839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.357999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.358162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.358465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.358763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.358948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.359079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.359390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.359666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.359823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.359987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.360259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.360548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.360717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.360878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.361178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.361396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.361678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.361807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.361952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.362071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.362096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.362243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.362373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.623 [2024-11-27 17:23:46.362404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.623 qpair failed and we were unable to recover it. 00:30:49.623 [2024-11-27 17:23:46.362507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.362660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.362685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.362780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.362926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.362950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.363072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.363338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.363622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.363869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.363997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.364125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.364363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.364656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.364813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.364912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.365162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.365449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.365744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.365869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.366040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.366305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.366566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.366845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.366989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.367102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.367398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.367701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.367854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.367973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.368234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.624 [2024-11-27 17:23:46.368542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.624 [2024-11-27 17:23:46.368660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.624 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.368833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.368963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.368989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.369165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.369438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.369752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.369910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.370044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.370296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.370563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.370880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.370979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.371171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.371462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.371710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.371876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.372002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.372270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.372538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.372771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.372927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.373058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.373380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.373656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.373783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.373881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.374187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.374475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.374742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.374888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.625 [2024-11-27 17:23:46.374987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.375115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.625 [2024-11-27 17:23:46.375139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.625 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.375254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.375523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.375832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.375982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.376152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.376398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.376747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.376887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.376998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.377323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.377565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.377828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.377983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.378131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.378447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.378726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.378924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.379042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.379332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.379536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.379796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.379976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.380103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.380393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.380694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.380822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.380964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.381306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.381618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.381834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.626 [2024-11-27 17:23:46.381997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.626 qpair failed and we were unable to recover it. 00:30:49.626 [2024-11-27 17:23:46.382127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.382423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.382752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.382925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.383070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.383383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.383641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.383797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.383933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.384224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.384452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.384786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.384934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.385049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.385287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.385609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.385864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.385994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.386134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.386414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.386726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.386883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.387315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.387557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.387813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.387971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.388137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.388269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.388294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.388415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.388542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.627 [2024-11-27 17:23:46.388569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.627 qpair failed and we were unable to recover it. 00:30:49.627 [2024-11-27 17:23:46.388688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.388778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.388802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.388898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.389154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.389483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.389761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.389897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.390037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.390255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.390572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.390721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.390872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.391183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.391500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.391752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.391895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.392004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.392271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.392611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.392854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.392994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.393103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.393429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.628 qpair failed and we were unable to recover it. 00:30:49.628 [2024-11-27 17:23:46.393689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.628 [2024-11-27 17:23:46.393890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.394022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.394274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.394566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.394844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.394989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.395103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.395340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.395697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.395847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.395978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.396311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.396578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.396754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.396908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.397252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.397549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.397790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.397948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.398086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.398373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.398630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.398781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.398934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.399233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.399482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.399826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.399975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.629 qpair failed and we were unable to recover it. 00:30:49.629 [2024-11-27 17:23:46.400070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.400158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.629 [2024-11-27 17:23:46.400182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.400321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.400492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.400517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.400623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.400719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.400744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.400891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.401178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.401476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.401779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.401970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.402085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.402334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.402629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.402792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.402954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.403281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.403574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.403820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.403938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.404052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.404343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.404552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.404797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.404946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.405058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.405355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.405649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.405799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.630 [2024-11-27 17:23:46.405922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.406044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.630 [2024-11-27 17:23:46.406069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.630 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.406184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.406448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.406702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.406890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.407024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.407337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.407539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.407782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.407902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.408019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.408216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.408477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.408806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.408957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.409103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.409352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.409640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.409786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.409893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.410218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.410539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.410854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.410999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.411517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.411796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.411926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.412044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.412167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.412193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.631 qpair failed and we were unable to recover it. 00:30:49.631 [2024-11-27 17:23:46.412343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.631 [2024-11-27 17:23:46.412466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.412493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.412692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.412794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.412819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.412948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.413284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.413585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.413742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.413889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.414148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.414429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.414675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.414809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.414916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.415228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.415511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.415760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.415901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.416035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.416326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.416597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.416846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.416993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.417129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.417346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.417610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.417822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.417971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.418086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.418212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.418239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.632 qpair failed and we were unable to recover it. 00:30:49.632 [2024-11-27 17:23:46.418377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.632 [2024-11-27 17:23:46.418507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.418542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.418696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.418821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.418846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.418960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.419190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.419473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.419726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.419847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.419934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.420193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.420461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.420740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.420862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.421008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.421271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.421574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.421810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.421928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.422057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.422318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.422607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.422784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.422913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.423176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.423418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.423710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.423874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.423995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.424088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.424112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.424237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.424333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.424374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.633 qpair failed and we were unable to recover it. 00:30:49.633 [2024-11-27 17:23:46.424503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.633 [2024-11-27 17:23:46.424657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.424682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.424768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.424960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.424985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.425085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.425356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.425595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.425864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.425995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.426109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.426342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.426640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.426794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.426885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.427214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.427498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.427823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.427990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.428132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.428372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.428641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.428802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.428948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.429070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.429095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.429236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.429337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.429364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.634 qpair failed and we were unable to recover it. 00:30:49.634 [2024-11-27 17:23:46.429555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.634 [2024-11-27 17:23:46.429645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.429670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.429776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.429871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.429898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.430024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.430281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.430576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.430859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.430959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.431127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.431377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.431689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.431833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.431991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.432308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.432589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.432751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.432923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.433205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.433468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.433749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.433916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.434069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.434306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.434621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.434790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.434917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.435158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.435444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.635 qpair failed and we were unable to recover it. 00:30:49.635 [2024-11-27 17:23:46.435708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.635 [2024-11-27 17:23:46.435849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.435874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.436042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.436310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.436581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.436816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.436972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.437135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.437430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.437680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.437802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.437907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.438207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.438477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.438704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.438833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.438936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.439188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.439431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.439718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.439879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.439974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.440318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.440585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.440709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.440879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.441180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.441459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.636 qpair failed and we were unable to recover it. 00:30:49.636 [2024-11-27 17:23:46.441733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.636 [2024-11-27 17:23:46.441855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.441881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.442029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.442372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.442661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.442811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.442986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.443298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.443604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.443839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.443990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.444154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.444408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.444700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.444888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.444990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.445295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.445603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.445844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.445956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.446082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.446354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.446652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.446762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.446916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.447206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.447485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.637 [2024-11-27 17:23:46.447817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.637 [2024-11-27 17:23:46.447940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.637 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.448114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.448414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.448670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.448785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.448872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.449142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.449406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.449718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.449842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.449988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.450298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.450537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.450854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.450981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.451122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.451398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.451692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.451827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.451945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.452191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.452451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.452745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.452864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.452985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.453215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.453474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.453786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.453900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.454024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.454113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.638 [2024-11-27 17:23:46.454138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.638 qpair failed and we were unable to recover it. 00:30:49.638 [2024-11-27 17:23:46.454263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.454499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.454756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.454917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.455059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.455351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.455645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.455886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.455975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.456168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.456453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.456745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.456867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.456984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.457256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.457497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.457795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.457960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.458088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.458338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.458536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.458808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.458942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.459068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.459349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.459618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.459843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.639 [2024-11-27 17:23:46.459995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.639 qpair failed and we were unable to recover it. 00:30:49.639 [2024-11-27 17:23:46.460177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.460467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.460712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.460830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.460936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.461258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.461545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.461782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.461910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.462043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.462334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.462633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.462823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.462990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.463154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.463417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.463688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.463862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.463973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.464252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.464496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.464769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.464948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.465072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.465236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.640 [2024-11-27 17:23:46.465264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.640 qpair failed and we were unable to recover it. 00:30:49.640 [2024-11-27 17:23:46.465410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.465559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.465585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.465710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.465808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.465835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.465973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.466277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.466500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.466739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.466893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.467004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.467260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.467614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.467803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.467917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.468005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.468252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.468547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.468812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.468984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.469130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.469410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.469673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.469878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.469994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.470320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.470584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.470759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.470909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.471175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.471481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.641 [2024-11-27 17:23:46.471768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.641 [2024-11-27 17:23:46.471900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.641 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.472060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.472328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.472569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.472783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.472934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.473022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.473324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.473635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.473754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.473880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.474215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.474473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.474701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.474845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.474969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.475232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.475504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.475836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.475982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.476103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.476420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.476746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.476876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.476997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.477222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.477547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.642 qpair failed and we were unable to recover it. 00:30:49.642 [2024-11-27 17:23:46.477792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.642 [2024-11-27 17:23:46.477890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.477918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.478033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.478288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.478579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.478744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.478915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.479180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.479466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.479770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.479929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.480059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.480337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.480635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.480897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.480981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.481097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.481349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.481592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.481797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.481910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.482034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.482343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.482555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.482792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.482974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.483077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.483185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.483210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.643 qpair failed and we were unable to recover it. 00:30:49.643 [2024-11-27 17:23:46.483292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.643 [2024-11-27 17:23:46.483407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.483431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.483599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.483702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.483730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.483882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.483998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.484110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.484401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.484678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.484846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.484976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.485545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.485823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.485973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.486074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.486337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.486585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.486824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.486942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.487058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.487365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.487792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.487913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.488212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.488475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.488727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.488832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.488991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.489152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.489176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.644 [2024-11-27 17:23:46.489303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.489464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.644 [2024-11-27 17:23:46.489492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.644 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.489640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.489767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.489792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.489948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.490264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.490531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.490837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.490966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.491093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.491329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.491567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.491844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.491970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.492088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.492311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.492540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.492804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.492968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.493084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.493320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.493686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.493831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.493958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.494208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.494505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.494811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.494967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.495084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.495206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.495230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.645 [2024-11-27 17:23:46.495347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.495438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.645 [2024-11-27 17:23:46.495462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.645 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.495555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.495682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.495710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.495809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.495933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.495960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.496089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.496348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.496584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.496830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.496993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.497152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.497450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.497686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.497807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.497907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.498151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.498373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.498643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.498801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.498905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.499164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.499419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.499648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.646 [2024-11-27 17:23:46.499847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.646 [2024-11-27 17:23:46.499962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.646 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.500119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.500361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.500682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.500818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.500950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.501209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.501493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.501762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.501875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.502017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.502285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.502570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.502744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.502905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.503191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.503461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.503753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.503875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.503976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.504197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.504500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.504759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.504933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.505043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.505331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.505597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.505898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.505989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.506014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.506131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.506266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.647 [2024-11-27 17:23:46.506294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.647 qpair failed and we were unable to recover it. 00:30:49.647 [2024-11-27 17:23:46.506425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.506561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.506591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.506744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.506840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.506865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.506954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.507247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.507491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.507830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.507980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.508120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.508405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.508681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.508834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.508964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.509205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.509447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.509751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.509907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.510039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.510316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.510573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.510743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.510907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.511239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.511515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.511753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.511870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.512019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.512339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.512609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.512783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.648 [2024-11-27 17:23:46.512899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.513027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.648 [2024-11-27 17:23:46.513055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.648 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.513224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.513487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.513753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.513894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.514280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.514567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.514845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.514986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.515141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.515407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.515654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.515769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.515900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.516212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.516456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.516728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.516901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.517022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.517242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.517535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.517777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.517925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.518017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.518252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.518463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.518724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.518924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.519072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.519226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.519251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.649 [2024-11-27 17:23:46.519379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.519469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.649 [2024-11-27 17:23:46.519494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.649 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.519614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.519710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.519734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.519853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.520135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.520432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.520689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.520835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.521001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.521275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.521521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.521784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.521930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.522051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.522295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.522585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.522827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.522976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.523101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.523435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.523711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.523831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.523926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.524206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.524480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.524728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.524845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.524984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.525260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.525537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.525694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.650 [2024-11-27 17:23:46.525856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.526007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.650 [2024-11-27 17:23:46.526032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.650 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.526146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.526467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.526709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.526848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.526973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.527225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.527510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.527820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.527970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.528077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.528374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.528645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.528789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.528968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.529215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.529522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.529769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.529891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.529977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.530270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.530499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.530779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.530911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.531056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.531345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.531596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.531816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.531999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.532116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.532463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.532742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.651 [2024-11-27 17:23:46.532858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.651 qpair failed and we were unable to recover it. 00:30:49.651 [2024-11-27 17:23:46.532963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.533219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.533466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.533774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.533908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.534017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.534309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.534626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.534871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.534995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.535093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.535344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.652 [2024-11-27 17:23:46.535672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.652 [2024-11-27 17:23:46.535844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.652 qpair failed and we were unable to recover it. 00:30:49.933 [2024-11-27 17:23:46.535986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.933 qpair failed and we were unable to recover it. 00:30:49.933 [2024-11-27 17:23:46.536228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.933 qpair failed and we were unable to recover it. 00:30:49.933 [2024-11-27 17:23:46.536502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.933 [2024-11-27 17:23:46.536663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.933 qpair failed and we were unable to recover it. 00:30:49.933 [2024-11-27 17:23:46.536764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.536859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.536885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.537015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.537285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.537520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.537788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.537928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.538075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.538308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.538589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.538825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.538945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.539068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.539305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.539613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.539737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.539856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.540206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.540474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.540802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.540967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.541058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.541376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.541608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.541874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.541998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.542193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.542468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.542744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.542868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.543267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.543610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.934 qpair failed and we were unable to recover it. 00:30:49.934 [2024-11-27 17:23:46.543893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.543996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.934 [2024-11-27 17:23:46.544026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.544174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.544489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.544781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.544902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.544989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.545222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.545461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.545745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.545864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.545988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.546268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.546539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.546760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.546899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.547000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.547296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.547557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.547842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.547983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.548074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.548343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.548628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.548746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.548893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.549233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.549493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.549747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.549869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.549969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.550233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.550509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.935 qpair failed and we were unable to recover it. 00:30:49.935 [2024-11-27 17:23:46.550786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.935 [2024-11-27 17:23:46.550893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.550923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.551047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.551338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.551664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.551790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.551910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.552190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.552461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.552701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.552840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.552976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.553263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.553516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.553782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.553895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.554018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.554247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.554539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.554772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.554941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.555114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.555369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.555645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.555822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.555938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.556175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.556464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.556732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.556887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.557012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.557280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.557529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.936 [2024-11-27 17:23:46.557748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.936 [2024-11-27 17:23:46.557855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.936 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.557945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.558201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.558534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.558875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.558997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.559166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.559479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.559823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.559940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.560069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.560309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.560520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.560820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.560936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.561039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.561296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.561554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.561860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.561987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.562124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.562379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.562678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.562852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.563014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.563282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.563554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.563826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.563996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.564170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.564432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.564707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.564849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.937 qpair failed and we were unable to recover it. 00:30:49.937 [2024-11-27 17:23:46.564953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.937 [2024-11-27 17:23:46.565099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.565252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.565575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.565851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.565972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.566065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.566336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.566579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.566694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.566845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.567154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.567422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.567678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.567812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.567947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.568294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.568642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.568791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.568912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.569173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b73e00 is same with the state(5) to be set 00:30:49.938 [2024-11-27 17:23:46.569354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.569616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.569838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.569981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.570141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.570416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.938 [2024-11-27 17:23:46.570668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.938 [2024-11-27 17:23:46.570781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.938 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.570901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.570998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.571198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.571515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.571772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.571881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.572005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.572240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.572456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.572742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.572889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.572994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.573273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.573543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.573782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.573934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.574061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.574363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.574593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.574813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.574955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.575074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.575357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.575676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.575825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.575914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.576205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.576496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.576731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.576844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.576993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.577213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.577415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.939 qpair failed and we were unable to recover it. 00:30:49.939 [2024-11-27 17:23:46.577670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.939 [2024-11-27 17:23:46.577771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.577795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.577918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.578160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.578381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.578673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.578793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.578946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.579230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.579564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.579781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.579934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.580026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.580291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.580590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.580830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.580980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.581130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.581442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.581706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.581864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.581967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.582235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.582512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.582747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.582903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.583791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.583975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.584144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.584440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.584757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.584883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.585032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.585336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.585666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.585815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.940 qpair failed and we were unable to recover it. 00:30:49.940 [2024-11-27 17:23:46.585952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.940 [2024-11-27 17:23:46.586064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.586200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.586544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.586770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.586952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.587049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.587362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.587667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.587830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.587972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.588304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.588513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.588781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.588926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.589023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.589259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.589494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.589736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.589852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.589983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.590254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.590545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.590788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.590950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.591097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.591400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.591656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.591840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.591981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.592253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.592494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.941 [2024-11-27 17:23:46.592785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.941 [2024-11-27 17:23:46.592950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.941 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.593074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.593335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.593575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.593803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.593944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.594037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.594267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.594771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.594920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.595045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.595284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.595573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.595816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.595932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.596083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.596375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.596626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.596784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.596924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.597183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.597454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.597712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.597845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.597985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.598253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.598493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.598740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.598886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.599029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.599330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.599604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.942 [2024-11-27 17:23:46.599741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.942 qpair failed and we were unable to recover it. 00:30:49.942 [2024-11-27 17:23:46.599842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.599984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.600135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.600458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.600690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.600809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.600926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.601212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.601478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.601767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.601906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.602025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.602305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.602606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.602750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.602917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.603209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.603481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.603825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.603969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.604070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.604391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.604675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.604841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.604960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.605212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.605471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.605796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.605958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.943 qpair failed and we were unable to recover it. 00:30:49.943 [2024-11-27 17:23:46.606087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.943 [2024-11-27 17:23:46.606189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.606312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.606559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.606834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.606983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.607114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.607328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.607610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.607759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.607884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.608177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.608466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.608696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.608821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.608922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.609226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.609483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.609779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.609952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.610080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.610388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.610672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.610819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.610946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.611181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.611431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.611683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.611791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.611910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.612176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.612458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.612678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.612834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.944 qpair failed and we were unable to recover it. 00:30:49.944 [2024-11-27 17:23:46.612952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.944 [2024-11-27 17:23:46.613076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.613224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.613511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.613762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.613898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.614050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.614300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.614536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.614762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.614876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.615028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.615351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.615570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.615800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.615947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.616096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.616390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.616623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.616741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.616949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.617291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.617548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.617779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.617921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.618065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.618345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.618647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.618851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.618995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.619087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.619371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.619642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.619862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.619984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.945 qpair failed and we were unable to recover it. 00:30:49.945 [2024-11-27 17:23:46.620076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.945 [2024-11-27 17:23:46.620169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.620353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.620615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.620835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.620988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.621111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.621392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.621667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.621782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.621942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.622268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.622580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.622833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.622975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.623068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.623329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.623572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.623780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.623968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.624128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.624425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.624673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.624808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.624931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.625200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.625441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.625704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.625913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.625997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.626165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.626392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.626632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.946 qpair failed and we were unable to recover it. 00:30:49.946 [2024-11-27 17:23:46.626842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.946 [2024-11-27 17:23:46.626957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.626997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.627166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.627414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.627667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.627782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.627929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.628243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.628502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.628736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.628859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.628952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.629185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.629476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.629699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.629850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.629970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.630178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.630440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.630669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.630793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.630916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.631169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.631379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.631589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.631830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.631975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.632070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.632289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.632515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.632767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.632954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.633090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.633221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.633249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.633368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.633466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.633491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.947 qpair failed and we were unable to recover it. 00:30:49.947 [2024-11-27 17:23:46.633624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.947 [2024-11-27 17:23:46.633724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.633749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.633878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.633968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.633993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.634119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.634438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.634700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.634856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.634988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.635295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.635574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.635851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.635971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.636123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.636357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.636584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.636804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.636957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.637080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.637336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.637639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.637899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.637994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.638135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.638369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.638615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.638857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.638989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.639085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.639356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.639652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.639766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.948 qpair failed and we were unable to recover it. 00:30:49.948 [2024-11-27 17:23:46.639924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.948 [2024-11-27 17:23:46.640067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.640237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.640506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.640789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.640919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.641032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.641306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.641643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.641777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.641939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.642180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.642511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.642763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.642937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.643054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.643310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.643612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.643762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.643893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.644180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.644455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.644734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.644846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.644986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.645253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.645566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.645775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.645899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.646051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.646371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.646594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.949 qpair failed and we were unable to recover it. 00:30:49.949 [2024-11-27 17:23:46.646813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.949 [2024-11-27 17:23:46.646955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.646985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.647103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.647386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.647699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.647867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.648015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.648300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.648627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.648854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.648978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.649110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.649372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.649691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.649869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.649964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.650278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.650605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.650733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.650880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.651148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.651417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.651684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.651822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.651945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.652256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.652509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.652743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.652872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.653046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.653344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.653622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.653867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.653986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.654082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.654220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.950 [2024-11-27 17:23:46.654254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.950 qpair failed and we were unable to recover it. 00:30:49.950 [2024-11-27 17:23:46.654358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.654473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.654498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.654604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.654699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.654723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.654876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.654972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.655118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.655453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.655694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.655866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.655966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.656287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.656522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.656776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.656955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.657078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.657341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.657673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.657786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.657919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.658238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.658487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.658747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.658930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.659030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.659369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.659644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.659772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.659943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.660243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.660515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.660784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.660926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.661022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.661230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.951 [2024-11-27 17:23:46.661477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.951 [2024-11-27 17:23:46.661631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.951 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.661721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.661867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.661894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.662002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.662272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.662601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.662776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.662910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.663187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.663515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.663775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.663956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.664101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.664396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.664680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.664822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.664939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.665237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.665472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.665756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.665898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.666031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.666319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.666557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.666820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.666990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.667174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.667397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.667721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.667871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.667964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.668288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.668620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.952 [2024-11-27 17:23:46.668780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.952 qpair failed and we were unable to recover it. 00:30:49.952 [2024-11-27 17:23:46.668940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.669223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.669492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.669808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.669954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.670113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.670424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.670722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.670850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.670974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.671291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.671532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.671872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.671991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.672113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.672381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.672690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.672834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.672949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.673307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.673541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.673821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.673990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.674160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.674412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.674632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.674791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.953 qpair failed and we were unable to recover it. 00:30:49.953 [2024-11-27 17:23:46.674944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.675072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.953 [2024-11-27 17:23:46.675098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.675247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.675403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.675430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.675540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.675690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.675718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.675871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.676192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.676474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.676724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.676880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.677059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.677351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.677627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.677747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.677887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.678231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.678537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.678870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.678993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.679109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.679373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.679712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.679887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.680042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.680312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.680553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.680835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.680987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.681117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.681336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.681630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.681864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.681982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.954 qpair failed and we were unable to recover it. 00:30:49.954 [2024-11-27 17:23:46.682082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.682182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.954 [2024-11-27 17:23:46.682206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.682322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.682416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.682458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.682608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.682734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.682760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.682846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.683242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.683670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.683824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.683964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.684251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.684558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.684800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.684923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.685019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.685287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.685608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.685762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.685904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.686240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.686533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.686776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.686945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.687240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.687456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.687692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.687873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.688018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.688332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.688655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.688780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.688911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.689223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.955 [2024-11-27 17:23:46.689510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.955 [2024-11-27 17:23:46.689670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.955 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.689791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.689881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.689905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.690086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.690387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.690670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.690813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.690918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.691188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.691452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.691738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.691910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.692058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.692282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.692610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.692854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.692984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.693103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.693363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.693705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.693903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.694053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.694302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.694576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.694886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.694981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.695130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.695465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.695767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.695925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.696061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.696367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.696670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.696789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.956 qpair failed and we were unable to recover it. 00:30:49.956 [2024-11-27 17:23:46.696925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.956 [2024-11-27 17:23:46.697054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.697195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.697557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.697837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.697995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.698135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.698395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.698655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.698822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.698958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.699254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.699538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.699802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.699967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.700111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.700376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.700684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.700825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.700964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.701232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.701536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.701807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.701958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.702082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.702314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.702627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.702734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.702867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.703198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.703523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.703802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.703967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.704099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.704266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.704293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.957 qpair failed and we were unable to recover it. 00:30:49.957 [2024-11-27 17:23:46.704444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.957 [2024-11-27 17:23:46.704553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.704579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.704720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.704828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.704854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.704959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.705256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.705509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.705761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.705890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.706025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.706299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.706531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.706812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.706954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.707069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.707355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.707643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.707878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.707998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.708134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.708430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.708721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.708865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.708969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.709269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.709565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.709800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.709921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.710016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.710300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.710568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.710756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.710905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.711063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.711087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.711230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.711366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.711392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.958 qpair failed and we were unable to recover it. 00:30:49.958 [2024-11-27 17:23:46.711546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.958 [2024-11-27 17:23:46.711641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.711667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.711785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.711907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.711932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.712054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.712351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.712596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.712855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.712995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.713129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.713419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.713662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.713843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.713954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.714279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.714577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.714799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.714944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.715077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.715318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.715663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.715794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.715911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.716238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.716496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.716822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.716945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.717069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.717329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.959 [2024-11-27 17:23:46.717642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.959 [2024-11-27 17:23:46.717786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.959 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.717970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.718281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.718597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.718860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.718981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.719099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.719430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.719697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.719843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.719995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.720326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.720614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.720859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.720980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.721151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.721464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.721794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.721907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.722049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.722384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.722662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.722812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.722933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.723205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.723400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.723665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.723849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.723993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.724331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.724608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.724800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.724919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.725038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.725063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.960 [2024-11-27 17:23:46.725165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.725254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.960 [2024-11-27 17:23:46.725277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.960 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.725401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.725537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.725565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.725680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.725828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.725852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.725963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.726274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.726564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.726857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.726991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.727121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.727429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.727663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.727832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.727952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.728283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.728598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.728756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.728922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.729268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.729564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.729739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.729870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.730160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.730450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.730741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.730911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.731067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.731367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.731675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.731816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.731976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.732315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.732658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.732786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.732930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.733032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.961 [2024-11-27 17:23:46.733056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.961 qpair failed and we were unable to recover it. 00:30:49.961 [2024-11-27 17:23:46.733186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.733435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.733738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.733852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.733947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.734156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.734425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.734647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.734786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.734918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.735205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.735451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.735767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.735900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.736080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.736392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.736695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.736879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.737026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.737288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.737502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.737783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.737941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.738083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.738381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.738623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.738883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.738986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.739124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.739329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.739610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.739796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.739938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.740072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.740099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.962 qpair failed and we were unable to recover it. 00:30:49.962 [2024-11-27 17:23:46.740213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.740334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.962 [2024-11-27 17:23:46.740358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.740469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.740636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.740661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.740774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.740906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.740933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.741097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.741406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.741716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.741854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.741964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.742171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.742504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.742762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.742899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.743047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.743328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.743612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.743732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.743925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.744168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.744442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.744710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.744877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.745041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.745343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.745621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.745874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.745994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.746114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.746398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.746687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.746872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.747013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.747127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.747151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.747268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.747408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.963 [2024-11-27 17:23:46.747435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.963 qpair failed and we were unable to recover it. 00:30:49.963 [2024-11-27 17:23:46.747547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.747683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.747709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.747855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.747955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.747978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.748070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.748337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.748626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.748758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.748907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.749250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.749492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.749784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.749911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.750017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.750323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.750556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.750737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.750870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.751134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.751429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.751741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.751901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.752087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.752385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.752688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.752846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.752968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.753326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.753580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.753773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.964 qpair failed and we were unable to recover it. 00:30:49.964 [2024-11-27 17:23:46.753922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.754079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.964 [2024-11-27 17:23:46.754121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.754248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.754569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.754853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.754969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.755081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.755356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.755681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.755831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.755977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.756286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.756530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.756780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.756947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.757117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.757412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.757697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.757871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.757973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.758218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.758497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.758786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.758940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.759079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.759423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.759674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.759831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.760002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.760230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.760439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.760718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.760861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.761040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.761367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.965 [2024-11-27 17:23:46.761631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.965 [2024-11-27 17:23:46.761783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.965 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.761931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.762277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.762567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.762972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.763142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.763453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.763732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.763905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.764078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.764421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.764672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.764821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.764956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.765217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.765481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.765755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.765909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.766024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.766312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.766662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.766838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.766957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.767239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.767537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.767869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.767990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.768101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.768482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.768793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.768935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.769085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.769233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.769261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.966 [2024-11-27 17:23:46.769407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.769538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.966 [2024-11-27 17:23:46.769564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.966 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.769662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.769750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.769776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.769947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.770250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.770521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.770788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.770972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.771085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.771386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.771647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.771810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.771955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.772233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.772454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.772770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.772967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.773124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.773457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.773789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.773940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.774086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.774348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.774641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.774906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.774991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.775104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.775396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.775654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.775829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.775952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.776202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.776470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.776723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.776896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.967 qpair failed and we were unable to recover it. 00:30:49.967 [2024-11-27 17:23:46.776997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.967 [2024-11-27 17:23:46.777127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.777263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.777540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.777846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.777967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.778099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.778369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.778685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.778804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.778923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.779210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.779474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.779732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.779910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.780063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.780330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.780667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.780829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.780943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.781171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.781459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.781741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.781860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.781994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.782303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.782546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.782790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.782920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.783066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.783396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.783680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.783795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.783915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.784006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.784031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.968 [2024-11-27 17:23:46.784155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.784271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.968 [2024-11-27 17:23:46.784295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.968 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.784383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.784482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.784506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.784648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.784740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.784764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.784908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.785209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.785450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.785738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.785895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.786016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.786284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.786490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.786719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.786875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.786988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.787312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.787557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.787860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.787989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.788210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.788520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.788816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.788986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.789135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.789473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.789771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.789919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.790072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.790371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.790636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.969 qpair failed and we were unable to recover it. 00:30:49.969 [2024-11-27 17:23:46.790906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.790994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.969 [2024-11-27 17:23:46.791035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.791134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.791459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.791711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.791868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.791971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.792249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.792469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.792735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.792865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.792985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.793267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.793604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.793892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.793992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.794176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.794472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.794769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.794892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.795011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.795345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.795573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.795813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.795951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.796114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.796386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.796714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.796864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.796995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.797306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.797639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.797811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.797968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.798071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.798099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.798220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.798318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.970 [2024-11-27 17:23:46.798342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.970 qpair failed and we were unable to recover it. 00:30:49.970 [2024-11-27 17:23:46.798443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.798539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.798564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.798716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.798841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.798865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.798987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.799287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.799590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.799795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.799966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.800253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.800568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.800852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.800980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.801128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.801375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.801635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.801787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.801939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.802193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.802489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.802751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.802876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.802984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.803233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.803503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.803818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.803969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.804099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.804400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.804632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.804764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.804915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.805173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.971 qpair failed and we were unable to recover it. 00:30:49.971 [2024-11-27 17:23:46.805426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.971 [2024-11-27 17:23:46.805574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.805699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.805820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.805844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.805986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.806274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.806536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.806816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.806989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.807111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.807386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.807653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.807821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.807924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.808251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.808505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.808782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.808946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.809055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.809349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.809623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.809813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.809990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.810266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.810542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.810851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.810996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.811118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.811435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.811718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.811863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.812012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.812160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.812187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.812317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.812421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.812448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.972 qpair failed and we were unable to recover it. 00:30:49.972 [2024-11-27 17:23:46.812590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.972 [2024-11-27 17:23:46.812711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.812736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.812885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.813196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.813493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.813812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.813957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.814105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.814409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.814722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.814911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.815050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.815370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.815702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.815870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.816001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.816307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.816564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.816890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.816992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.817132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.817380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.817643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.817808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.817903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.818187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.818474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.818761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.818875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.819030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.819314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.819537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.973 qpair failed and we were unable to recover it. 00:30:49.973 [2024-11-27 17:23:46.819825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.973 [2024-11-27 17:23:46.819963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.820097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.820422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.820713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.820845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.821004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.821370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.821611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.821838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.821954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.822073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.822386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.822703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.822893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.823020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.823234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.823558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.823744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.823915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.824234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.824495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.824798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.824972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.825085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.825414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.825676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.825801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.825935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.826196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.826481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.826715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.974 [2024-11-27 17:23:46.826868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.974 qpair failed and we were unable to recover it. 00:30:49.974 [2024-11-27 17:23:46.826980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.827305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.827563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.827827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.827987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.828159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.828422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.828709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.828824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.828947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.829291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.829538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.829780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.829953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.830060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.830362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.830668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.830809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.830899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.831248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.831498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.831795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.831924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.832016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.832344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.832648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.832878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.832975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.833142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.833470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.833755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.833907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.834027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.834125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.834149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.834288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.834401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.834427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.975 qpair failed and we were unable to recover it. 00:30:49.975 [2024-11-27 17:23:46.834530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.975 [2024-11-27 17:23:46.834680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.834705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.834830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.834957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.834980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.835144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.835459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.835732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.835846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.835964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.836279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.836574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.836814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.836982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.837105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.837375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.837624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.837767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.837892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.838201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.838449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.838731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.838915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.839062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.839353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.839650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.839816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.839951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.840284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.840549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.840850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.840954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.841083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.841374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.841673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.841789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.841960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.842247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.842504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.976 qpair failed and we were unable to recover it. 00:30:49.976 [2024-11-27 17:23:46.842831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.976 [2024-11-27 17:23:46.842957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.843154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.843447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.843706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.843861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.843965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.844246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.844507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.844812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.844946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.845105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.845411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.845682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.845852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.845957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.846281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.846561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.846824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.846971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.847086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.847348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.847625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.847757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.847900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.848195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.848477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.848710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.848852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.848976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.849289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.849580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.849903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.849995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.850156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.850416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.850754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.977 [2024-11-27 17:23:46.850903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.977 qpair failed and we were unable to recover it. 00:30:49.977 [2024-11-27 17:23:46.851059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.851338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.851663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.851801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.851920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.852214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.852496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.852712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.852857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.853013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.853280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.853585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.853849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.853986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.854159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.854496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.854789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.854926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.855057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.855346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.855624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.855833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.855999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.856127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.856413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.856725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.856872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.857049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.857311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.857590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.857760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.857903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.858217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.858541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.858881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.858999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.978 qpair failed and we were unable to recover it. 00:30:49.978 [2024-11-27 17:23:46.859115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.978 [2024-11-27 17:23:46.859205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.859231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.979 qpair failed and we were unable to recover it. 00:30:49.979 [2024-11-27 17:23:46.859341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.859509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.859565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.979 qpair failed and we were unable to recover it. 00:30:49.979 [2024-11-27 17:23:46.859681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.859829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.859853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.979 qpair failed and we were unable to recover it. 00:30:49.979 [2024-11-27 17:23:46.860002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.860152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.860187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.979 qpair failed and we were unable to recover it. 00:30:49.979 [2024-11-27 17:23:46.860357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.860508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.979 [2024-11-27 17:23:46.860544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:49.979 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.860669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.860785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.860907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.861130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.861387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.861729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.861922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.862085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.862245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.862278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.862445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.862676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.862715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.862871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.862993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.863029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.863201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.863378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.863413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.863569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.863696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.863728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.259 qpair failed and we were unable to recover it. 00:30:50.259 [2024-11-27 17:23:46.863903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.864074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.259 [2024-11-27 17:23:46.864102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.864237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.864412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.864437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.864537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.864659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.864684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.864855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.864979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.865143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.865453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.865673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.865863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.866027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.866313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.866576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.866733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.866864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.867198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.867430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.867754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.867888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.868033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.868329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.868645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.868792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.868941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.869235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.869538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.869853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.869999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.870138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.870410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.260 qpair failed and we were unable to recover it. 00:30:50.260 [2024-11-27 17:23:46.870714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.260 [2024-11-27 17:23:46.870805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.870831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.870958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.871207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.871577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.871816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.871995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.872120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.872422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.872705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.872832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.872933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.873242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.873498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.873798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.873975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.874118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.874391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.874656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.874789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.874974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.875222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.875504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.875800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.875971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.876074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.876322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.876598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.261 [2024-11-27 17:23:46.876748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.261 qpair failed and we were unable to recover it. 00:30:50.261 [2024-11-27 17:23:46.876848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.876940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.876987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.877110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.877411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.877699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.877837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.877961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.878224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.878516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.878775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.878902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.879048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.879341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.879648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.879807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.879974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.880252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.880503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.880814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.880954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.881101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.881405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.881716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.881837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.882023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.882351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.882693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.882817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.882985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.883144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.883186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.262 qpair failed and we were unable to recover it. 00:30:50.262 [2024-11-27 17:23:46.883277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.262 [2024-11-27 17:23:46.883412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.883444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.883595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.883697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.883722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.883843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.884201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.884749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.884866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.884989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.885276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.885506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.885810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.885987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.886133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.886460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.886709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.886861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.886980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.887327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.887663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.887838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.887958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.888193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.888470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.888719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.888868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.888982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.889202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.263 qpair failed and we were unable to recover it. 00:30:50.263 [2024-11-27 17:23:46.889466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.263 [2024-11-27 17:23:46.889608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.889746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.889880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.889909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.890042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.890345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.890626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.890825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.890958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.891273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.891577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.891824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.891965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.892080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.892365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.892669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.892817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.892937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.893274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.893558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.893869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.893984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.894085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.894323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.894645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.894771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.894914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.895196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.895405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.264 qpair failed and we were unable to recover it. 00:30:50.264 [2024-11-27 17:23:46.895733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.264 [2024-11-27 17:23:46.895878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.895902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.896002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.896343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.896654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.896779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.896923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.897227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.897480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.897796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.897964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.898058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.898318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.898611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.898760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.898881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.899122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.899437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.899758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.899876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.900024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.900133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.900159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.265 qpair failed and we were unable to recover it. 00:30:50.265 [2024-11-27 17:23:46.900264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.900397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.265 [2024-11-27 17:23:46.900423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.900599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.900723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.900747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.900935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.901163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.901435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.901713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.901906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.902001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.902351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.902667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.902788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.902918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.903210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.903563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.903720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.903898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.904256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.904594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.904819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.904968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.905092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.905343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.905622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.905775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.905944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.906230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.906521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.266 qpair failed and we were unable to recover it. 00:30:50.266 [2024-11-27 17:23:46.906813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.266 [2024-11-27 17:23:46.906949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.906975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.907126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.907383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.907655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.907793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.907925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.908213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.908455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.908669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.908853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.908980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.909270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.909608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.909758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.909901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.910182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.910482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.910800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.910962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.911125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.911400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.911711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.911845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.911996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.912258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.912539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.912719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.912894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.913154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.267 [2024-11-27 17:23:46.913420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.267 [2024-11-27 17:23:46.913582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.267 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.913721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.913843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.913867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.913964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.914225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.914532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.914840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.914962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.915126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.915440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.915762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.915945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.916086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.916367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.916706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.916843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.916934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.917260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.917507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.917817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.917959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.918055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.918333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.918645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.918760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.918889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.919143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.919373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.919653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.268 [2024-11-27 17:23:46.919813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.268 qpair failed and we were unable to recover it. 00:30:50.268 [2024-11-27 17:23:46.919954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.920264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.920506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.920774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.920936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.921100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.921411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.921674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.921817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.921947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.922251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.922579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.922896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.922995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.923115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.923342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.923633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.923867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.923983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.924099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.924348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.924638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.924781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.924935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.925151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.925392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.269 qpair failed and we were unable to recover it. 00:30:50.269 [2024-11-27 17:23:46.925634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.269 [2024-11-27 17:23:46.925796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.925956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.926251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.926480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.926817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.926975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.927116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.927397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.927672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.927829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.927941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.928233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.928501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.928790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.928940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.929059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.929346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.929615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.929744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.929929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.930276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.930571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.930705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.930860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.931207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.931522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.931799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.931970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.270 [2024-11-27 17:23:46.932056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.932137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.270 [2024-11-27 17:23:46.932162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.270 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.932273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.932393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.932418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.932585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.932687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.932715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.932854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.932988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.933119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.933355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.933646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.933808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.933955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.934202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.934497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.934812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.934980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.935131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.935424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.935748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.935904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.936044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.936354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.936720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.936868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.936989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.937108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.937134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.937305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.937463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.271 [2024-11-27 17:23:46.937489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.271 qpair failed and we were unable to recover it. 00:30:50.271 [2024-11-27 17:23:46.937619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.937729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.937763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.937920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.938278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.938520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.938724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.938879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.939196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.939447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.939763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.939918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.940035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.940358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.940633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.940817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.940957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.941227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.941498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.941784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.941917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.942067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.942358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.942668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.942802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.942972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.943251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.943547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.272 qpair failed and we were unable to recover it. 00:30:50.272 [2024-11-27 17:23:46.943837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.272 [2024-11-27 17:23:46.943990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.944116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.944316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.944564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.944812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.944953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.945111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.945400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.945638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.945778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.945889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.946173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.946469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.946717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.946860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.946978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.947222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.947535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.947835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.947971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.948083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.948361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.948644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.948784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.948942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.949270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.949506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.949730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.949879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.273 qpair failed and we were unable to recover it. 00:30:50.273 [2024-11-27 17:23:46.950006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.273 [2024-11-27 17:23:46.950099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.950250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.950507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.950775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.950925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.951087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.951359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.951588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.951826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.951950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.952095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.952431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.952715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.952902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.953037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.953303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.953596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.953774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.953916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.954162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.954457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.954698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.954828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.954959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.955188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.955456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.955795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.955956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.274 qpair failed and we were unable to recover it. 00:30:50.274 [2024-11-27 17:23:46.956126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.274 [2024-11-27 17:23:46.956245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.956269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.956371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.956511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.956544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.956696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.956787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.956818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.956916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.957155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.957356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.957667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.957817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.957917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.958160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.958467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.958741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.958899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.959038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.959273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.959549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.959826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.959967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.960052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.960280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.960590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.960855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.960981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.961151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.961438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.961747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.961858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.275 [2024-11-27 17:23:46.961967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.962075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.275 [2024-11-27 17:23:46.962103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.275 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.962233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.962559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.962777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.962948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.963036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.963304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.963509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.963812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.963992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.964138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.964430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.964683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.964857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.965006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.965218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.965564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.965838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.965985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.966100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.966387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.966699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.966817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.966962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.967215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.967567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.967834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.967999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.276 [2024-11-27 17:23:46.968135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.968250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.276 [2024-11-27 17:23:46.968283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.276 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.968423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.968509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.968547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.968679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.968807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.968831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.968948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.969273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.969567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.969741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.969889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.970216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.970457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.970742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.970881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.971052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.971320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.971606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.971852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.971979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.972152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.972442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.972688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.972820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.972969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.973114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.973155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.277 qpair failed and we were unable to recover it. 00:30:50.277 [2024-11-27 17:23:46.973284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.277 [2024-11-27 17:23:46.973378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.973404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.973540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.973664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.973688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.973780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.973868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.973892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.974019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.974317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.974644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.974825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.974934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.975171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.975454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.975730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.975894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.976047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.976290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.976544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.976786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.976930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.977050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.977424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.977787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.977899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.977999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.978397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.978693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.978803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.978919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.979097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.979124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.979273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.979387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.278 [2024-11-27 17:23:46.979413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.278 qpair failed and we were unable to recover it. 00:30:50.278 [2024-11-27 17:23:46.979536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.979654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.979679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.979774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.979872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.979905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.980028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.980317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.980553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.980828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.980975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.981143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.981386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.981693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.981822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.981949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.982215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.982512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.982807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.982954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.983101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.983393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.983668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.983790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.983915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.984201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.984506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.279 qpair failed and we were unable to recover it. 00:30:50.279 [2024-11-27 17:23:46.984774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.279 [2024-11-27 17:23:46.984926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.984968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.985154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.985466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.985721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.985881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.986013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.986294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.986620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.986776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.986878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.987168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.987480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.987803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.987943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.988054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.988293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.988574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.988713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.988883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.989185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.989445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.989715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.989877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.990019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.990320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.990588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.990760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.280 [2024-11-27 17:23:46.990881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.991068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.280 [2024-11-27 17:23:46.991092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.280 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.991210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.991484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.991803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.991963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.992147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.992421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.992814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.992969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.993073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.993353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.993626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.993890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.993980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.994099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.994466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.994731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.994908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.995027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.995263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.995575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.995740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.995904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.996170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.996419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.996731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.996885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.996997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.997128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.281 [2024-11-27 17:23:46.997164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.281 qpair failed and we were unable to recover it. 00:30:50.281 [2024-11-27 17:23:46.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.997508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.997558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.997662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.997760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.997785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.997908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.998174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.998442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.998687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.998814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.998966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.999247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.999588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:46.999743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:46.999901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.000153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.000443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.000775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.000911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.001057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.001291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.001533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.001855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.001983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.002123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.002424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.002762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.002880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.002996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.003121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.003146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.282 [2024-11-27 17:23:47.003273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.003413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.282 [2024-11-27 17:23:47.003440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.282 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.003614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.003737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.003761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.003910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.004192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.004455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.004711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.004853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.004979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.005294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.005613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.005850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.005975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.006132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.006398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.006702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.006829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.007008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.007349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.007627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.007803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.007967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.008243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.283 [2024-11-27 17:23:47.008539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.283 [2024-11-27 17:23:47.008666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.283 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.008832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.008932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.008958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.009061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.009316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.009678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.009845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.009951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.010233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.010514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.010792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.010946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.011078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.011334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.011654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.011802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.011953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.012188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.012427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.012765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.012919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.013023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.013312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.013573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.013766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.013889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.014156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.014498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.014770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.014913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.284 qpair failed and we were unable to recover it. 00:30:50.284 [2024-11-27 17:23:47.015063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.284 [2024-11-27 17:23:47.015206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.015234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.015374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.015498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.015522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.015659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.015786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.015820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.015977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.016265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.016473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.016740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.016936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.017075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.017367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.017643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.017774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.017942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.018204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.018468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.018768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.018967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.019094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.019369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.019677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.019859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.019949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.020227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.020561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.285 qpair failed and we were unable to recover it. 00:30:50.285 [2024-11-27 17:23:47.020802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.285 [2024-11-27 17:23:47.020921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.020945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.021064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.021357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.021609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.021851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.021973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.022099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.022442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.022683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.022804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.022935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.023266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.023540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.023864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.023989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.024184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.024465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.024777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.024957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.025046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.025350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.025703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.025870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.025983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.026269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.026574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.026851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.026990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.027017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.286 qpair failed and we were unable to recover it. 00:30:50.286 [2024-11-27 17:23:47.027189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.286 [2024-11-27 17:23:47.027348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.027374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.027472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.027585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.027619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.027771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.027874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.027898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.028039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.028326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.028681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.028874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.028989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.029354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.029623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.029749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.029919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.030157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.030431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.030742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.030858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.031021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.031331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.031623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.031789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.031897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.032203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.032469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.032786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.032933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.033044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.033178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.033203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.287 qpair failed and we were unable to recover it. 00:30:50.287 [2024-11-27 17:23:47.033361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.287 [2024-11-27 17:23:47.033453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.033483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.033644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.033737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.033763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.033862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.033953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.033977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.034113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.034416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.034699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.034856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.035000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.035298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.035541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.035720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.035840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.038714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.038760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.038891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.039213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.039543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.039741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.039888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.040147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.040517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.040810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.040981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.041096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.041379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.041719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.041840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.041990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.042255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.288 qpair failed and we were unable to recover it. 00:30:50.288 [2024-11-27 17:23:47.042582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.288 [2024-11-27 17:23:47.042725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.042840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.042956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.042981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.043096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.043345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.043654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.043890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.043990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.044118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.044405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.044704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.044831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.044955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.045224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.045514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.045826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.045974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.046144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.046355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.046685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.046851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.047024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.047149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.047173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.289 qpair failed and we were unable to recover it. 00:30:50.289 [2024-11-27 17:23:47.047350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.047455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.289 [2024-11-27 17:23:47.047482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.047665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.047826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.047854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.048045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.048343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.048653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.048892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.048984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.049138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.049363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.049709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.049859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.049982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.050263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.050581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.050872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.050999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.051170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.051532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.051780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.051920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.052049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.052355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.052601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.052748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.052853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.053014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.053040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.290 qpair failed and we were unable to recover it. 00:30:50.290 [2024-11-27 17:23:47.053186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.053313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.290 [2024-11-27 17:23:47.053337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.053461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.053597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.053641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.053800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.053929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.053955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.054077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.054351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.054637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.054811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.054957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.055227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.055567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.055731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.055882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.056133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.056442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.056831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.056982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.057105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.057398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.057678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.057834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.058030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.058357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.058657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.058777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.058924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.059300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.059630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.059755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.291 qpair failed and we were unable to recover it. 00:30:50.291 [2024-11-27 17:23:47.059913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.291 [2024-11-27 17:23:47.060066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.060223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.060495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.060741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.060873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.061028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.061304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.061507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.061849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.061979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.062146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.062352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.062642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.062772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.062895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.063232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.063456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.063795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.063943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.064113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.064414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.064697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.064827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.065046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.065285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.065577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.065757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.292 [2024-11-27 17:23:47.065880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.066009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.292 [2024-11-27 17:23:47.066037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.292 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.066147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.066470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.066720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.066881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.066984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.067263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.067574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.067760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.067897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.068166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.068528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.068760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.068905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.069053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.069315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.069580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.069876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.069998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.070140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.070469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.070719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.070893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.071034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.071327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.071566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.071853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.071992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.293 qpair failed and we were unable to recover it. 00:30:50.293 [2024-11-27 17:23:47.072170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.293 [2024-11-27 17:23:47.072302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.072327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.072450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.072600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.072626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.072746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.072880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.072907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.073013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.073271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.073598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.073898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.073992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.074180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.074388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.074668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.074904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.074990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.075141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.075384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.075645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.075812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.075975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.076271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.076599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.076856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.076995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.077161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.077456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.077677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.077800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.077942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.078042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.078069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.078192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.078322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.078347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.294 qpair failed and we were unable to recover it. 00:30:50.294 [2024-11-27 17:23:47.078504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.294 [2024-11-27 17:23:47.078671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.078697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.078793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.078932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.078959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.079178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.079471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.079783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.079952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.080093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.080399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.080649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.080809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.080946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.081221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.081506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.081785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.081936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.082065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.082357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.082762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.082884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.083011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.083293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.083586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.083897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.083994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.084022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.295 qpair failed and we were unable to recover it. 00:30:50.295 [2024-11-27 17:23:47.084134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.295 [2024-11-27 17:23:47.084271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.084298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.084413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.084540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.084566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.084748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.084853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.084882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.085029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.085467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.085822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.085944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.086097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.086364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.086689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.086836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.086950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.087227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.087461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.087754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.087893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.088034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.088318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.088591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.088773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.088901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.089197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.089522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.089815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.089940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.090066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.090306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.090609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.296 qpair failed and we were unable to recover it. 00:30:50.296 [2024-11-27 17:23:47.090840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.296 [2024-11-27 17:23:47.090986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.091184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.091549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.091835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.091984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.092133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.092370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.092696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.092826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.093035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.093296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.093585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.093750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.093889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.094164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.094396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.094717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.094885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.095035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.095245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.095458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.095749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.095877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.095990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.096230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.096558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.096836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.096978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.097105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.097271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.297 [2024-11-27 17:23:47.097298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.297 qpair failed and we were unable to recover it. 00:30:50.297 [2024-11-27 17:23:47.097437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.097597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.097622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.097725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.097842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.097867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.097958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.098277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.098486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.098756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.098910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.099083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.099344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.099621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.099783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.099931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.100158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.100397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.100692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.100845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.100965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.101184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.101392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.101638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.101851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.101985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.102160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.102456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.102689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.102859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.102992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.103108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.298 [2024-11-27 17:23:47.103133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.298 qpair failed and we were unable to recover it. 00:30:50.298 [2024-11-27 17:23:47.103223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.103442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.103747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.103895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.104041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.104299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.104572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.104855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.104979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.105135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.105414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.105674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.105796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.105893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.106162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.106453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.106780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.106967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.107085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.107346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.107602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.107844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.107963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.108045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.108266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.108504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.299 [2024-11-27 17:23:47.108727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.299 [2024-11-27 17:23:47.108842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.299 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.108931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.109220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.109504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.109724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.109867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.109985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.110276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.110537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.110823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.110974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.111091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.111398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.111708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.111848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.111971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.112232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.112533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.112760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.112896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.113026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.113334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.113638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.113771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.113925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.114189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.114427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.114680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.114853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.114988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.115113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.115137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.115280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.115377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.115405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.300 qpair failed and we were unable to recover it. 00:30:50.300 [2024-11-27 17:23:47.115542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.300 [2024-11-27 17:23:47.115686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.115711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.115804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.115958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.115983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.116154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.116395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.116651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.116808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.116969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.117277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.117623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.117830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.117953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.118048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.118358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.118665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.118810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.118961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.119245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.119537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.119714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.119883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.120184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.120495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.120811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.120986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.121014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.121156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.121279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.121303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.301 qpair failed and we were unable to recover it. 00:30:50.301 [2024-11-27 17:23:47.121415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.301 [2024-11-27 17:23:47.121563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.121589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.121710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.121823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.121851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.122056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.122378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.122638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.122862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.122982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.123156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.123429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.123689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.123836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.123981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.124233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.124559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.124816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.124984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.125098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.125369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.125656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.125848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.125951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.126206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.126457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.126737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.126870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.126985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.127257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.127521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.127769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.127908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.128060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.128179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.128204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.302 qpair failed and we were unable to recover it. 00:30:50.302 [2024-11-27 17:23:47.128352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.302 [2024-11-27 17:23:47.128454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.128482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.128620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.128712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.128737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.128846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.128996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.129145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.129417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.129685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.129823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.129954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.130215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.130453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.130732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.130868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.131042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.131288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.131537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.131813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.131932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.132101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.132420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.132708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.132858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.132951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.133188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.133431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.133683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.133872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.134011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.134258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.134516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.303 qpair failed and we were unable to recover it. 00:30:50.303 [2024-11-27 17:23:47.134805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.303 [2024-11-27 17:23:47.134928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.134952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.135099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.135335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.135560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.135718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.135886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.136178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.136430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.136731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.136874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.137031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.137359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.137714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.137880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.137986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.138287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.138568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.138714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.138837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.139148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.139416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.139713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.139878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.140002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.140277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.140510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.140837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.140951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.304 [2024-11-27 17:23:47.141075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.141197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.304 [2024-11-27 17:23:47.141221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.304 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.141318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.141561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.141868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.141987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.142100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.142425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.142690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.142859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.143021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.143303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.143598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.143777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.143907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.144245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.144467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.144730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.144918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.145055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.145370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.145687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.145811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.145935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.146197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.146442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.146713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.146902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.147022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.147318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.147582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.147850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.147971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.148066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.148213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.148238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.148360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.148512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.305 [2024-11-27 17:23:47.148553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.305 qpair failed and we were unable to recover it. 00:30:50.305 [2024-11-27 17:23:47.148676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.148795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.148820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.149001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.149239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.149494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.149746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.149936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.150099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.150412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.150637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.150807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.150925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.151275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.151538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.151819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.151976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.152144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.152393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.152675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.152868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.153019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.153305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.153640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.153786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.153905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.154198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.154465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.154749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.306 [2024-11-27 17:23:47.154910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.306 qpair failed and we were unable to recover it. 00:30:50.306 [2024-11-27 17:23:47.155031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.155321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.155579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.155839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.155977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.156151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.156459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.156708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.156887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.157012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.157258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.157582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.157747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.157883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.158224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.158464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.158736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.158856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.159029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.159339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.159688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.159804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.159936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.160180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.160415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.160661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.160834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.160976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.161301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.161539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.161837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.161979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.162007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.307 qpair failed and we were unable to recover it. 00:30:50.307 [2024-11-27 17:23:47.162110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.162212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.307 [2024-11-27 17:23:47.162241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.162389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.162487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.162512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.162703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.162816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.162846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.163000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.163263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.163492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.163785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.163953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.164095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.164441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.164744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.164924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.165126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.165420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.165721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.165859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.165973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.166305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.166572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.166784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.166931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.167068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.167340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.167591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.167718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.167843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.168175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.168447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.168660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.168892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.168994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.169163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.169416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.169770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.169923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.308 [2024-11-27 17:23:47.170073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.170190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.308 [2024-11-27 17:23:47.170216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.308 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.170394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.170523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.170563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.170689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.170782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.170807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.170954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.171253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.171513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.171837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.171974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.172125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.172401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.172670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.172818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.172942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.173233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.173539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.173836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.173987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.174120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.174433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.174664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.174823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.174923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.175248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.175516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.175744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.175905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.176138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.176393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.176647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.176813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.176938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.177277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.177577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.309 qpair failed and we were unable to recover it. 00:30:50.309 [2024-11-27 17:23:47.177852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.309 [2024-11-27 17:23:47.177968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.177993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.178120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.178358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.178656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.178760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.178907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.179199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.179501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.179660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.179802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.180193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.180447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.180794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.180965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.181101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.181361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.181701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.181828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.181991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.182358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.182640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.182795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.182931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.183258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.183562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.183868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.183996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.184110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.184401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.184753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.184939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.185091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.185223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.185249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.310 qpair failed and we were unable to recover it. 00:30:50.310 [2024-11-27 17:23:47.185344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.310 [2024-11-27 17:23:47.185486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.185516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.185643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.185775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.185802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.185946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.186253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.186469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.186748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.311 [2024-11-27 17:23:47.186870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.311 qpair failed and we were unable to recover it. 00:30:50.311 [2024-11-27 17:23:47.186991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.187286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.187573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.187758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.187895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.188568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.188742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.188933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.189213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.189555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.189727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.189891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.190195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.190544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.190831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.190960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.191107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.191384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.191702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.191854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.191985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.192276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.192508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.591 qpair failed and we were unable to recover it. 00:30:50.591 [2024-11-27 17:23:47.192781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.591 [2024-11-27 17:23:47.192919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.192945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.193062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.193321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.193667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.193824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.193996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.194315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.194623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.194750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.194893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.195212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.195452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.195731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.195874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.195997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.196288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.196577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.196873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.196975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.197103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.197412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.197709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.197870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.197968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.198276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.198592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.198763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.198884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.199163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.199432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.199753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.199897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.200064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.200346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.200573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.200736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.200910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.201177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.201399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.201690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.201799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.201943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.202200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.202475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.592 [2024-11-27 17:23:47.202726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.592 [2024-11-27 17:23:47.202860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.592 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.203025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.203300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.203573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.203860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.203996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.204111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.204319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.204598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.204848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.204986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.205098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.205437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.205706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.205860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.206008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.206308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.206537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.206819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.206969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.207099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.207372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.207700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.207854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.207979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.208239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.208466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.208772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.208947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.209067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.209322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.209677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.209821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.209941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.210208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.210453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.210697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.210883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.211012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.211332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.211562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.211722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.211872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.212137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.212384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.593 [2024-11-27 17:23:47.212655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.593 [2024-11-27 17:23:47.212783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.593 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.212945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.213221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.213445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.213740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.213922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.214032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.214338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.214670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.214831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.214970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.215212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.215495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.215878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.215995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.216088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.216296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.216541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.216807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.216976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.217068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.217383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.217608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.217879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.217990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.218115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.218349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.218671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.218839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.218984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.219267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.219523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.219805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.219950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.220093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.220411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.220665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.220806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.220932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.221207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.221440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.221733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.221899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.222074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.222195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.222221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.222344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.222465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.222490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.594 qpair failed and we were unable to recover it. 00:30:50.594 [2024-11-27 17:23:47.222594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.594 [2024-11-27 17:23:47.222713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.222738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.222886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.223162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.223397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.223652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.223822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.223917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.224207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.224468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.224758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.224907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.225011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.225337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.225607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.225763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.225904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.226169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.226447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.226653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.226768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.226912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.227187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.227435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.227719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.227921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.228078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.228405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.228708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.228867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.228984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.229212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.229490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.229784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.229895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.230013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.230316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.230623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.230772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.230934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.231054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.595 [2024-11-27 17:23:47.231078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.595 qpair failed and we were unable to recover it. 00:30:50.595 [2024-11-27 17:23:47.231190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.231515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.231790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.231898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.231989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.232203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.232475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.232730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.232915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.233069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.233301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.233560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.233803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.233950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.234073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.234365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.234602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.234759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.234880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.235127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.235420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.235651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.235807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.235941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.236238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.236509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.236852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.236996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.237141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.237436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.237736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.237901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.238021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.238275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.238541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.238798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.238944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.239041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.239271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.239536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.239810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.239946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.240070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.240331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.240563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.596 qpair failed and we were unable to recover it. 00:30:50.596 [2024-11-27 17:23:47.240858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.596 [2024-11-27 17:23:47.240995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.241153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.241454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.241728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.241918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.242078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.242332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.242622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.242757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.242882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.243255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.243561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.243786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.243953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.244279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.244557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.244837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.244981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.245127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.245443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.245708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.245847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.245945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.246303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.246589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.246767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.246960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.247197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.247515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.247682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.247827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.248205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.248512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.248785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.248945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.249046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.249361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.249637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.249836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.249978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.250111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.250443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.250696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.250857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.250969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.251244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.597 qpair failed and we were unable to recover it. 00:30:50.597 [2024-11-27 17:23:47.251548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.597 [2024-11-27 17:23:47.251688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.251810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.251928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.251954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.252129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.252420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.252731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.252885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.253018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.253336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.253624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.253770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.253896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.254213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.254566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.254850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.254991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.255119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.255393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.255625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.255768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.255868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.256154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.256410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.256676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.256802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.256919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.257196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.257511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.257852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.257963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.258062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.258407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.258710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.258847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.258939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.259232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.259567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.259711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.259870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.260200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.260488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.598 qpair failed and we were unable to recover it. 00:30:50.598 [2024-11-27 17:23:47.260768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.598 [2024-11-27 17:23:47.260917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.261038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.261332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.261683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.261804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.261974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.262277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.262576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.262851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.262994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.263131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.263408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.263770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.263908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.264034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.264283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.264553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.264828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.264996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.265133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.265431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.265725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.265885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.266040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.266412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.266718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.266892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.267030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.267304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.267513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.267793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.267945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.268114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.268415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.268678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.268870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.268967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.269295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.269518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.269804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.269924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.270048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.270358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.270653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.270764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.270896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.271018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.271043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.599 qpair failed and we were unable to recover it. 00:30:50.599 [2024-11-27 17:23:47.271159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.271322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.599 [2024-11-27 17:23:47.271350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.271482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.271655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.271685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.271839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.271962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.271988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.272105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.272373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.272683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.272798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.272925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.273147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.273417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.273666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.273811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.273960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.274182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.274423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.274750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.274886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.274996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.275260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.275496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.275773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.275898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.275990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.276284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.276576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.276722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.276878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.277192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.277466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.277759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.277951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.278054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.278294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.278570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.278814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.278958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.279052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.279281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.279614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.279844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.279991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.280100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.280388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.280648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.280793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.600 [2024-11-27 17:23:47.280911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.281029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.600 [2024-11-27 17:23:47.281054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.600 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.281155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.281468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.281721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.281880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.281999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.282234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.282516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.282815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.282935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.283055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.283307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.283578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.283820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.283927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.284021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.284258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.284559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.284814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.284965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.285063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.285353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.285567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.285835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.285985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.286102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.286332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.286598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.286839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.286982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.287103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.287375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.287677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.287820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.287956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.288243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.288521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.288837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.288978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.289129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.289382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.289610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.289859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.289983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.290008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.290108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.290251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.290276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.290398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.290548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.601 [2024-11-27 17:23:47.290595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.601 qpair failed and we were unable to recover it. 00:30:50.601 [2024-11-27 17:23:47.290689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.290785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.290810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.290960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.291178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.291440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.291691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.291844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.292007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.292276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.292518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.292762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.292909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.293012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.293283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.293488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.293737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.293864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.293955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.294216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.294458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.294691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.294842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.294964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.295209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.295472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.295761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.295886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.295979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.296218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.296472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.296747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.296948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.297062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.297347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.297655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.297814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.297921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.298206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.298446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.298744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.298920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.602 qpair failed and we were unable to recover it. 00:30:50.602 [2024-11-27 17:23:47.299026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.299127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.602 [2024-11-27 17:23:47.299151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.299281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.299582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.299859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.299987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.300143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.300464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.300750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.300878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.301031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.301282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.301539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.301727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.301896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.302179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.302400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.302691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.302818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.302968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.303165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.303192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.303323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.303418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.303442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.304539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.304707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.304733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.304874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.305211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.305448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.305742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.305879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.306016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.306111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.306136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.306257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.306964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.306993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.307158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.307453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.307698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.307875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.307996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.308244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.308550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.308823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.308936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.309047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.309317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.309569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.309819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.309968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.310091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.310368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.603 qpair failed and we were unable to recover it. 00:30:50.603 [2024-11-27 17:23:47.310713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.603 [2024-11-27 17:23:47.310872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.310978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.311208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.311518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.311769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.311960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.312110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.312352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.312615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.312762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.312881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.313160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.313431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.313687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.313834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.313959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.314209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.314453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.314670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.314842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.314968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.315178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.315470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.315861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.315993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.316181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.316510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.316885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.316985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.317147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.317417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.317763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.317944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.318124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.318367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.318657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.318888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.318986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.319212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.319466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.319754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.319871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.319994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.320259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.320510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.604 qpair failed and we were unable to recover it. 00:30:50.604 [2024-11-27 17:23:47.320788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.604 [2024-11-27 17:23:47.320950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.321083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.321384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.321692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.321836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.321979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.322283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.322630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.322808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.322954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.323264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.323507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.323757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.323873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.324005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.324288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.324586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.324892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.324991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.325133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.325426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.325716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.325883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.326026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.326294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.326536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.326814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.326974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.327073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.327364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.327680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.327800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.327965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.328227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.328468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.328675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.328830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.328962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.329203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.329471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.329771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.329962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.330172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.330431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.605 [2024-11-27 17:23:47.330691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.605 [2024-11-27 17:23:47.330807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.605 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.330916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.331203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.331470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.331776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.331941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.332105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.332445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.332713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.332863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.333015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.333326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.333634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.333749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.333887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.334150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.334459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.334699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.334831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.334966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.335220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.335544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.335835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.335981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.336071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.336309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.336621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.336766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.336915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.337180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.337448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.337724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.337842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.337985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.338297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.338567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.338803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.338916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.339016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.339324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.339595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.606 [2024-11-27 17:23:47.339720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.606 qpair failed and we were unable to recover it. 00:30:50.606 [2024-11-27 17:23:47.339850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.339974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.340172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.340444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.340764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.340914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.341084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.341431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.341723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.341851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.341986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.342243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.342551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.342860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.342986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.343135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.343457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.343689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.343809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.343986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.344219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.344500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.344816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.344950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.345120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.345351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.345616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.345788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.345897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.346196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.346455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.346707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.346844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.346996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.347235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.347505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.347769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.347971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.348142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.348451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.348706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.348881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.348981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.349303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.349513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.349845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.607 [2024-11-27 17:23:47.349977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.607 qpair failed and we were unable to recover it. 00:30:50.607 [2024-11-27 17:23:47.350090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.350323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.350707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.350848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.350941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.351177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.351478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.351795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.351945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.352065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.352296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.352597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.352842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.352978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.353138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.353443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.353733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.353870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.353998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.354273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.354575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.354866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.354986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.355109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.355422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.355735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.355868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.356014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.356345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.356649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.356817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.356967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.357271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.357580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.357878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.357994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.358166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.358496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.358709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.358850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.358938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.359196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.359486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.359738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.359873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.360005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.360162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.608 [2024-11-27 17:23:47.360194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.608 qpair failed and we were unable to recover it. 00:30:50.608 [2024-11-27 17:23:47.360331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.360452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.360478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.360659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.360759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.360786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.360967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.361209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.361476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.361794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.361983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.362075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.362307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.362570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.362845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.362969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.363076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.363405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.363709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.363853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.363968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.364261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.364568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.364780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.364921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.365018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.365300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.365574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.365825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.365987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.366137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.366434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.366731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.366892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.367027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.367278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.367629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.367868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.367981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.368105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.368438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.368715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.368834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.369025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.369123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.609 [2024-11-27 17:23:47.369149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.609 qpair failed and we were unable to recover it. 00:30:50.609 [2024-11-27 17:23:47.369275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.369373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.369413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.369584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.369711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.369735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.369860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.370201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.370531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.370701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.370870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.371195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.371497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.371773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.371939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.372085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.372314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.372593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.372832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.372991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.373100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.373351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.373666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.373838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.373972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.374276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.374549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.374760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.374875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.374970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.375221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.375482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.375719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.375839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.375987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.376244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.376498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.376809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.376921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.377018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.377292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.377596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.377863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.377983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.378130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.378427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.378728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.378844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.378938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.379056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.610 [2024-11-27 17:23:47.379104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.610 qpair failed and we were unable to recover it. 00:30:50.610 [2024-11-27 17:23:47.379266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.379580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.379799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.379990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.380147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.380461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.380706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.380829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.380958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.381204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.381495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.381836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.381966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.382138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.382402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.382737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.382905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.383061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.383347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.383617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.383847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.383966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.384077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.384357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.384689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.384838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.384953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.385216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.385517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.385796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.385961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.386090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.386382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.386708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.386839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.386970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.387248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.387564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.387748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.387890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.388149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.388465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.388770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.388966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.389090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.389202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.389226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.611 [2024-11-27 17:23:47.389350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.389496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.611 [2024-11-27 17:23:47.389547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.611 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.389688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.389771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.389795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.389920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.390178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.390494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.390768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.390889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.391110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.391393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.391682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.391825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.391957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.392285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.392569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.392825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.392938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.393063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.393378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.393635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.393776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.393898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.394226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.394521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.394777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.394965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.395082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.395326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.395634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.395888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.396131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.396430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.396754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.396866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.397008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.397236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.397556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.397762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.397917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.398033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.398325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.398663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.398812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.398902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.399183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.399453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.612 [2024-11-27 17:23:47.399570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.612 qpair failed and we were unable to recover it. 00:30:50.612 [2024-11-27 17:23:47.399688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.399851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.399877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.400017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.400235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.400540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.400810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.400952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.401050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.401326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.401625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.401749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.401887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.402184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.402430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.402648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.402789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.402911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.403203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.403471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.403758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.403920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.404038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.404332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.404601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.404872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.404996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.405143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.405460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.405706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.405825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.405926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.406244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.406534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.406854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.406974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.407148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.407408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.407689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.407847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.408010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.408281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.408565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.613 [2024-11-27 17:23:47.408704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.613 qpair failed and we were unable to recover it. 00:30:50.613 [2024-11-27 17:23:47.408817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.408938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.408963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.409081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.409301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.409606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.409850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.409998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.410111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.410332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.410631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.410752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.410894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.411474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.411796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.411989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.412130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.412369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.412635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.412784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.412932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.413228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.413545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.413801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.413997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.414115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.414390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.414713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.414876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.414971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.415209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.415487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.415784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.415941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.416087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.416320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.416654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.416800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.416943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.417278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.417656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.417805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.417929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.418183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.418391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.418635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.614 [2024-11-27 17:23:47.418752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.614 qpair failed and we were unable to recover it. 00:30:50.614 [2024-11-27 17:23:47.418867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.419159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.419441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.419731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.419905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.420013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.420219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.420742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.420864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.421014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.421305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.421550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.421767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.421963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.422074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.422370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.422869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.423008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.423253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.423461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.423705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.423845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.423953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.424271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.424596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.424751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.424879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.425128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.425418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.425751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.425870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.425962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.426221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.426559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.426839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.426998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.427125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.427445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.427774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.427966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.428064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.428363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.615 qpair failed and we were unable to recover it. 00:30:50.615 [2024-11-27 17:23:47.428622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.615 [2024-11-27 17:23:47.428815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.428989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.429304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.429578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.429734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.429899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.430202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.430518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.430814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.430988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.431131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.431413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.431749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.431927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.432041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.432326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.432642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.432807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.432957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.433166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.433473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.433736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.433878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.434063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.434359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.434665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.434806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.434960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.435217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.435481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.435746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.435912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.436027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.436295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.436618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.436770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.436909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.437225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.437469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.437737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.437866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.438014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.438280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.438582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.438842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.438951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.439072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.439170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.616 [2024-11-27 17:23:47.439197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.616 qpair failed and we were unable to recover it. 00:30:50.616 [2024-11-27 17:23:47.439332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.439471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.439498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.439657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.439751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.439776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.439939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.440249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.440550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.440843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.440971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.441071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.441354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.441713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.441874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.441980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.442331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.442650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.442798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.442975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.443246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.443538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.443812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.443962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.444119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.444363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.444654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.444818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.444959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.445256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.445588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.445792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.445956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.446305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.446548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.446817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.446987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.447160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.447500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.447774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.447881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.448004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.448669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.448810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.617 qpair failed and we were unable to recover it. 00:30:50.617 [2024-11-27 17:23:47.448969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.449059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.617 [2024-11-27 17:23:47.449085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.449181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.449288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.449336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.449509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.449630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.449655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.449806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.449983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.450140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.450476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.450753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.450895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.451047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.451344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.451671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.451965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.452207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.452510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.452701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.452840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.453153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.453467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.453763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.453932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.454052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.454297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.454637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.454758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.454899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.455174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.455478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.455808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.455930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.456049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.456333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.456588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.456799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.456971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.457126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.457477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.457747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.457882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.458031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.458372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.458697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.458878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.459262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.459495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.618 [2024-11-27 17:23:47.459693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.618 qpair failed and we were unable to recover it. 00:30:50.618 [2024-11-27 17:23:47.459868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.459982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.460148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.460381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.460648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.460828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.460998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.461258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.461551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.461789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.461927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.462020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.462268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.462567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.462826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.462994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.463108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.463360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.463691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.463835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.463955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.464278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.464574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.464853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.464984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.465091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.465375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.465635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.465866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.465991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.466080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.466281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.466552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.466813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.466970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.467091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.467384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.467717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.467857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.468021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.468308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.468647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.468762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.468884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.469187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.469467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.619 qpair failed and we were unable to recover it. 00:30:50.619 [2024-11-27 17:23:47.469800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.619 [2024-11-27 17:23:47.469909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.469933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.470083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.470336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.470572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.470803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.470916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.471013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.471291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.471577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.471807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.471917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.472069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.472393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.472707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.472911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.473026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.473299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.473512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.473721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.473891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.473986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.474231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.474473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.474739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.474873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.474959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.475207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.475487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.475915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.476004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.476301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.476599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.476838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.476975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.477117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.477371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.477651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.477832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.477983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.478078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.478103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.620 [2024-11-27 17:23:47.478225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.478361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.620 [2024-11-27 17:23:47.478386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.620 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.478512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.478667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.478691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.478808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.478953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.478977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.479093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.479352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.479658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.479794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.479883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.480203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.480417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.480701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.480838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.480984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.481280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.481530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.481778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.481884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.481980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.482244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.482449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.482763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.482897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.483017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.483322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.483589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.483793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.483906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.484051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.484351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.484617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.484867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.484985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.485134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.485390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.485652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.485770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.485924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.486176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.486368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.486642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.486794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.486914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.487153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.487394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.487620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.621 [2024-11-27 17:23:47.487767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.621 qpair failed and we were unable to recover it. 00:30:50.621 [2024-11-27 17:23:47.487887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.488144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.488377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.488665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.488784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.488910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.489180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.489444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.489671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.489796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.489910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.490141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.490372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.490697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.490814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.490963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.491233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.491470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.491712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.491860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.491976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.492281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.492522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.492834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.492993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.493114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.493391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.493677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.493807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.493909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.494173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.494416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.494663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.494872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.494989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.495109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.495363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.495651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.495798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.495913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.496153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.496391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.496644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.496753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.496900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.497019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.497043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.622 qpair failed and we were unable to recover it. 00:30:50.622 [2024-11-27 17:23:47.497162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.622 [2024-11-27 17:23:47.497289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.497313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.497427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.497546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.497571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.497668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.497790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.497814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.497936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.498184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.498451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.498711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.498830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.498949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.499156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.499392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.499631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.499896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.499994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.500113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.500376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.500664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.500808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.500900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.501170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.501423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.501707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.501829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.501923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.502179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.502415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.502674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.502793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.502912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.503145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.503381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.503639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.503809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.503911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.504178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.504438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.504659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.504769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.504884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.505132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.505373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.623 qpair failed and we were unable to recover it. 00:30:50.623 [2024-11-27 17:23:47.505634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.623 [2024-11-27 17:23:47.505828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.505929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.506175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.506412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.506682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.506878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.506998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.507123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.507337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.507581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.507823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.507942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.508030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.508277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.508504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.508818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.508963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.509063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.509362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.509616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.509811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.509967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.510046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.510289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.510554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.510825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.510980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.511122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.511379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.511629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.511882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.511997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.512115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.512374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.512661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.512805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.512927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.513191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.513451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.624 qpair failed and we were unable to recover it. 00:30:50.624 [2024-11-27 17:23:47.513747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.624 [2024-11-27 17:23:47.513864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.513889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.514005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.514252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.514505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.514757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.514885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.515046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.515264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.515538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.515768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.515938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.516027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.516287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.516588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.516851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.516986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.517137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.517383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.517659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.517808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.517960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.518210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.518454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.518716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.625 [2024-11-27 17:23:47.518832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.625 qpair failed and we were unable to recover it. 00:30:50.625 [2024-11-27 17:23:47.518927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.519160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.519408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.519682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.519851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.519995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.520314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.520639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.520789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.520960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.521304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.521657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.521826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.522002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.522364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.522646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.522864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.522992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.523016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.908 [2024-11-27 17:23:47.523133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.523232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.908 [2024-11-27 17:23:47.523257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.908 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.523373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.523494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.523518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.523672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.523763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.523787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.523911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.524193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.524442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.524688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.524827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.524948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.525188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.525481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.525718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.525862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.525962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.526202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.526459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.526770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.526903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.527020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.527364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.527616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.527786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.527936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.528201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.528438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.528689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.528867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.528983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.529223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.529442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.529729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.529948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.530075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.530280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.530540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.530752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.530893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.530980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.531273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.531531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.531798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.531943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.909 qpair failed and we were unable to recover it. 00:30:50.909 [2024-11-27 17:23:47.532065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.532190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.909 [2024-11-27 17:23:47.532214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.532302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.532448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.532472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.532594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.532717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.532741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.532859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.532985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.533103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.533426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.533724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.533863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.534013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.534250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.534498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.534778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.534891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.535014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.535285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.535541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.535816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.535963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.536084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.536413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.536651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.536872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.536989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.537112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.537379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.537635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.537871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.537979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.538109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.538361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.538671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.538892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.538976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.539102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.539398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.539675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.539796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.539942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.540178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.540400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.540635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.910 qpair failed and we were unable to recover it. 00:30:50.910 [2024-11-27 17:23:47.540861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.910 [2024-11-27 17:23:47.540979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.541127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.541378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.541623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.541831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.541947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.542144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.542403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.542683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.542829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.542977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.543184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.543489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.543700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.543819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.543942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.544159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.544395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.544641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.544797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.544932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.545218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.545515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.545693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.545810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.546161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.546398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.546659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.546908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.546997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.547142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.547382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.547590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.547701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.547826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.548160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.548492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.548771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.548893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.549042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.549296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.549573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.911 [2024-11-27 17:23:47.549684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.911 qpair failed and we were unable to recover it. 00:30:50.911 [2024-11-27 17:23:47.549767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.549886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.549910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.549993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.550289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.550560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.550834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.550949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.551069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.551327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.551520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.551821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.551959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.552087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.552322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.552544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.552790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.552893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.552982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.553296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.553583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.553853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.553996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.554095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.554339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.554554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.554853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.554980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.555161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.555369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.555638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.555886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.555983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.556131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.556361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.556626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.556863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.912 [2024-11-27 17:23:47.556991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.912 qpair failed and we were unable to recover it. 00:30:50.912 [2024-11-27 17:23:47.557088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.557330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.557604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.557890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.557980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.558125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.558394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.558625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.558845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.558958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.559080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.559315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.559612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.559789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.559911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.560207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.560468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.560666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.560790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.560908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.561147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.561386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.561642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.561759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.561880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.562149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.562410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.562649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.562793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.562916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.563114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.563437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.563681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.563794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.563943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.564229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.564460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.564734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.564852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.564975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.565210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.913 [2024-11-27 17:23:47.565461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.913 [2024-11-27 17:23:47.565608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.913 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.565729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.565853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.565877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.566010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.566358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.566634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.566802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.566892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.567133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.567363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.567738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.567856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.567967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.568171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.568458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.568669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.568819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.568918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.569289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.569579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.569845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.569996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.570139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.570412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.570635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.570783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.570906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.571180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.571473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.571753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.571900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.572013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.572251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.572518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.572828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.572947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.573044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.573287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.573557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.573841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.573963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.574053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.574317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.574574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.574806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.574946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.575072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.575196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.575220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.914 [2024-11-27 17:23:47.575316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.575439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.914 [2024-11-27 17:23:47.575463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.914 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.575561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.575712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.575741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.575828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.575948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.575972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.576119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.576390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.576701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.576824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.576947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.577300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.577562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.577823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.577977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.578126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.578364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.578593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.578836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.578981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.579068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.579339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.579680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.579824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.579951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.580195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.580490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.580772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.580886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.581083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.581363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.581659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.581832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.581952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.582219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.582493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.582743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.582912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.583006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.583271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.583549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.583845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.583993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.584127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.584367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.584667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.584793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.584918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.585182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.585479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.585770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.585915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.586012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.586219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.586483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.586782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.586937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.587091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.587186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.587210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.587302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.587403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.915 [2024-11-27 17:23:47.587427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.915 qpair failed and we were unable to recover it. 00:30:50.915 [2024-11-27 17:23:47.587534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.587640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.587665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.587788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.587913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.587938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.588059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.588329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.588604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.588744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.588863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.589158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.589395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.589639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.589890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.589986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.590135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.590363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.590631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.590853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.590988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.591268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.591537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.591752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.591861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.591960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.592179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.592481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.592745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.592866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.592985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.593223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.593490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.593725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.593846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.593967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.594261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.594495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.594804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.594924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.595009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.595282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.595562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.595774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.595916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.596060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.596267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.596496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.596792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.596969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.597083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.597376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.597630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.597875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.597991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.598129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.598413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.598655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.598777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.598903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.599156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.599389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.599633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.599746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.599860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.600184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.600464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.600707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.600849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.916 qpair failed and we were unable to recover it. 00:30:50.916 [2024-11-27 17:23:47.600972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.601115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.916 [2024-11-27 17:23:47.601139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.601261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.601498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.601860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.601999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.602146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.602352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.602613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.602844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.602990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.603090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.603340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.603553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.603827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.603998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.604093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.604291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.604565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.604792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.604987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.605134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.605433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.605686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.605824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.605976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.606240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.606442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.606675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.606833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.606958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.607176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.607509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.607753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.607876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.607971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.608233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.608545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.608812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.608962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.609112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.609431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.609687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.609808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.609903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.610146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.610410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.610723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.610876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.611000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.611255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.611528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.611775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.611920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.612006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.612234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.612537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.612782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.612896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.613018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.613291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.613563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.613830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.613977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.614118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.614436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.614664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.614811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.614941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.615062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.615086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.917 [2024-11-27 17:23:47.615207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.615308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.917 [2024-11-27 17:23:47.615332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.917 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.615449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.615564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.615589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.615739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.615875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.615900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.616013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.616288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.616535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.616765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.616901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.616997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.617290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.617497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.617848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.617954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.618047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.618296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.618575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.618828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.618966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.619068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.619340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.619538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.619780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.619902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.620000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.620264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.620491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.620790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.620906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.621034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.621318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.621624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.621764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.621879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.622191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.622437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.622694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.622834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.622935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.623204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.623445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.623686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.623806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.623930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.624155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.624380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.624629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.624805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.624928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.625241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.625450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.625759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.625902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.625983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.626254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.626554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.626779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.626915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.627029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.627325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.627585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.627852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.627998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.628147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.628294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.918 [2024-11-27 17:23:47.628318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.918 qpair failed and we were unable to recover it. 00:30:50.918 [2024-11-27 17:23:47.628419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.628497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.628521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.628617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.628764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.628788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.628935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.629198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.629443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.629680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.629825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.629972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.630209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.630481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.630695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.630810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.630960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.631192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.631400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.631648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.631771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.631887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.632148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.632351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.632618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.632817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.632957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.633080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.633369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.633645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.633790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.633911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.634151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.634377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.634586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.634834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.634953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.635100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.635306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.635593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.635803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.635948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.636038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.636342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.636599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.636877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.636989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.637091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.637320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.637615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.637863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.637983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.638100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.638346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.638580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.638793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.638968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.639083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.639387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.639630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.639898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.639990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.640014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.919 qpair failed and we were unable to recover it. 00:30:50.919 [2024-11-27 17:23:47.640159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.640259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.919 [2024-11-27 17:23:47.640283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.640413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.640512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.640543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.640637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.640725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.640749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.640873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.641139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.641358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.641651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.641870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.641991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.642137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.642373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.642619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.642860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.642982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.643105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.643382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.643692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.643805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.643929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.644180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.644420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.644719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.644892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.644988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.645234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.645555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.645814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.645961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.646091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.646377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.646597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.646873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.646976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.647095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.647349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.647592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.647868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.647973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.648100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.648373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.648680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.648825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.648916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.649115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.649357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.649622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.649844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.649994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.650095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.650354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.650655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.650992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.651104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.651370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.651656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.651808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.651925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.652159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.652434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.652732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.920 [2024-11-27 17:23:47.652904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.920 qpair failed and we were unable to recover it. 00:30:50.920 [2024-11-27 17:23:47.653024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.653248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.653539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.653788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.653934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.654057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.654294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.654610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.654856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.654985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.655116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.655384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.655599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.655890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.655988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.656130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.656370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.656652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.656801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.656918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.657163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.657409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.657694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.657837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.657961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.658255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.658457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.658702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.658840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.658936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.659170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.659405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.659673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.659829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.659942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.660180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.660417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.660711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.660829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.660918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.661183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.661485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.661729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.661878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.662028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.662292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.662507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.662868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.662987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.663133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.663420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.663720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.663866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.663990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.664112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.664136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.921 qpair failed and we were unable to recover it. 00:30:50.921 [2024-11-27 17:23:47.664265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.921 [2024-11-27 17:23:47.664359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.664383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.664500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.664595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.664620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.664744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.664845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.664870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.664991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.665267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.665500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.665781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.665901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.666023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.666282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.666584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.666859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.666985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.667137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.667405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.667672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.667815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.667902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.668213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.668479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.668770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.668883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.669005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.669229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.669486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.669753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.669870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.669971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.670311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.670604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.670751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.670873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.671199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.671448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.671704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.671855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.671977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.672216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.672447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.672715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.922 [2024-11-27 17:23:47.672861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.922 qpair failed and we were unable to recover it. 00:30:50.922 [2024-11-27 17:23:47.672984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.673216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.673452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.673823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.673998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.674122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.674400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.674703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.674826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.675021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.675238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.675532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.675781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.675932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.676050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.676249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.676545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.676766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.676902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.677002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.677214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.677479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.677748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.677894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.678014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.678289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.678557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.678829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.678975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.679090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.679389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.679677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.679850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.679977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.680211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.680482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.680786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.680907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.681002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.681206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.681432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.681749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.681870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.682003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.682123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.682148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.923 [2024-11-27 17:23:47.682234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.682365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.923 [2024-11-27 17:23:47.682390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.923 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.682512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.682670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.682694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.682818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.682907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.682932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.683058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.683274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.683501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.683750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.683894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.684024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.684264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.684537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.684872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.684980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.685095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.685396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.685675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.685795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.685888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.686154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.686428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.686679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.686802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.686893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.687124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.687399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.687667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.687779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.687899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.688182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.688432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.688688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.688810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.688931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.689159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.689394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.689678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.689854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.689978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.690219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.690453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.924 qpair failed and we were unable to recover it. 00:30:50.924 [2024-11-27 17:23:47.690708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.924 [2024-11-27 17:23:47.690792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.690815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.690938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.691196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.691403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.691662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.691860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.691980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.692103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.692387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.692646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.692822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.692946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.693238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.693449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.693749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.693889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.693980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.694182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.694423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.694709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.694855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.694961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.695170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.695445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.695674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.695816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.695935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.696198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.696439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.696680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.696852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.696951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.697214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.697450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.697767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.697896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.697986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.698227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.698446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.698706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.698817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.698939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.699149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.699460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.925 qpair failed and we were unable to recover it. 00:30:50.925 [2024-11-27 17:23:47.699743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.925 [2024-11-27 17:23:47.699881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.700004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.700271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.700485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.700763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.700900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.701031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.701354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.701603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.701828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.701996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.702111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.702385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.702709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.702828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.702928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.703212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.703464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.703681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.703827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.703914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.704175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.704465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.704710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.704828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.704927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.705218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.705438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.705711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.705859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.706007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.706255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.706492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.706776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.706925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.707017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.707277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.707508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.707776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.707899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.708065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.708281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.708490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.708764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.708911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.926 [2024-11-27 17:23:47.709042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.709163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.926 [2024-11-27 17:23:47.709187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.926 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.709288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.709537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.709846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.709988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.710110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.710329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.710553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.710855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.710985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.711095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.711349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.711625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.711851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.711998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.712128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.712371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.712637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.712783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.712930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.713234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.713542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.713809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.713979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.714106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.714429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.714702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.714847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.714976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.715190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.715450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.715736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.715851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.715946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.716194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.716516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.716761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.716872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.717020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.717284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.717494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.717730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.717879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.927 [2024-11-27 17:23:47.717993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.718091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.927 [2024-11-27 17:23:47.718114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.927 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.718213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.718482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.718770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.718905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.719031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.719288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.719531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.719780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.719932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.720053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.720339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.720570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.720805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.720943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.721061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.721359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.721631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.721782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.721896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.722163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.722396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.722622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.722866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.722998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.723123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.723421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.723667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.723788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.723917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.724246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.724541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.724783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.724914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.725037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.725294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.725535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.725782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.725956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.726046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.726175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.726200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.726293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.726385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.928 [2024-11-27 17:23:47.726409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.928 qpair failed and we were unable to recover it. 00:30:50.928 [2024-11-27 17:23:47.726538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.726674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.726698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.726794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.726917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.726940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.727104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.727396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.727639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.727863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.727983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.728104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.728349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.728586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.728824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.728942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.729067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.729351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.729662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.729804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.729926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.730155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.730399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.730676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.730844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.730960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.731205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.731478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.731696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.731869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.731996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.732237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.732516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.732808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.732952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.733066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.733354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.733589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.733853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.733992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.734106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.734389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.734649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.734887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.734977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.735002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.735123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.735209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.735234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.929 qpair failed and we were unable to recover it. 00:30:50.929 [2024-11-27 17:23:47.735325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.929 [2024-11-27 17:23:47.735438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.735462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.735586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.735678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.735704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.735852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.735973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.735997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.736099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.736375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.736684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.736888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.736995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.737098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.737335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.737561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.737816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.737936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.738051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.738287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.738531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.738768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.738939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.739089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.739357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.739592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.739804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.739923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.740044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.740298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.740553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.740820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.740954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.741051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.741352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.741606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.741862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.741974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.742102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.742380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.742624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.742829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.742946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.743073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.743355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.743555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.743804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.743916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.744046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.744167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.744191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.930 qpair failed and we were unable to recover it. 00:30:50.930 [2024-11-27 17:23:47.744314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.930 [2024-11-27 17:23:47.744434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.744458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.744553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.744703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.744732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.744849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.744949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.744973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.745092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.745333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.745572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.745789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.745928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.746052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.746346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.746584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.746830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.746977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.747100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.747364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.747576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.747836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.747950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.748071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.748334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.748594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.748841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.748989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.749134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.749423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.749704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.749817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.749910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.750199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.750423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.750679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.750824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.750968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.751219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.751531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.751772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.751938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.752027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.752321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.931 qpair failed and we were unable to recover it. 00:30:50.931 [2024-11-27 17:23:47.752578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.931 [2024-11-27 17:23:47.752716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.752838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.752963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.752988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.753111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.753347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.753611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.753732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.753859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.754160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.754422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.754638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.754753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.754877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.755148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.755411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.755642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.755785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.755909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.756158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.756475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.756728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.756870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.757017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.757292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.757579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.757842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.757959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.758085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.758287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.758583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.758803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.758947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.759097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.759329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.759620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.759777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.759899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.760132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.760433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.760694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.760836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.760950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.761213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.761479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.932 qpair failed and we were unable to recover it. 00:30:50.932 [2024-11-27 17:23:47.761741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.932 [2024-11-27 17:23:47.761875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.761900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.761999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.762209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.762480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.762726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.762891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.762980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.763254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.763489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.763758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.763874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.764022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.764240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.764513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.764806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.764977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.765097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.765304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.765592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.765830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.765999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.766119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.766354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.766631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.766777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.766905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.767190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.767420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.767658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.767830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.767952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.768164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.768427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.768651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.768891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.768980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.769121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.769441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.769666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.769780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.933 qpair failed and we were unable to recover it. 00:30:50.933 [2024-11-27 17:23:47.769897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.933 [2024-11-27 17:23:47.770012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.770134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.770401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.770675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.770819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.770916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.771138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.771376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.771676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.771823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.771971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.772221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.772457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.772696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.772842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.772995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.773235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.773532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.773802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.773918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.774002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.774297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.774558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.774811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.774927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.775026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.775319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.775604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.775814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.775924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.776048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.776360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.776645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.776799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.776922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.777206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.777486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.777759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.777880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.777977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.778199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.778463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.778733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.778857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.778990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.779111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.779135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.934 qpair failed and we were unable to recover it. 00:30:50.934 [2024-11-27 17:23:47.779260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.934 [2024-11-27 17:23:47.779403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.779427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.779519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.779649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.779673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.779770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.779859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.779884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.779981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.780236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.780554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.780825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.780967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.781054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.781320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.781594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.781841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.781979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.782099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.782342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.782559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.782795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.782963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.783065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.783365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.783612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.783787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.783888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.784181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.784471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.784741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.784885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.784998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.785240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.785504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.785751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.785919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.786114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.786463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.786725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.786841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.786991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.787244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.787502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.935 qpair failed and we were unable to recover it. 00:30:50.935 [2024-11-27 17:23:47.787774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.935 [2024-11-27 17:23:47.787862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.787886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.788031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.788244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.788511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.788753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.788870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.788969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.789258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.789530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.789783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.789899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.790023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.790260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.790512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.790786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.790907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.791026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.791309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.791509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.791786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.791931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.792080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.792340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.792639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.792807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.792930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.793176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.793463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.793731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.793867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.794014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.794318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.794578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.794817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.794958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.795090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.795382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.795657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.795830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.795951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.796176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.796409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.796657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.796805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.796930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.797021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.797045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.936 qpair failed and we were unable to recover it. 00:30:50.936 [2024-11-27 17:23:47.797185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.797296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.936 [2024-11-27 17:23:47.797321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.797453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.797543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.797568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.797669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.797762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.797787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.797885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.798206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.798464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.798699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.798845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.798971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.799233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.799469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.799745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.799889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.799985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.800201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.800446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.800717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.800860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.800958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.801245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.801480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.801721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.801856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.801978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.802207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.802473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.802700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.802845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.802977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.803214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.803499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.803845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.803982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.804177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.804420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.804699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.804847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.804945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.805221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.805464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.805737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.805887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.806002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.806324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.937 [2024-11-27 17:23:47.806626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.937 [2024-11-27 17:23:47.806744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.937 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.806868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.807189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.807429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.807645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.807819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.807915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.808186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.808424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.808680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.808806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.808929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.809176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.809461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.809759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.809928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.810029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.810318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.810577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.810788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.810936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.811068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.811355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.811600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.811848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.811963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.812119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.812391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.812701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.812847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.812950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.813247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.813546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.813806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.813923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.814050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.814290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.814573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.814842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.814964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.815114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.815387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.815668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.815790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.815929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.816046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.816072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.938 [2024-11-27 17:23:47.816221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.816314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.938 [2024-11-27 17:23:47.816339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.938 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.816437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.816534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.816560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.816670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.816793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.816819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.816970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.817273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.817547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.817832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.817981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.818083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.818325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.818531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.818836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.818983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.819103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.819315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.819572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.819828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.819977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.820104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.820341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.820616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.820854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.820999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.821087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.821357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.821666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.821897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.821985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.822140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.822403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.822655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.822799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.822921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.823177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.823441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.823705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.823850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.823949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.824149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.824352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.939 qpair failed and we were unable to recover it. 00:30:50.939 [2024-11-27 17:23:47.824615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.939 [2024-11-27 17:23:47.824737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.824885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.825154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.825475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.825872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.825974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.826220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.826493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.826708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.826826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.826953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.827195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.827432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.827682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.827801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.827926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.828165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.828404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.828704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.828852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.828941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.829193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.829538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.829837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.829986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.830088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.830295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.830504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.830759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.830905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.831005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.831327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.831579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.831807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.831919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.832004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.832239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.832540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.832793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.832930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:50.940 [2024-11-27 17:23:47.833044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.833152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.940 [2024-11-27 17:23:47.833177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:50.940 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.833295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.833541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.833767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.833941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.834008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b73e00 (9): Bad file descriptor 00:30:51.241 [2024-11-27 17:23:47.834168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.834442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.834678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.834812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.834915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.835012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.835038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.241 qpair failed and we were unable to recover it. 00:30:51.241 [2024-11-27 17:23:47.835141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.241 [2024-11-27 17:23:47.835263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.835385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.835616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.835880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.835998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.836124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.836340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.836644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.836793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.836890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.837131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.837400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.837654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.837861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.837975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.838123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.838403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.838634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.838789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.838909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.839198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.839450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.839733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.839887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.839999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.840248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.840510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.840803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.840986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.841085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.841301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.841614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.841886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.841981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.842007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.842113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.842207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.842233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.242 qpair failed and we were unable to recover it. 00:30:51.242 [2024-11-27 17:23:47.842385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.242 [2024-11-27 17:23:47.842483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.842510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.842644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.842779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.842805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.842928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.843184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.843425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.843704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.843829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.843930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.844206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.844483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.844764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.844886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.845011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.845231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.845471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.845674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.845831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.845956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.846199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.846481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.846806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.846956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.847107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.847365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.847602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.847834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.847953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.848047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.848310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.848635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.848887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.848985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.849139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.849380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.243 [2024-11-27 17:23:47.849621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.243 [2024-11-27 17:23:47.849775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.243 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.849975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.850303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.850510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.850693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.850893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.851194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.851451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.851732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.851883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.852033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.852327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.852592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.852835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.852982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.853080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.853398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.853680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.853803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.853955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.854173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.854433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.854669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.854788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.854879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.855179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.855487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.855716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.855862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.855993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.856230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.856490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.856823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.856973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.857136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.857237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.857263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.857357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.857478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.244 [2024-11-27 17:23:47.857505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.244 qpair failed and we were unable to recover it. 00:30:51.244 [2024-11-27 17:23:47.857633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.857738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.857764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.857891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.858189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.858466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.858719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.858857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.858951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.859208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.859481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.859695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.859810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.859929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.860175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.860452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.860696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.860825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.860919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.861214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.861479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.861705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.861883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.862084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.862390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.862675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.862856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.862947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.863193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.863494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.863832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.863980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.864135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.864388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.864711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.864866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.865068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.865215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.865242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.245 qpair failed and we were unable to recover it. 00:30:51.245 [2024-11-27 17:23:47.865392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.245 [2024-11-27 17:23:47.865487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.865514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.865654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.865780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.865808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.865937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.866178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.866448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.866670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.866801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.866889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.867164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.867399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.867672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.867795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.867913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.868184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.868409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.868681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.868852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.868977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.869330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.869712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.869868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.870016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.870262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.870575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.870817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.870995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.871152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.871271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.871297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.871498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.871632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.871660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.246 qpair failed and we were unable to recover it. 00:30:51.246 [2024-11-27 17:23:47.871757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.246 [2024-11-27 17:23:47.871883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.871910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.871997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.872271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.872553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.872859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.872982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.873102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.873351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.873637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.873754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.873878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.874150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.874418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.874691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.874818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.874940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.875288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.875629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.875861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.875978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.876131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.876377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.876641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.876826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.876982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.877256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.877504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.877788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.877917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.878073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.878344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.878602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.878725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.878877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.879188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.879490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.247 qpair failed and we were unable to recover it. 00:30:51.247 [2024-11-27 17:23:47.879753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.247 [2024-11-27 17:23:47.879849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.879876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.880004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.880242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.880452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.880756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.880880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.880980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.881314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.881631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.881777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.881904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.882178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.882455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.882737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.882895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.883016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.883304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.883586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.883872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.883993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.884082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.884363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.884643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.884863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.884979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.885125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.885403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.885733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.885856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.886003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.886269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.886576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.886731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.886885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.887150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.248 [2024-11-27 17:23:47.887419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.248 [2024-11-27 17:23:47.887573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.248 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.887724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.887828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.887856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.887983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.888255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.888518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.888756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.888934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.889057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.889343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.889595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.889739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.889941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.890215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.890429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.890670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.890825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.890929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.891177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.891472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.891802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.891963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.892069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.892355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.892613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.892765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.892886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.893206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.893509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.893764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.893888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.893981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.894330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.894561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.894845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.894965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.895115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.895239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.895266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.249 qpair failed and we were unable to recover it. 00:30:51.249 [2024-11-27 17:23:47.895385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.249 [2024-11-27 17:23:47.895487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.895514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.895612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.895764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.895890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.896155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.896431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.896676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.896828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.896951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.897187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.897415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.897766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.897917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.898018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.898241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.898486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.898707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.898832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.898929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.899164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.899436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.899688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.899814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.899966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.900310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.900538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.900826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.900977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.901071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.901352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.901614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.250 qpair failed and we were unable to recover it. 00:30:51.250 [2024-11-27 17:23:47.901844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.901993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.250 [2024-11-27 17:23:47.902020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.902137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.902385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.902640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.902878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.902995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.903142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.903447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.903685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.903811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.903926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.904198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.904452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.904764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.904939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.905064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.905330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.905562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.905805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.905952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.906100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.906396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.906702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.906851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.906967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.907208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.907455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.907697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.907820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.907969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.908265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.908574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94e8000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.908825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.908948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.909072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.909194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.909219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.909372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.909472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.251 [2024-11-27 17:23:47.909498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.251 qpair failed and we were unable to recover it. 00:30:51.251 [2024-11-27 17:23:47.909632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.909761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.909786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.909943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.910195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.910406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.910659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.910821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.910918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.911192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.911440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.911738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.911901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.911996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.912271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.912493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.912747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.912873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.912965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.913243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.913564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.913816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.913961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.914113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.914331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.914628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.914853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.914997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.915121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.915389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.915641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.915791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.915918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.916144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.916396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.916646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.252 [2024-11-27 17:23:47.916894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.916987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.252 [2024-11-27 17:23:47.917013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.252 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.917144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.917364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.917639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.917814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.917910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.918209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.918482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.918735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.918881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.919010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.919287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.919568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.919782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.919932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.920054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.920306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.920622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.920872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.920997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.921145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.921397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.921686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.921861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.921985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.922292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.922546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.922770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.922920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.923004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.923331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.923644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.923797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.923916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.924145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.924394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.253 qpair failed and we were unable to recover it. 00:30:51.253 [2024-11-27 17:23:47.924680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.253 [2024-11-27 17:23:47.924803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.924829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.924956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.925256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.925553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.925874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.925997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.926149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.926452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.926730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.926849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.926975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.927208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.927478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.927790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.927966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.928055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.928303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.928577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.928850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.928977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.929128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.929431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.929707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.929829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.929924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.930255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.930501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.930779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.930889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.930984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.931219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.931483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.931709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.931827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.931943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.932035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.932062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.932185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.932273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.254 [2024-11-27 17:23:47.932301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.254 qpair failed and we were unable to recover it. 00:30:51.254 [2024-11-27 17:23:47.932428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.932518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.932553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.932682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.932803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.932830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.932919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.933221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.933468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.933744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.933891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.933994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.934301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.934600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.934871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.934995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.935139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.935410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.935716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.935866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.935993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.936215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.936515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.936816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.936937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.937057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.937275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.937587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.937775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.937926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.938240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.938494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.938770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.938920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.939046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.939148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.939173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.255 qpair failed and we were unable to recover it. 00:30:51.255 [2024-11-27 17:23:47.939325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.939447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.255 [2024-11-27 17:23:47.939473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.939588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.939714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.939741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.939837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.939964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.939989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.940087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.940340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.940595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.940857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.940980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.941096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.941367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.941677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.941804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.941923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.942198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.942448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.942724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.942879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.943036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.943308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.943575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.943755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.943879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.944126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.944368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.944669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.944786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.944927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.945200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.945473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.945728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.945881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.946012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.946257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.946507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.256 [2024-11-27 17:23:47.946785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.256 [2024-11-27 17:23:47.946912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.256 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.947067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.947297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.947602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.947839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.947987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.948136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.948389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.948689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.948840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.948990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.949215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.949415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.949725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.949900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.950025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.950273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.950528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.950796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.950971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.951065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.951309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.951582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.951829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.951953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.952082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.952371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.952645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.952791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.952944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.953227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.953537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.953791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.953946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.954073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.954193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.954220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.954372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.954462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.954487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.257 qpair failed and we were unable to recover it. 00:30:51.257 [2024-11-27 17:23:47.954626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.257 [2024-11-27 17:23:47.954749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.954774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.954931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.955171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.955467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.955771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.955940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.956063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.956312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.956623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.956780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.956923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.957145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.957411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.957651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.957825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.957948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.958232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.958532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.958788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.958916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.959061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.959332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.959603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.959762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.959907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.960202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.960446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.960689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.960803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.960932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.961180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.961430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.961682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.961835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.961954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.962079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.962113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.962207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.962329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.962356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.258 qpair failed and we were unable to recover it. 00:30:51.258 [2024-11-27 17:23:47.962481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.258 [2024-11-27 17:23:47.962607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.962635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.962735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.962850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.962877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.963028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.963327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.963606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.963858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.963983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.964112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.964350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.964592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.964877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.964995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.965111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.965359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.965657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.965804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.965905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.966194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.966496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.966746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.966920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.967040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.967312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.967622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.967869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.967989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.968115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.968321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.968566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.968868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.968990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.969091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.969359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.969580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.259 qpair failed and we were unable to recover it. 00:30:51.259 [2024-11-27 17:23:47.969876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.259 [2024-11-27 17:23:47.969963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.969989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.970087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.970336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.970651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.970773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.970920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.971149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.971393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.971668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.971908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.971999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.972117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.972333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.972619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.972855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.972976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.973119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.973353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.973608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.973760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.973908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.974186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.974491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.974796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.974974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.975073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.975317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.975559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.975796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.975912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.260 [2024-11-27 17:23:47.976031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.976151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.260 [2024-11-27 17:23:47.976178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.260 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.976305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.976549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.976822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.976977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.977099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.977344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.977653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.977775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.977903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.978148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.978421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.978723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.978873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.978968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.979268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.979519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.979794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.979945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.980066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.980346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.980583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.980856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.980973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.981100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.981370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.981630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.981808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.981957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.982219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.982500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.982791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.982963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.983088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.983342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.983580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.261 qpair failed and we were unable to recover it. 00:30:51.261 [2024-11-27 17:23:47.983819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.261 [2024-11-27 17:23:47.983965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.984090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.984339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.984697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.984874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.984989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.985239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.985548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.985798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.985945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.986065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.986340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.986621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.986735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.986880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.987180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.987456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.987735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.987885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.987976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.988217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.988488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.988766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.988918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.989035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.989303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.989599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.989747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.989871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.990171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.990480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.990744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.990898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.990986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.991312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.991620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.262 qpair failed and we were unable to recover it. 00:30:51.262 [2024-11-27 17:23:47.991866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.262 [2024-11-27 17:23:47.991992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.992140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.992394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.992625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.992902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.992997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.993122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.993356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.993660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.993817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.993918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.994191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.994463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.994742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.994890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.994987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.995276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.995518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.995773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.995958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.996107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.996382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.996686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.996842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.996948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.997225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.997553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.997800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.997947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.998078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.998296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.998510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.998732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.998850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.998941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.999031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.999057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.999181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.999269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.263 [2024-11-27 17:23:47.999295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.263 qpair failed and we were unable to recover it. 00:30:51.263 [2024-11-27 17:23:47.999411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:47.999559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:47.999590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:47.999713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:47.999802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:47.999828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:47.999951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.000220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.000490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.000811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.000991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.001122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.001452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.001795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.001918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.002017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.002294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.002576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.002815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.002994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.003093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.003390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.003680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.003858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.003947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.004223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.004448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.004695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.004816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.004967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.005225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.005477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.005757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.005908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.006005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.006132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.006158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.264 qpair failed and we were unable to recover it. 00:30:51.264 [2024-11-27 17:23:48.006317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.006412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.264 [2024-11-27 17:23:48.006438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.006588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.006716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.006743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.006901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.007173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.007475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.007805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.007932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.008063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.008372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.008603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.008786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.008914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.009164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.009385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.009661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.009813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.009909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.010153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.010465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.010742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.010890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.011014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.011302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.011547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.011797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.011921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.012042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.012306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.012546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.012703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.012855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.013150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.013432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.013673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.013804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.013926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.014023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.265 [2024-11-27 17:23:48.014049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.265 qpair failed and we were unable to recover it. 00:30:51.265 [2024-11-27 17:23:48.014179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.014452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.014725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.014877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.014978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.015291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.015591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.015773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.015923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.016238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.016487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.016778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.016924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.017052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.017317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.017560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.017874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.017992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.018122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.018368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.018691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.018813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.018947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.019272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.019491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.019766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.019914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.020012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.020288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.020582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.020835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.020987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.021104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.021377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.021649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.021822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.266 [2024-11-27 17:23:48.021928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.022021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.266 [2024-11-27 17:23:48.022047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.266 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.022169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.022442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.022661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.022812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.022933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.023156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.023392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.023668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.023797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.023915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.024209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.024477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.024692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.024843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.024943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.025213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.025461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.025770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.025919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.026050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.026316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.026594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.026844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.026999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.027152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.027420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.027659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.027784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.027934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.028179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.028440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.028714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.028855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.029005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.029129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.029157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.029309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.029437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.029464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.267 qpair failed and we were unable to recover it. 00:30:51.267 [2024-11-27 17:23:48.029600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.267 [2024-11-27 17:23:48.029735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.029761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.029857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.030120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.030358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.030631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.030899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.030989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.031147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.031444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.031686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.031859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.031983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.032253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.032560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.032810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.032960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.033078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.033403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.033647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.033856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.033978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.034070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.034304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.034532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.034830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.034959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.035079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.035391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.035683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.035802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.035956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.036230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.036472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.036745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.036872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.036994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.037118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.037144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.268 qpair failed and we were unable to recover it. 00:30:51.268 [2024-11-27 17:23:48.037232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.268 [2024-11-27 17:23:48.037360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.037386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.037474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.037573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.037599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.037693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.037839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.037866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.037991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.038269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.038493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.038704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.038848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.038966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.039204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.039535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.039775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.039925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.040016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.040273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.040534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.040791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.040943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.041064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.041343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.041635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.041780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.041899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.042172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.042416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.042678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.042827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.042953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.043213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.043506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.269 [2024-11-27 17:23:48.043760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.269 [2024-11-27 17:23:48.043919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.269 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.044046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.044302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.044584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.044873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.044997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.045150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.045435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.045682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.045832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.045949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.046252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.046521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.046748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.046867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.046990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.047265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.047562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.047768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.047889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.048157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.048425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.048669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.048821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.048947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.049241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.049505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.049755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.049903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.050054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.050273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.050556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.050815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.050996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.051127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.051254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.051280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.051396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.051511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.051542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.270 qpair failed and we were unable to recover it. 00:30:51.270 [2024-11-27 17:23:48.051639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.270 [2024-11-27 17:23:48.051731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.051758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.051905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.052178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.052476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.052713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.052855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.052972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.053211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.053539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.053833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.053982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.054109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.054373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.054610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.054790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.054916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.055188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.055430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.055713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.055886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.055984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.056251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.056536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.056827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.056951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.057108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.057357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.057642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.057783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.057882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.058185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.058435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.058700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.058875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.059037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.059181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.059207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.059310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.059459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.271 [2024-11-27 17:23:48.059485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.271 qpair failed and we were unable to recover it. 00:30:51.271 [2024-11-27 17:23:48.059628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.059751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.059777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.059903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.060202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.060450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.060746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.060898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.061019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.061294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.061588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.061870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.061990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.062099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.062377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.062698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.062818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.062911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.063218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.063464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.063697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.063821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.063913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.064184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.064422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.064695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.064870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.065002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.065276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.065522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.065798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.065954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.066057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.066306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.066561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.066803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.066953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.272 [2024-11-27 17:23:48.067107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.067197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.272 [2024-11-27 17:23:48.067225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.272 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.067356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.067502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.067534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.067633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.067731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.067757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.067879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.068153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.068403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.068710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.068857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.068980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.069263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.069517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.069797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.069943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.070073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.070343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.070613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.070742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.070862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.071163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.071417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.071705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.071824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.071952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.072198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.072538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.072833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.072984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.073158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.073410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.073719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.073837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.073987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.074136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.074162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.273 qpair failed and we were unable to recover it. 00:30:51.273 [2024-11-27 17:23:48.074291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.273 [2024-11-27 17:23:48.074378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.074404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.074498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.074626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.074653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.074756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.074855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.074881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.075006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.075272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.075550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.075862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.075991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.076142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.076391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.076691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.076867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.076993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.077273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.077576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.077787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.077936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.078025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.078278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.078560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.078811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.078930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.079056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.079302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.079578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.079793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.079969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.080090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.080332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.080626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.080777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.080908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.081218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.081472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.274 qpair failed and we were unable to recover it. 00:30:51.274 [2024-11-27 17:23:48.081774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.274 [2024-11-27 17:23:48.081934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.082063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.082304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.082608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.082887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.082977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.083111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.083385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.083621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.083853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.083976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.084123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.084397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.084675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.084890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.085102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.085340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.085659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.085812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.085936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.086239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.086509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.086758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.086881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.087008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.087282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.087534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.087815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.087963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.088054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.088353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.088584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.088828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.088987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.089126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.089276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.089302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.275 qpair failed and we were unable to recover it. 00:30:51.275 [2024-11-27 17:23:48.089422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.275 [2024-11-27 17:23:48.089517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.089550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.089652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.089751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.089777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.089904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.089991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.090105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.090353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.090655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.090808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.090937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.091197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.091426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.091680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.091860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.091985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.092231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.092556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.092830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.092984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.093114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.093388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.093685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.093861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.093984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.094258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.094747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.094880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.095010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.095267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.095573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.095833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.095980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.096134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.096381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.096680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.096808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.096908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.097028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.276 [2024-11-27 17:23:48.097056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.276 qpair failed and we were unable to recover it. 00:30:51.276 [2024-11-27 17:23:48.097189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.097419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.097697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.097840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.097940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.098266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.098507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.098788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.098939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.099038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.099286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.099497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.099807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.099922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.100051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.100331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.100609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.100869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.100996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.101147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.101446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.101725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.101857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.101984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.102237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.102529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.102769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.102917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.103012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.103343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.103606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.103831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.103986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.104109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.104395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.277 [2024-11-27 17:23:48.104682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.277 [2024-11-27 17:23:48.104809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.277 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.104907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.104998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.105159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.105413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.105682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.105809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.105957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.106202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.106498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.106764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.106891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.107042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.107327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.107579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.107873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.107985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.108078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.108351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.108631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.108782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.108920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.109193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.109494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.109723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.109854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.109946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.110278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.110563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.110848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.110975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.111094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.111189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.111216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.278 [2024-11-27 17:23:48.111342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.111461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.278 [2024-11-27 17:23:48.111488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.278 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.111618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.111703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.111728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.111835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.111963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.111990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.112116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.112346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.112567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.112807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.112940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.113065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.113359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.113669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.113820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.113955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.114249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.114462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.114761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.114912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.115010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.115274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.115558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.115784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.115945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.116042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.116287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.116565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.116719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.116881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.117176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.117423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.117715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.117862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.117982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.118242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.118512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.118839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.118956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.279 qpair failed and we were unable to recover it. 00:30:51.279 [2024-11-27 17:23:48.119079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.279 [2024-11-27 17:23:48.119170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.119291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.119558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.119811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.119935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.120034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.120302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.120542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.120789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.120955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.121073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.121282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.121589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.121839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.121992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.122144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.122381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.122670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.122849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.122939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.123211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.123454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.123718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.123867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.123959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.124212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.124456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.124763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.124914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.125013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.125250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.125574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.125876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.125997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.126024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.126115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.126236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.126262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.126412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.126563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.280 [2024-11-27 17:23:48.126593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.280 qpair failed and we were unable to recover it. 00:30:51.280 [2024-11-27 17:23:48.126721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.126874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.126900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.127023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.127292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.127538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.127785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.127907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.128008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.128285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.128501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.128799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.128978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.129076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.129329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.129568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.129868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.129984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.130168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.130462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.130729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.130860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.130980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.131252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.131523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.131778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.131934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.132087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.132353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.132605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.132757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.132910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.133208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.133442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.133712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.133857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.133977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.134101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.134128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.281 [2024-11-27 17:23:48.134283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.134430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.281 [2024-11-27 17:23:48.134457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.281 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.134554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.134682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.134709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.134874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.134971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.134997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.135092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.135374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.135607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.135851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.135967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.136058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.136368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.136659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.136810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.136938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.137208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.137487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.137787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.137949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.138051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.138291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.138539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.138810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.138960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.139049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.139323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.139597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.139744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.139893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.140196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.140422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.140693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.140808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.140899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.141014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.141040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.282 qpair failed and we were unable to recover it. 00:30:51.282 [2024-11-27 17:23:48.141168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.141287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.282 [2024-11-27 17:23:48.141314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.141414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.141534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.141560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.141709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.141827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.141853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.141974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.142273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.142538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.142786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.142933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.143053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.143328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.143579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.143880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.143978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.144101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.144383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.144714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.144888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.145037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.145294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.145539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.145846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.145996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.146150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.146416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.146649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.146797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.146949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.147270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.147556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.147803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.147946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.148067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.148373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.148647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.148799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.148959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.149057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.283 [2024-11-27 17:23:48.149084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.283 qpair failed and we were unable to recover it. 00:30:51.283 [2024-11-27 17:23:48.149210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.149478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.149793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.149943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.150043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.150320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.150557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.150829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.150981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.151081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.151305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.151581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.151853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.151995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.152148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.152410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.152647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.152820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.152944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.153178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.153427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.153735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.153858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1874985 Killed "${NVMF_APP[@]}" "$@" 00:30:51.284 [2024-11-27 17:23:48.153982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.154199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 17:23:48 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:51.284 [2024-11-27 17:23:48.154326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 17:23:48 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:51.284 [2024-11-27 17:23:48.154455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 17:23:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:51.284 [2024-11-27 17:23:48.154713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 17:23:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.284 [2024-11-27 17:23:48.154817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.154844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 17:23:48 -- common/autotest_common.sh@10 -- # set +x 00:30:51.284 [2024-11-27 17:23:48.154974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.155247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.155557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.155807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.155942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.156073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.156163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.156190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.284 qpair failed and we were unable to recover it. 00:30:51.284 [2024-11-27 17:23:48.156318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.284 [2024-11-27 17:23:48.156413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.156440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.156570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.156707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.156734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.156857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.156958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.156985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.157087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.157349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.157598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.157819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.157937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.158062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.158301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.158629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.158826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.158959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 17:23:48 -- nvmf/common.sh@469 -- # nvmfpid=1875682 00:30:51.285 17:23:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:51.285 [2024-11-27 17:23:48.159131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 17:23:48 -- nvmf/common.sh@470 -- # waitforlisten 1875682 00:30:51.285 [2024-11-27 17:23:48.159171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.159299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 17:23:48 -- common/autotest_common.sh@829 -- # '[' -z 1875682 ']' 00:30:51.285 [2024-11-27 17:23:48.159442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.159480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.285 17:23:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 17:23:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:51.285 [2024-11-27 17:23:48.159653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 17:23:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:51.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:51.285 [2024-11-27 17:23:48.159785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.159812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 17:23:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:51.285 [2024-11-27 17:23:48.159914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 17:23:48 -- common/autotest_common.sh@10 -- # set +x 00:30:51.285 [2024-11-27 17:23:48.160012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.160192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.160412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.160660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.160788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.285 [2024-11-27 17:23:48.160916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.161016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.285 [2024-11-27 17:23:48.161043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.285 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.161141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.161401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.161669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.161819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.161915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.162231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.162437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.569 [2024-11-27 17:23:48.162700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.569 [2024-11-27 17:23:48.162832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.569 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.162956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.163190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.163431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.163745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.163904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.163999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.164216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.164513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.164811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.164959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.165082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.165324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.165610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.165831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.165946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.166075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.166320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.166548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.166786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.166900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.166995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.167251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.167487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.167762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.167882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.167982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.168281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.168546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.168814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.168939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.169059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.169337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.169595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.169833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.570 [2024-11-27 17:23:48.169949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.570 qpair failed and we were unable to recover it. 00:30:51.570 [2024-11-27 17:23:48.170048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.170318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.170605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.170723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.170847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.171117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.171376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.171647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.171818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.171940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.172146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.172400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.172615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.172854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.172967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.173073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.173338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.173548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.173800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.173971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.174070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.174358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.174622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.174833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.174979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.175096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.175340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.175613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.175823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.175932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.176024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.176275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.176508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.176751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.176895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.571 [2024-11-27 17:23:48.176988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.177102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.571 [2024-11-27 17:23:48.177127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.571 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.177247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.177488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.177787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.177906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.178056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.178301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.178564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.178811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.178960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.179092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.179335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.179587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.179833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.179978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.180101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.180304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.180556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.180799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.180916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.181064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.181328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.181595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.181864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.181989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.182143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.182408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.182707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.182852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.182969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.183212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.183427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.183719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.183873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.183970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.184240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.572 qpair failed and we were unable to recover it. 00:30:51.572 [2024-11-27 17:23:48.184547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.572 [2024-11-27 17:23:48.184683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.184770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.184896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.184920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.185046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.185278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.185559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.185806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.185953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.186067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.186306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.186585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.186732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.186886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.187157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.187432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.187732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.187871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.187995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.188237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.188548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.188797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.188953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.189072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.189315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.189559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.189789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.189928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.190054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.190263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.190502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.190747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.190874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.190964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.191237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.191485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.191762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.191917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.573 qpair failed and we were unable to recover it. 00:30:51.573 [2024-11-27 17:23:48.192046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.573 [2024-11-27 17:23:48.192137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.192257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.192532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.192771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.192955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.193355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.193594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.193866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.193987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.194099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.194363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.194655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.194808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.194957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.195258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.195555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.195773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.195893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.196018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.196267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.196506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.196736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.196924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.197074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.197312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.197644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.197888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.197981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.198006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.198134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.198236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.574 [2024-11-27 17:23:48.198260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.574 qpair failed and we were unable to recover it. 00:30:51.574 [2024-11-27 17:23:48.198388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.198504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.198536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.198655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.198806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.198831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.198921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.199161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.199421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.199700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.199849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.199944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.200214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.200479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.200722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.200835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.200937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.201242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.201490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.201725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.201864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.201987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.202229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.202507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.202753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.202893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.203018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:51.575 [2024-11-27 17:23:48.203044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203093] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:51.575 [2024-11-27 17:23:48.203132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.203287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.203506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.203798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.203946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.204073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.204344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.204654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.204776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.204899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.205166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.205435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.575 [2024-11-27 17:23:48.205563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.575 qpair failed and we were unable to recover it. 00:30:51.575 [2024-11-27 17:23:48.205681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.205766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.205791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.205939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.206206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.206483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.206721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.206894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.206990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.207325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.207566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.207780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.207897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.207989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.208238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.208459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.208706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.208826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.208946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.209256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.209523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.209745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.209920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.210052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.210315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.210539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.210786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.210904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.211049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.211346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.211600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.211775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.211931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.212200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.212471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.212759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.212885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.213021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.213114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.576 [2024-11-27 17:23:48.213139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.576 qpair failed and we were unable to recover it. 00:30:51.576 [2024-11-27 17:23:48.213230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.213521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.213758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.213912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.214040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.214303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.214595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.214817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.214991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.215080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.215311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.215535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.215737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.215856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.215980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.216247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.216532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.216801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.216913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.217059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.217287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.217517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.217744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.217884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.217977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.218234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.218500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.218749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.218875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.218976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.219203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.219448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.219686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.219858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.219961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.220110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.220135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.577 [2024-11-27 17:23:48.220259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.220348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.577 [2024-11-27 17:23:48.220374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.577 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.220455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.220541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.220567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.220689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.220782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.220808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.220928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.221172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.221409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.221659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.221853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.221997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.222090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.222398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.222668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.222875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.222992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.223112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.223351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.223615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.223864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.223968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.224093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.224320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.224540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.224836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.224979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.225108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.225374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.225664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.225780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.225934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.226207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.226480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.578 qpair failed and we were unable to recover it. 00:30:51.578 [2024-11-27 17:23:48.226755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.578 [2024-11-27 17:23:48.226880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.226905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.227026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.227313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.227569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.227860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.227979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.228158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.228427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.228651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.228827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.228923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.229152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.229384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.229666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.229776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.229898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.230193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.230458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.230735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.230848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.230935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.231207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.231445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.231743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.231854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.231958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.232256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.232498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.232739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.232889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.232981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.233280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.233523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.233815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.233936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.579 qpair failed and we were unable to recover it. 00:30:51.579 [2024-11-27 17:23:48.234053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.579 [2024-11-27 17:23:48.234173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.234298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.234597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.234845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.234994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.235117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.235334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.235650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.235888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.235987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.236160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.580 [2024-11-27 17:23:48.236397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.236631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.236797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.236896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.237195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.237444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.237724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.237845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.237966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.238208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.238477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.238759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.238911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.239009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.239287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.239544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.239811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.239960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.240056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.240285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.240554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.580 qpair failed and we were unable to recover it. 00:30:51.580 [2024-11-27 17:23:48.240765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.580 [2024-11-27 17:23:48.240890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.240915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.241030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.241255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.241529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.241804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.241953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.242084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.242354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.242644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.242786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.242916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.243174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.243443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.243749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.243896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.243988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.244237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.244510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.244764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.244916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.245066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.245294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.245503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.245729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.245869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.245962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.246223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.246494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.246733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.246861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.246994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.247254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.247463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.581 [2024-11-27 17:23:48.247764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.581 [2024-11-27 17:23:48.247948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.581 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.248075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.248283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.248518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.248781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.248901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.249017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.249250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.249514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.249797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.249913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.250063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.250336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.250580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.250842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.250966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.251092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.251332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.251569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.251822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.251971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.252071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.252290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.252529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.252803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.252916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.253034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.253253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.253504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.253781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.253935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.254028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.254298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.254572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.254808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.254966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.582 qpair failed and we were unable to recover it. 00:30:51.582 [2024-11-27 17:23:48.255083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.582 [2024-11-27 17:23:48.255183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.255333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.255615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.255887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.255975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.256100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.256340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.256614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.256884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.256984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.257089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.257336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.257580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.257815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.257933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.258060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.258278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.258512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.258807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.258922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.259019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.259326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.259596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.259840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.259988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.260072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.260287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.260567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.583 qpair failed and we were unable to recover it. 00:30:51.583 [2024-11-27 17:23:48.260810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.583 [2024-11-27 17:23:48.260901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.260926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.261045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.261268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.261558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.261784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.261917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.262042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.262302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.262519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.262740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.262917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.263009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.263269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.263496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.263772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.263888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.263982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.264210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.264472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.264691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.264835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.264957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.265209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.265475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.265699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.265847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.265965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.266211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.266453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.266683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.266899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.266987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.267012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.584 qpair failed and we were unable to recover it. 00:30:51.584 [2024-11-27 17:23:48.267108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.267197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.584 [2024-11-27 17:23:48.267228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.267379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.267532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.267558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.267682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.267805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.267830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.267948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.268215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.268483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.268757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.268876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.268992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.269227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.269467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.269667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.269814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.269945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.270177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.270381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.270614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.270905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.270969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:51.585 [2024-11-27 17:23:48.271001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.271136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.271408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.271646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.271892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.271980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.272131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.272427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.272666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.272813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.272961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.273190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.273474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.273683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.273829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.273932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.274028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.274053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.274147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.274237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.274262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.585 qpair failed and we were unable to recover it. 00:30:51.585 [2024-11-27 17:23:48.274410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.585 [2024-11-27 17:23:48.274540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.274566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.274711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.274828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.274853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.274983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.275226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.275501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.275805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.275944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.276034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.276309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.276535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.276774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.276888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.277036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.277236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.277485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.277715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.277852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.277943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.278180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.278420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.278717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.278837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.278935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.279196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.279442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.279761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.279897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.279994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.280237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.280474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.280726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.280859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.280953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.281045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.281072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.586 [2024-11-27 17:23:48.281166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.281286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.586 [2024-11-27 17:23:48.281311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.586 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.281436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.281584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.281610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.281734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.281862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.281888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.281978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.282248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.282498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.282813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.282932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.283071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.283361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.283584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.283830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.283968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.284085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.284316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.284561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.284795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.284944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.285099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.285394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.285640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.285866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.285978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.286096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.286351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.286568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.286835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.286982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.287103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.287335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.287609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.287868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.287991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.288145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.288416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.587 qpair failed and we were unable to recover it. 00:30:51.587 [2024-11-27 17:23:48.288664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.587 [2024-11-27 17:23:48.288765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.288790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.288915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.289243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.289487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.289739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.289853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.289945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.290236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.290456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.290725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.290841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.290938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.291204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.291470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.291745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.291893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.292017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.292284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.292535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.292747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.292920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.293070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.293365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.293656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.293829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.293930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.294228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.294498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.294784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.294906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.588 [2024-11-27 17:23:48.295000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.295118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.588 [2024-11-27 17:23:48.295143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.588 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.295264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.295565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.295825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.295946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.296096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.296338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.296563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.296854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.296977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.297072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.297288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.297611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.297756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.297862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.298127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.298391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.298627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.298855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.298972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.299070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.299281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.299518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.299823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.299968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.300106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.300378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.300626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.300802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.300926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.301186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.301438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.301652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.301795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.589 [2024-11-27 17:23:48.301885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.302003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.589 [2024-11-27 17:23:48.302028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.589 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.302154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.302394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.302670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.302908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.302994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.303113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.303412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.303673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.303796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.303916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.304200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.304473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.304690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.304807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.304923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.305164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.305458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.305707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.305827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.305946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.306199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.306468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.306704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.306820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.306925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.307163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.307395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.307671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.307788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.307889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.308188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.308433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.308685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.308829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.308925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.309076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.309102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.590 [2024-11-27 17:23:48.309230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.309375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.590 [2024-11-27 17:23:48.309400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.590 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.309532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.309630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.309656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.309750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.309873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.309898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.309995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.310273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.310519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.310794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.310936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.311032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.311273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.311542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.311795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.311979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.312101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.312424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.312732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.312881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.313005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.313274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.313520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.313797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.313916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.314042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.314366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.314647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.314797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.314926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.315188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.315396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.315640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.315785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.315909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.316164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.316414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.316698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.316817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.591 qpair failed and we were unable to recover it. 00:30:51.591 [2024-11-27 17:23:48.316940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.317090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.591 [2024-11-27 17:23:48.317115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.317240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.317504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.317779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.317925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.318046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.318312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.318586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.318834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.318973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.319101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.319351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.319626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.319774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.319899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.320127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.320426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.320699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.320876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.321000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.321259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.321470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.321706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.321853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.321976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.322278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.322569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.322773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.322923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.323048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.323324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.323571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.323819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.323943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.324067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.324205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.324230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.324323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.324449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.324474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.592 qpair failed and we were unable to recover it. 00:30:51.592 [2024-11-27 17:23:48.324597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.592 [2024-11-27 17:23:48.324713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.324738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.324864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.324990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.325151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.325450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.325706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.325820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.325945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.326191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.326461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.326686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.326807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.326901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.327151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.327406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.327669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.327834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.327954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.328226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.328464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.328696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.328843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.328967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.329159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.329445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.329689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.329838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.329961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.330239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.330492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.330769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.330942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.593 qpair failed and we were unable to recover it. 00:30:51.593 [2024-11-27 17:23:48.331039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.593 [2024-11-27 17:23:48.331135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.331259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.331502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.331770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.331924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.332021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.332287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.332531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.332976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.333067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.333295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.333540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.333755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.333901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.334024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.334310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.334591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.334831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.334953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.335079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.335326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.335631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.335780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.335882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.336181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.336401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.336649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.336877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.336999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.337120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.337365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.337588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.337852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.337987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.594 [2024-11-27 17:23:48.338082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.338228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.594 [2024-11-27 17:23:48.338253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.594 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.338343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.338442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.338469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.338592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.338739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.338765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.338868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.338994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.339111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.339356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.339573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.339818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.339959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.340111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.340405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.340719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.340860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.340955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.341223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.341471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.341752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.341896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.342019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.342277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.342572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.342811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.342960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.343053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.343362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.343605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.343832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.343954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.344052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.344327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.344573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.344836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.344994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.345020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.345115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.345239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.345265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.595 [2024-11-27 17:23:48.345359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.345480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.595 [2024-11-27 17:23:48.345506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.595 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.345607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.345727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.345753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.345887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.346152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.346403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.346662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.346907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.346998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.347122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.347322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.347557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.347861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.347990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.348133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.348422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.348670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.348817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.348942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.349207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.349421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.349702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.349828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.349921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.350169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.350432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.350658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.350805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.350930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.351183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.351393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.351634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.351898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.351985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.352011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.596 qpair failed and we were unable to recover it. 00:30:51.596 [2024-11-27 17:23:48.352107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.352230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.596 [2024-11-27 17:23:48.352255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.352351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.352444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.352469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.352615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.352742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.352767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.352886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.352976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.353152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.353393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.353671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.353790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.353906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.354162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.354401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.354645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.354898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.354997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.355120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.355415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.355633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.355899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.355982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.356139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.356349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.356641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.356793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.356922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.357191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.357412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.357643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.357791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.357915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.358207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.597 [2024-11-27 17:23:48.358408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.597 [2024-11-27 17:23:48.358516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.597 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.358651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.358775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.358799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.358887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.359153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.359387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.359598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.359842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.359987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.360113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.360388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.360666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.360882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.360999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.361116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.361337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.361553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.361680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.598 [2024-11-27 17:23:48.361770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361817] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:51.598 [2024-11-27 17:23:48.361841] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:51.598 [2024-11-27 17:23:48.361854] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:51.598 [2024-11-27 17:23:48.361858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.361911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:51.598 [2024-11-27 17:23:48.361978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:51.598 [2024-11-27 17:23:48.361977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:51.598 [2024-11-27 17:23:48.362076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.361981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:51.598 [2024-11-27 17:23:48.362101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.362227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.362446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.362712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.362840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.362955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.363171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.363371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.363618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.363846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.363959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.364086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.364339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.364561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.598 [2024-11-27 17:23:48.364677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.598 qpair failed and we were unable to recover it. 00:30:51.598 [2024-11-27 17:23:48.364765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.364879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.364904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.364999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.365224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.365471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.365744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.365889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.365982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.366187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.366426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.366662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.366874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.366999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.367112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.367387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.367608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.367869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.367980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.368074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.368288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.368555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.368783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.368899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.369018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.369279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.369484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.369710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.369835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.369930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.370202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.370435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.370687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.370800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.599 qpair failed and we were unable to recover it. 00:30:51.599 [2024-11-27 17:23:48.370919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.599 [2024-11-27 17:23:48.371039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.371152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.371439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.371657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.371867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.371992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.372115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.372322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.372543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.372779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.372891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.372986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.373203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.373419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.373647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.373868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.373979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.374105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.374323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.374554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.374783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.374934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.375059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.375276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.375482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.375711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.375860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.375988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.376224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.376463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.376680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.376800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.376923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.377138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.377346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.600 [2024-11-27 17:23:48.377465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.600 qpair failed and we were unable to recover it. 00:30:51.600 [2024-11-27 17:23:48.377593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.377690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.377715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.377806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.377898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.377923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.378018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.378251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.378500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.378735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.378852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.378939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.379162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.379408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.379678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.379795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.379951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.380168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.380420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.380644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.380870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.380993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.381074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.381315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.381568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.381802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.381916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.382017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.382226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.382452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.382664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.382894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.382982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.383135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.383359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.383568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.601 [2024-11-27 17:23:48.383798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.601 [2024-11-27 17:23:48.383917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.601 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.384058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.384317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.384579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.384825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.384946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.385044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.385270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.385476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.385706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.385851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.385944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.386184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.386415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.386632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.386866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.386980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.387075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.387340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.387585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.387847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.387964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.388064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.388298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.388503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.388726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.388880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.388999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.389250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.389509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.602 [2024-11-27 17:23:48.389750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.602 [2024-11-27 17:23:48.389889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.602 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.389978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.390191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.390397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.390628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.390837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.390978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.391109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.391349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.391608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.391818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.391926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.392016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.392254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.392451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.392701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.392824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.392971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.393190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.393418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.393683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.393897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.393991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.394135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.394342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.394562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.394762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.394906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.394999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.395193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.395405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.395655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.395864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.395984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.396009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.396114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.396204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.396230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.603 qpair failed and we were unable to recover it. 00:30:51.603 [2024-11-27 17:23:48.396322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.396430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.603 [2024-11-27 17:23:48.396454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.396546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.396638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.396662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.396776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.396867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.396891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.397007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.397266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.397470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.397711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.397823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.397951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.398154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.398392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.398601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.398807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.398931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.399028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.399239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.399466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.399676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.399881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.399998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.400113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.400315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.400559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.400796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.400938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.401041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.401234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.401499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.401771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.401915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.402013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.402249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.402475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.604 [2024-11-27 17:23:48.402627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.604 qpair failed and we were unable to recover it. 00:30:51.604 [2024-11-27 17:23:48.402760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.402846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.402870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.403011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.403253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.403462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.403698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.403826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.403972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.404193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.404424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.404681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.404819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.404937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.405155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.405421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.405717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.405833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.405925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.406146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.406449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.406778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.406934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.407034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.407296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.407600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.407833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.407980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.408077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.408327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.408571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.408887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.408984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.409129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.409334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.409604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.605 [2024-11-27 17:23:48.409827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.605 [2024-11-27 17:23:48.409953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.605 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.410047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.410264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.410508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.410755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.410917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.411045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.411325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.411564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.411779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.411944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.412041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.412292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.412522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.412784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.412910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.413006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.413283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.413505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.413745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.413867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.413968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.414177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.414418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.414664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.414883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.414998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.415311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.415517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.415770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.415921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.416016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.416291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.416496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.606 qpair failed and we were unable to recover it. 00:30:51.606 [2024-11-27 17:23:48.416720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.606 [2024-11-27 17:23:48.416807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.416840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.416942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.417183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.417428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.417656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.417900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.417992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.418109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.418308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.418575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.418777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.418928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.419026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.419234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.419457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.419741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.419887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.420002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.420217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.420472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.420684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.420840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.420965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.421172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.421411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.421679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.421791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.421922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.422019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.422045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.422137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.422226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.422251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.607 qpair failed and we were unable to recover it. 00:30:51.607 [2024-11-27 17:23:48.422346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.607 [2024-11-27 17:23:48.422468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.422493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.422597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.422708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.422733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.422824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.422918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.422944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.423065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.423310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.423562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.423779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.423888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.424009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.424482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.424713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.424833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.424921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.425151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.425406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.425676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.425895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.425981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.426134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.426347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.426585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.426825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.426941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.427031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.427288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.427501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.427759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.427872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.428017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.428216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.428456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.428732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.428880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.428980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.429079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.608 [2024-11-27 17:23:48.429102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.608 qpair failed and we were unable to recover it. 00:30:51.608 [2024-11-27 17:23:48.429202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.429467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.429722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.429848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.429952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.430157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.430426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.430666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.430876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.430980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.431131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.431379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.431597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.431843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.431965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.432052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.432270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.432530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.432807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.432965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.433053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.433320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.433554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.433776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.433933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.434023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.434228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.434481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.434788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.434914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.435012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.435255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.435457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.435734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.435847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.435971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.436091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.609 [2024-11-27 17:23:48.436117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.609 qpair failed and we were unable to recover it. 00:30:51.609 [2024-11-27 17:23:48.436210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.436415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.436644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.436879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.436994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.437099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.437354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.437642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.437764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.437895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.438132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.438379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.438615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.438886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.438976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.439091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.439354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.439571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.439801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.439967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.440068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.440317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.440606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.440874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.440987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.441085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.441321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.441581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.441779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.441948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.442069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.442290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.442523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.442784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.442911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.610 qpair failed and we were unable to recover it. 00:30:51.610 [2024-11-27 17:23:48.443041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.443157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.610 [2024-11-27 17:23:48.443182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.443280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.443518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.443758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.443908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.444009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.444225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.444424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.444678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.444827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.444913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.445124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.445352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.445585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.445794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.445912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.446007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.446253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.446488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.446692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.446810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.446923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.447162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.447394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.447633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.447771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.447901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.448156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.448402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.611 [2024-11-27 17:23:48.448522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.611 qpair failed and we were unable to recover it. 00:30:51.611 [2024-11-27 17:23:48.448622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.448721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.448744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.448849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.448963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.448986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.449069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.449280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.449520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.449738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.449847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.449992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.450249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.450496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.450755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.450884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.450974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.451185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.451392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.451631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.451875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.451987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.452102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.452342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.452591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.452835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.452941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.453033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.453275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.453503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.453740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.453851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.453941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.454159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.454422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.454646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.454852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.454968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.455065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.455307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.455506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.612 qpair failed and we were unable to recover it. 00:30:51.612 [2024-11-27 17:23:48.455738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.612 [2024-11-27 17:23:48.455841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.455867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.455981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.456225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.456491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.456730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.456841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.456945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.457179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.457441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.457651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.457856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.457978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.458100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.458307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.458557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.458769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.458916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.459021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.459261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.459480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.459709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.459860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.459984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.460242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.460459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.460677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.460881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.460995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.461089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.461339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.461564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.461777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.461898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.461992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.462230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.462497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.462712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.462867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.613 qpair failed and we were unable to recover it. 00:30:51.613 [2024-11-27 17:23:48.462963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.613 [2024-11-27 17:23:48.463082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.463192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.463415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.463612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.463843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.463954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.464075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.464288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.464547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.464754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.464884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.464976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.465182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.465413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.465694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.465807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.465930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.466142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.466397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.466625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.466853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.466957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.467054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.467288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.467482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.467719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.467839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.467934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.468166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.468399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.468613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.468811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.468915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.469011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.469246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.469471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.469727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.469836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.614 qpair failed and we were unable to recover it. 00:30:51.614 [2024-11-27 17:23:48.469931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.470013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.614 [2024-11-27 17:23:48.470037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.470124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.470331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.470571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.470781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.470923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.471010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.471241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.471472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.471680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.471909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.471999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.472112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.472365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.472585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.472792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.472966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.473056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.473260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.473464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.473665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.473799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.473925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.474126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.474331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.474614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.474858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.474976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.475089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.475334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.475566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.475774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.475893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.475986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.476183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.476414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.476682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.476904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.476991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.477016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.477143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.477257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.477283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.615 qpair failed and we were unable to recover it. 00:30:51.615 [2024-11-27 17:23:48.477385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.615 [2024-11-27 17:23:48.477481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.477506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.477615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.477711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.477736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.477852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.477943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.477967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.478061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.478290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.478522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.478737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.478860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.478957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.479192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.479433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.479649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.479885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.479997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.480087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.480333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.480543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.480768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.480873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.480962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.481175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.481385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.616 [2024-11-27 17:23:48.481616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.616 [2024-11-27 17:23:48.481726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.616 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.481815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.481950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.481974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.482058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.482258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.482442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.482665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.482868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.482980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.483068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.483302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.483500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.483706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.483868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.483960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.484206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.484406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.484663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.484774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.484904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.485134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.485366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.485594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.485833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.485941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.486031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.486272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.486505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.486729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.486844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.486933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.487156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.487383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.617 [2024-11-27 17:23:48.487492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.617 qpair failed and we were unable to recover it. 00:30:51.617 [2024-11-27 17:23:48.487586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.487684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.487708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.487808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.487904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.487927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.488017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.488208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.488417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.488647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.488786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.488909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.489120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.489321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.489565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.489805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.489914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.490012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.490247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.490470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.490748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.490870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.490961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.491251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.491488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.491752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.491885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.491988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.492222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.492474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.492730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.492843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.492960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.493201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.493435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.493676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.493800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.618 qpair failed and we were unable to recover it. 00:30:51.618 [2024-11-27 17:23:48.493891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.618 [2024-11-27 17:23:48.494021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.901 [2024-11-27 17:23:48.494045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.901 qpair failed and we were unable to recover it. 00:30:51.901 [2024-11-27 17:23:48.494141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.901 [2024-11-27 17:23:48.494234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.901 [2024-11-27 17:23:48.494260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.901 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.494364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.494508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.494565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.494660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.494743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.494768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.494889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.494979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.495101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.495345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.495619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.495793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.495912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.496216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.496492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.496755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.496890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.496990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.497305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.497580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.497849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.497987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.498113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.498357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.498573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.498809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.498945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.499037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.499362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.499577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.499788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.499903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.500025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.500218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.500408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.500638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.500901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.500986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.501010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.501137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.501223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.902 [2024-11-27 17:23:48.501247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.902 qpair failed and we were unable to recover it. 00:30:51.902 [2024-11-27 17:23:48.501332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.501560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.501769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.501894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.501983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.502210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.502423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.502640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.502859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.502969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.503071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.503312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.503499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.503729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.503846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.503946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.504153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.504383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.504664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.504909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.504996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.505112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.505317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.505518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.505763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.505880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.506010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.506204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.506404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.506649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.506761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.506886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.507143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.507341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.903 qpair failed and we were unable to recover it. 00:30:51.903 [2024-11-27 17:23:48.507621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.903 [2024-11-27 17:23:48.507711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.507736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.507877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.507969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.507993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.508109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.508314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.508515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.508757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.508874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.508993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.509270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.509466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.509710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.509824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.509925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.510188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.510415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.510625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.510842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.510948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.511046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.511248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.511456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.511665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.511818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.511909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.512144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.512410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.512614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.512821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.512934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.513058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.513289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.513522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.513730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.513887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.513976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.514062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.514086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.904 qpair failed and we were unable to recover it. 00:30:51.904 [2024-11-27 17:23:48.514180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.904 [2024-11-27 17:23:48.514262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.514424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.514639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.514844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.514987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.515077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.515337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.515547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.515780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.515924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.516014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.516247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.516447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.516672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.516905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.516994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.517113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.517346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.517597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.517840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.517984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.518094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.518290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.518522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.518728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.518838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.518927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.519156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.519379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.519624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.519820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.519940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.520051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.520248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.905 [2024-11-27 17:23:48.520473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.905 [2024-11-27 17:23:48.520589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.905 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.520678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.520768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.520791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.520882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.520969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.520994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.521090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.521291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.521537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.521739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.521858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.521952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.522206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.522393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.522617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.522827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.522937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.523050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.523259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.523550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.523782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.523897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.523994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.524232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.524477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.524674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.524796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.524915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.525129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.525376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.525603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.525848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.525960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.906 qpair failed and we were unable to recover it. 00:30:51.906 [2024-11-27 17:23:48.526055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.906 [2024-11-27 17:23:48.526177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.526302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.526507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.526750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.526898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.526989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.527224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.527423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.527872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.527987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.528075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.528280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.528518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.528718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.528832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.528923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.529180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.529447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.529679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.529795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.529881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.530145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.530361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.530576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.530772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.530897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.531013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.531220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.531447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.531647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.531861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.531980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.532096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.532302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.907 qpair failed and we were unable to recover it. 00:30:51.907 [2024-11-27 17:23:48.532570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.907 [2024-11-27 17:23:48.532657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.532680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.532774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.532902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.532926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.533015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.533222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.533418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.533673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.533789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.533916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.534146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.534380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.534625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.534828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.534965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.535055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.535293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.535559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.535797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.535907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.536029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.536349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.536594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.536792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.536941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.537035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.537244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.537498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.537737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.537880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.537969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.538232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.538459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.538696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.538804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.538895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.539016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.539040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.539137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.539251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.539275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.908 qpair failed and we were unable to recover it. 00:30:51.908 [2024-11-27 17:23:48.539356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.908 [2024-11-27 17:23:48.539438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.539462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.539577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.539669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.539694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.539791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.539917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.539941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.540035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.540341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.540579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.540810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.540949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.541121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.541370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.541617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.541865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.541979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.542072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.542271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.542517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.542851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.542964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.543065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.543310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.543591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.543823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.543935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.544056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.544283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.544586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.544793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.544906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.545029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.545236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.545423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.545628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.545835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.545954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.546043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.546167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.546191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.909 qpair failed and we were unable to recover it. 00:30:51.909 [2024-11-27 17:23:48.546303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.909 [2024-11-27 17:23:48.546385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.546409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.546510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.546627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.546652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.546770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.546854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.546877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.546968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.547200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.547426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.547663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.547895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.547986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.548133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.548359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.548611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.548806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.548983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.549073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.549271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.549502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.549723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.549834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.549930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.550166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.550425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.550669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.550894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.550987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.551102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.551309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.551509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.551795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.551905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.552006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.552213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.552404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.552654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.552768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.910 qpair failed and we were unable to recover it. 00:30:51.910 [2024-11-27 17:23:48.552865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.910 [2024-11-27 17:23:48.553008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.553113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.553315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.553562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.553798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.553908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.554090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.554329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.554581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.554853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.554962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.555055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.555247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.555464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.555660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.555867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.555978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.556090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.556319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.556532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.556732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.556841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.556963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.557192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.557402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.557650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.557805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.557906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.558141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.558373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.558629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.911 [2024-11-27 17:23:48.558736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.911 qpair failed and we were unable to recover it. 00:30:51.911 [2024-11-27 17:23:48.558878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.558981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.559096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.559310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.559553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.559763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.559913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.560011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.560211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.560479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.560704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.560849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.560971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.561205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.561415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.561655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.561856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.561962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.562082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.562291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.562495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.562772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.562892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.562982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.563221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.563504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.563762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.563909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.564003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.564209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.564454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.564696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.564811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.564898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.565194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.565436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.912 [2024-11-27 17:23:48.565572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.912 qpair failed and we were unable to recover it. 00:30:51.912 [2024-11-27 17:23:48.565667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.565767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.565791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.565885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.565972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.566104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.566356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.566671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.566910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.566998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.567170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.567402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.567620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.567879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.567977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.568100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.568461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.568707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.568846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.569042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.569264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.569471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.569712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.569871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.569973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.570175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.570386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.570647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.570898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.570987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.571145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.571403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.571624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.571849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.571965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.572052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.572291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.572492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.913 [2024-11-27 17:23:48.572722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.913 qpair failed and we were unable to recover it. 00:30:51.913 [2024-11-27 17:23:48.572837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.572968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.572994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.573113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.573346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.573708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.573827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.573952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.574185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.574638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.574842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.574978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.575075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.575400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.575611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.575904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.575990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.576140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.576417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.576626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.576867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.576976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.577063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.577283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.577487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.577742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.577888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.577974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.578165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.578375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.578617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.578911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.578997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.579106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.579307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.914 qpair failed and we were unable to recover it. 00:30:51.914 [2024-11-27 17:23:48.579540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.914 [2024-11-27 17:23:48.579658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.579683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.579771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.579920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.579944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.580043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.580279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.580496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.580751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.580865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.580954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.581205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.581445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.581658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.581771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.581899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.582134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.582369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.582627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.582869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.582999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.583136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.583370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.583587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.583786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.583899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.583983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.584182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.584414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.584667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.584902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.584991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.585101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.585293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.915 qpair failed and we were unable to recover it. 00:30:51.915 [2024-11-27 17:23:48.585517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.915 [2024-11-27 17:23:48.585673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.585767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.585859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.585884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.585975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.586214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.586416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.586632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.586856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.586943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.587209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.587443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.587651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.587859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.587967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.588059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.588292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.588533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.588750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.588871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.588990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.589216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.589413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.589630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.589864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.589977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.590066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.590267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.590470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.590685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.590795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.590886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.591114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.591309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.591530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.591780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.591898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.916 qpair failed and we were unable to recover it. 00:30:51.916 [2024-11-27 17:23:48.591995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.916 [2024-11-27 17:23:48.592074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.592188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.592418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.592686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.592827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.593027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.593268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.593500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.593715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.593857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.594010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.594209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.594413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.594665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.594871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.594978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.595090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.595292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.595495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.595754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.595863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.595980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.596188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.596499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.596737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.596871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.596962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.597170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.597387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.597613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.597854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.597979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.598083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.598277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.598508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.917 qpair failed and we were unable to recover it. 00:30:51.917 [2024-11-27 17:23:48.598764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.917 [2024-11-27 17:23:48.598847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.598871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.598986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.599181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.599390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.599670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.599831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.599957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.600168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.600376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.600598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.600822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.600964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.601061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.601266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.601505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.601724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.601843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.601931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.602187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.602417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.602643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.602864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.602969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.603071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.603269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.603510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.603717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.603861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.603957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.604165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.604370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.604612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.604820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.604932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.605015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.605101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.605125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.918 qpair failed and we were unable to recover it. 00:30:51.918 [2024-11-27 17:23:48.605272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.918 [2024-11-27 17:23:48.605370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.605394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.605483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.605577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.605602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.605720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.605920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.605944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.606060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.606313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.606551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.606748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.606859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.606952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.607161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.607394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.607607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.607823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.607966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.608088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.608392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.608620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.608834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.608947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.609037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.609385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.609695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.609839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.609934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.610138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.610336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.610552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.610753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.610863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.611223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.611430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.611645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.611852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.611972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.919 qpair failed and we were unable to recover it. 00:30:51.919 [2024-11-27 17:23:48.612093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.612180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.919 [2024-11-27 17:23:48.612204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.612300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.612503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.612742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.612854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.612937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.613157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.613386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.613620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.613867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.613981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.614094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.614409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.614659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.614899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.614986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.615209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.615447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.615675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.615790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.615918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.616119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.616323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.616533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.616767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.616907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.617033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.617232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.617462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.617676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.617789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.617918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.618011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.618036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.920 qpair failed and we were unable to recover it. 00:30:51.920 [2024-11-27 17:23:48.618135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.920 [2024-11-27 17:23:48.618255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.618368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.618590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.618823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.618991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.619075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.619390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.619666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.619870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.619987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.620070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.620301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.620508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.620749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.620863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.620954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.621186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.621417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.621648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.621861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.621979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.622082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.622322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.622552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.622805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.622920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.623016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.623249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.623450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.623733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.623855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.623946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.624176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.624434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.624645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.921 [2024-11-27 17:23:48.624770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.921 qpair failed and we were unable to recover it. 00:30:51.921 [2024-11-27 17:23:48.624869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.624958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.624985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.625074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.625282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.625516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.625779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.625896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.625982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.626183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.626410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94f4000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.626699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.626835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.626932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.627130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.627334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.627663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.627778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.627975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.628236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.628432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.628851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.628991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.629071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.629266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.629466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.629779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.629924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.630016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.630246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.630460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.630734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.630850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.630976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.631209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.631414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.922 [2024-11-27 17:23:48.631536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.922 qpair failed and we were unable to recover it. 00:30:51.922 [2024-11-27 17:23:48.631624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.631715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.631740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.631833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.631956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.631980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.632071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.632342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f94ec000b90 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.632567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.632783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.632886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.633004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.633215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.633414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.633653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.633767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.633887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.634141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.634370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.634607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.634845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.634955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.635052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.635259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.635462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.635670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.635872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.635977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.636064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.636291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.636643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.636879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.636994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.637080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.637326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.637534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.637742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.637852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.923 qpair failed and we were unable to recover it. 00:30:51.923 [2024-11-27 17:23:48.637936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.923 [2024-11-27 17:23:48.638021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.638166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.638377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.638692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.638802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.638887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.639148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.639375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.639617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.639737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.639933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.640189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.640399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.640620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.640819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.640930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.641016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.641264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.641547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.641759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.641898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.641988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.642192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.642408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.642650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.642767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.642859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.643168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.643423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.643649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.643844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.643962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.924 qpair failed and we were unable to recover it. 00:30:51.924 [2024-11-27 17:23:48.644054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.924 [2024-11-27 17:23:48.644179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.644519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.644728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.644874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.644998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.645200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.645430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.645651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.645761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.645961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.646148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.646415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.646634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.646867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.646986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.647115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.647307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.647530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.647758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.647866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.647957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.648149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.648349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.648636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.648852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.648992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.649114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.649332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.649562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.649773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.649891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.649975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.650178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.650418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.925 qpair failed and we were unable to recover it. 00:30:51.925 [2024-11-27 17:23:48.650654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.925 [2024-11-27 17:23:48.650754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.650778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.650868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.650957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.650981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.651071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.651302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.651537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.651749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.651891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.651985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.652186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.652417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.652696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.652833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.652927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.653128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.653341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.653617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.653822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.653963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.654061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.654300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.654555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.654805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.654915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.655031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.655227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.655430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.655645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.655846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.655981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.656070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.656286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.656519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.656755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.656862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.656960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.657047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.657071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.926 qpair failed and we were unable to recover it. 00:30:51.926 [2024-11-27 17:23:48.657266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.926 [2024-11-27 17:23:48.657362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.657386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.657510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.657602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.657627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.657717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.657801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.657829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.657911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.658117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.658321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.658569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.658763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.658933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.659025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.659231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.659543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.659797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.659948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.660144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.660416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.660634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.660872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.660988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.661076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.661313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.661547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.661779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.661997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.662118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.662326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.662533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.662729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.662843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.662962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.663163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.663357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.663589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.663830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.663940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.927 qpair failed and we were unable to recover it. 00:30:51.927 [2024-11-27 17:23:48.664033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.927 [2024-11-27 17:23:48.664120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.664232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.664456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.664662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.664803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.664895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.665168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.665476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.665687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.665833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.665919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.666162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.666395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.666629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.666867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.666983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.667073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.667302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.667546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.667753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.667971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.668061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.668257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.668480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.668700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.668849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.668930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.669126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.669391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.669630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.669848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.669966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.670081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.670283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.670642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.928 qpair failed and we were unable to recover it. 00:30:51.928 [2024-11-27 17:23:48.670849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.928 [2024-11-27 17:23:48.670943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.670967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.671080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.671318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.671522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.671665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.671862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.672117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.672312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.672634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.672842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.672984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.673106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.673315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.673530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.673738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.673847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.673942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.674175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.674373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.674593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.674801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.674913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.675030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.675263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.675493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.675702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.675813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.675902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.676126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.676349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.676547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.929 qpair failed and we were unable to recover it. 00:30:51.929 [2024-11-27 17:23:48.676843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.929 [2024-11-27 17:23:48.676930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.676955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.677071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.677299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.677567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.677789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.677900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.677993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.678200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.678426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.678687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.678798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.678892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.679201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.679435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.679640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.679873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.679990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.680090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.680312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.680542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.680776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.680897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.681012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.681209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.681415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.681629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.681836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.681950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.682035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.682260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.682469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.682667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.682805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.682897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.683135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.930 qpair failed and we were unable to recover it. 00:30:51.930 [2024-11-27 17:23:48.683357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.930 [2024-11-27 17:23:48.683471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.683562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.683647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.683671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.683764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.683875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.683899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.683996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.684189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.684418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.684652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.684798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.684932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.685133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.685337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.685542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.685766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.685877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.685975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.686178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.686412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.686665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.686803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.686925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.687130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.687362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.687568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.687781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.687898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.687992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.688222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.688497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.688738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.688857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.688949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.689214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.689480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.689697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.931 qpair failed and we were unable to recover it. 00:30:51.931 [2024-11-27 17:23:48.689910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.689997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.931 [2024-11-27 17:23:48.690022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.690102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.690294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.690554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.690764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.690876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.690976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.691180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.691414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.691665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.691904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.691994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.692113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.692339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.692549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.692749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.692869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.692961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.693160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.693389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.693668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.693874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.693993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.694110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.694351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.694559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.694761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.694897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.694982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.695237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.695429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.695655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.695884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.695976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.696000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.696115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.696198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.696222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.932 qpair failed and we were unable to recover it. 00:30:51.932 [2024-11-27 17:23:48.696308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.696396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.932 [2024-11-27 17:23:48.696421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.696513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.696609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.696634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.696752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.696839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.696863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.696980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.697209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.697418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.697670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.697879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.697987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.698114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.698349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.698594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.698826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.698942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.699075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.699308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.699498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.699748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.699856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.699976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.700178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.700380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.700592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.700824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.700961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.701048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.701243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.701445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.701645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.701875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.701979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.933 [2024-11-27 17:23:48.702003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.933 qpair failed and we were unable to recover it. 00:30:51.933 [2024-11-27 17:23:48.702147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.702383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.702592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.702817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.702930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.703022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.703281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.703515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.703735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.703878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.703969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.704178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.704401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.704602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.704839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.704953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.705039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.705233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.705432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.705676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.705793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.705889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.706129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.706366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.706613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.706863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.706995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.707135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.707335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.707571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.707776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.707885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.707996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.708291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.708491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.934 [2024-11-27 17:23:48.708616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.934 qpair failed and we were unable to recover it. 00:30:51.934 [2024-11-27 17:23:48.708704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.708796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.708821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.708944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.709179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.709465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.709668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.709866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.709979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.710095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.710335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.710556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.710780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.710887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.711007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.711256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.711492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.711723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.711875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.712007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.712247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.712487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.712697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.712838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.712926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.713156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.713417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.713626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.713833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.713946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.714032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.714270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.714546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.714752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.714890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.714984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.715070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.715094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.715190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.715291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.935 [2024-11-27 17:23:48.715316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.935 qpair failed and we were unable to recover it. 00:30:51.935 [2024-11-27 17:23:48.715414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.715505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.715534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.715625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.715756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.715780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.715896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.715989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.716167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.716371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.716642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.716796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.716927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.717158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.717394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.717606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.717813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.717917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.718037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.718310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.718555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.718778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.718887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.718973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.719172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.719412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.719619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.719858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.719975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.720071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.720275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.720469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.720694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.720886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.720996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.721093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.721325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.721533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.721758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.936 [2024-11-27 17:23:48.721870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.936 qpair failed and we were unable to recover it. 00:30:51.936 [2024-11-27 17:23:48.721991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.722245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.722459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.722693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.722838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.722938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.723169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.723403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.723608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.723846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.723966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.724066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.724302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.724563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.724803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.724918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.725051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.725262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.725507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.725724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.725834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.725954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.726196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.726435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.726675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.726873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.726987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.727067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.727265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.727515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.727725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.727864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.727958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.728159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.728365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.937 [2024-11-27 17:23:48.728477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.937 qpair failed and we were unable to recover it. 00:30:51.937 [2024-11-27 17:23:48.728596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.728685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.728710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.728794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.728880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.728906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.729027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.729298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.729505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.729735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.729873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.729966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.730205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.730397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.730671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.730779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.730875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.731121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.731344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.731554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.731786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.731897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.732014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.732259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.732491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.732700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.732842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.732963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.733168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.733366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.733582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.733818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.733928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.734025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.734110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.734134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.734248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.734332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.734356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.938 qpair failed and we were unable to recover it. 00:30:51.938 [2024-11-27 17:23:48.734447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.938 [2024-11-27 17:23:48.734644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.734669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.734764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.734850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.734873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.734988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.735234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.735430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.735651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.735851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.735964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.736089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.736300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.736531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.736750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.736894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.736985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.737212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.737409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.737650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.737879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.737990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.738108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.738311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.738583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.738788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.738929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.739025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.739271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.739509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.739764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.739882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.740002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.740233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.740459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.740669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.740881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.740998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.939 [2024-11-27 17:23:48.741022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.939 qpair failed and we were unable to recover it. 00:30:51.939 [2024-11-27 17:23:48.741110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.741314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.741553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.741792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.741933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.742021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.742278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.742480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.742676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.742920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.742998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.743112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.743311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.743547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.743786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.743900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.743996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.744229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.744467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.744766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.744905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.745025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.745233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.745427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.745636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.745836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.745988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.746111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.746311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.746553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.746768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.746892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.746988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.747227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.747481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.940 [2024-11-27 17:23:48.747602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.940 qpair failed and we were unable to recover it. 00:30:51.940 [2024-11-27 17:23:48.747692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.747783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.747807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.747926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.748118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.748327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.748559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.748767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.748906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.749010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.749246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.749461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.749673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.749846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.749936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.750345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.750584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.750852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.750965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.751082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.751284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.751530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.751742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.751858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.752008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.752241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.752443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.752648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.752856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.752985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.753097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.753291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.753512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.753761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.753903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.753993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.754081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.941 [2024-11-27 17:23:48.754107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.941 qpair failed and we were unable to recover it. 00:30:51.941 [2024-11-27 17:23:48.754199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.754431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.754650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.754861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.754976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.755085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.755317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.755538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.755771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.755886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.755978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.756175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.756367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.756582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.756791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.756926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.757013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.757212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.757415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.757649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.757863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.757979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.758076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.758283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.758517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.758731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.758845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.758927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.759157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.759359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.759593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.942 [2024-11-27 17:23:48.759741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.942 qpair failed and we were unable to recover it. 00:30:51.942 [2024-11-27 17:23:48.759863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.759954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.759978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.760069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.760304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.760512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.760753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.760869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.760953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.761186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.761404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.761609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.761848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.761974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.762062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.762260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.762521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.762762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.762868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.762994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.763188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.763431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.763678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.763896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.763980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.764098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.764298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.764529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.764727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.764848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.764937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.765163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.765354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.765594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.765797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.765917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.943 [2024-11-27 17:23:48.766012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.766105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.943 [2024-11-27 17:23:48.766129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.943 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.766212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.766420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.766644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.766881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.766994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.767108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.767308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.767540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.767769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.767894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.768014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.768252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.768478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.768711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.768838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.768926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.769130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.769375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.769629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.769831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.769946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.770064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.770320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.770577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.770810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.770924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.771020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.771247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.771481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.771694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.771806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.771898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.772128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.772320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.944 qpair failed and we were unable to recover it. 00:30:51.944 [2024-11-27 17:23:48.772628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.944 [2024-11-27 17:23:48.772719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.772743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.772875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.772965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.772990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.773140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.773348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.773594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.773793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.773917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.774007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.774248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.774470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.774742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.774890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.774978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.775188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.775392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.775610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.775860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.775974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.776068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.776282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.776478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.776713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.776822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.776913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.777178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.777375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.777615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.777822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.777969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.778094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.778329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.778540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.778736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.778840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.778928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.779192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.945 qpair failed and we were unable to recover it. 00:30:51.945 [2024-11-27 17:23:48.779417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.945 [2024-11-27 17:23:48.779538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.779624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.779745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.779770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.779884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.779971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.779996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.780089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.780301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.780571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.780888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.780982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.781197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.781425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.781666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.781877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.781998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.782155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.782368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.782581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.782780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.782895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.782991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.783227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.783427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.783731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.783846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.783938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.784178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.784417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.784639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.784891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.784982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.785095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.785297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.785534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.785750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.785890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.785977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.786185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.786433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.946 [2024-11-27 17:23:48.786555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.946 qpair failed and we were unable to recover it. 00:30:51.946 [2024-11-27 17:23:48.786644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.786794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.786818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.786907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.786996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.787118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.787337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.787618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.787847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.787962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.788056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.788285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.788501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.788707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.788824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.788911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.789151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.789404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.789679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.789821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.789909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.790145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.790384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.790623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.790865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.790976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.791069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.791269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.791512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.791754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.791898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.792011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.792235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.947 [2024-11-27 17:23:48.792476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.947 [2024-11-27 17:23:48.792591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.947 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.792680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.792775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.792799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.792889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.793130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.793358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.793638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.793872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.793988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.794099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.794337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.794575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.794808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.794925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.795018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.795276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.795507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.795757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.795903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.795993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.796188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.796393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.796668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.796875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.796987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.797079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.797327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.797569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.797777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.797927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.798010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.798100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.798124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.948 qpair failed and we were unable to recover it. 00:30:51.948 [2024-11-27 17:23:48.798246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.948 [2024-11-27 17:23:48.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.798383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.798487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.798607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.798632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.798763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.798846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.798870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.798991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.799230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.799441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.799654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.799973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.800065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.800272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.800583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.800812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.800956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.801070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.801268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.801542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.801749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.801906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.802006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.802241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.802467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.802701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.802814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.802940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.803140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.803380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.803608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.803826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.803937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.804019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.804249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.804450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.804666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.804869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.804979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.805100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.805371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.805578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.949 [2024-11-27 17:23:48.805769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.949 [2024-11-27 17:23:48.805879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.949 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.805973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.806223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.806421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.806676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.806816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.806937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.807166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.807396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.807634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.807876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.807985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.808076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.808330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.808540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.808741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.808852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.808973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.809249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.809466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.809668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.809873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.809983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.810106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.810349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.810557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.810751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.810868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.810960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.811155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.811357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.811568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.811769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.811887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.811982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.812204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.812403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.812613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.812870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.812986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.813075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.813185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.813209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.950 qpair failed and we were unable to recover it. 00:30:51.950 [2024-11-27 17:23:48.813304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.950 [2024-11-27 17:23:48.813387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.813411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.813499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.813604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.813630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.813756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.813839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.813864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.813985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.814212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.814442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.814641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.814870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.814992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.815111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.815352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.815577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.815770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.815927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.816017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.816231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.816429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.816657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.816855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.816966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.817060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.817291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.817492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.817699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.817817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.817903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.818189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.818415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.818626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.818876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.818990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.819083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.819298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.819556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.951 qpair failed and we were unable to recover it. 00:30:51.951 [2024-11-27 17:23:48.819762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.951 [2024-11-27 17:23:48.819882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.819907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.820000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.820204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.820475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.820701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.820897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.820983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.821095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.821294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.821510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.821750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.821889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.822008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.822246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.822532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.822768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.822909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.823260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.823501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.823714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.823865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.823952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.824184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.824442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.824675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.824796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.824897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.825179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.825403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.825649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.825794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.825891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.826141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:51.952 [2024-11-27 17:23:48.826377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.952 [2024-11-27 17:23:48.826515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:51.952 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.826628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.826727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.826758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.826854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.826942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.826967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.827056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.827281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.827564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.827831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.827963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.828074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.828368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.828667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.828798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.828954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.829090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.829123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.829245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.829386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.829424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.236 qpair failed and we were unable to recover it. 00:30:52.236 [2024-11-27 17:23:48.829542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.236 [2024-11-27 17:23:48.829645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.829681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.829823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.829962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.830143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.830426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.830704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.830817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.830907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.831146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.831347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.831612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.831813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.831932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.832041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.832238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.832431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.832716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.832879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.832969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.833175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.833370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.833604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.833833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.833988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.834107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.834312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.834545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.834757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.834877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.834970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.835231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.835469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.835665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.835866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.835983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.836081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.836177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.237 [2024-11-27 17:23:48.836202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.237 qpair failed and we were unable to recover it. 00:30:52.237 [2024-11-27 17:23:48.836303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.836533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.836775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.836896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.837016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.837215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.837451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.837668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.837866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.837976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.838067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.838297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.838548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.838744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.838860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.838960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.839155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.839406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.839648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.839843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.839964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.840050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.840255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.840479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.840746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.840880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.840961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.841170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.841404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.841615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.841844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.841962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.842054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.842137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.842161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.842253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.842336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.238 [2024-11-27 17:23:48.842360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.238 qpair failed and we were unable to recover it. 00:30:52.238 [2024-11-27 17:23:48.842476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.842566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.842589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.842715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.842805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.842829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.842959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.843152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.843390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.843617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.843823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.843967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.844062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.844313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.844512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.844727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.844848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.845007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.845210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.845439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.845678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.845888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.845977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.846115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.846365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.846612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.846817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.846927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.847048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.847288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.847481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.847698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.847908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.847993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.848120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.848340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.848578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.239 [2024-11-27 17:23:48.848783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.239 [2024-11-27 17:23:48.848938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.239 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.849029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.849232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.849444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.849646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.849790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.849893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.850113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.850332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.850553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.850760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.850872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.850991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.851217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.851432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.851660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.851861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.851972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.852066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.852286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.852516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.852779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.852924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.853011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.853252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.853487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.853726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.853835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.853922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.854154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.854355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.854569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.854784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.854898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.854988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.855069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.855092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.240 qpair failed and we were unable to recover it. 00:30:52.240 [2024-11-27 17:23:48.855211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.855297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.240 [2024-11-27 17:23:48.855321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.855408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.855660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.855872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.855987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.856072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.856257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.856481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.856685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.856804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.856926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.857151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.857444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.857671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.857780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.857899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.858184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.858426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.858635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.858837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.858960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.859074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.859298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.859500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.859854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.859944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.860143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.860378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.241 qpair failed and we were unable to recover it. 00:30:52.241 [2024-11-27 17:23:48.860684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.241 [2024-11-27 17:23:48.860767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.860792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.860939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.861142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.861371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.861576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.861791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.861929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.862020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.862262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.862465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.862705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.862823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.862945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.863146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.863406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.863638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.863867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.863983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.864100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.864320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.864533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.864733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.864873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.864964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.865177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.865379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.865597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.865797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.865903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.865992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.866221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.866454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.866656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.866849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.866958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.242 qpair failed and we were unable to recover it. 00:30:52.242 [2024-11-27 17:23:48.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.242 [2024-11-27 17:23:48.867164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.867274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.867535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.867724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.867835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.867928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.868151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.868412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.868686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.868887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.868998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.869080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.869327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.869557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.869759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.869880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.869966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.870257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.870461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.870678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.870788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.870893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.871156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.871363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.871571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.871772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.871879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.871999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.872204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.872441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.872673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.872883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.872999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.873116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.873228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.873252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.873345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.873461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.873486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.243 qpair failed and we were unable to recover it. 00:30:52.243 [2024-11-27 17:23:48.873584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.243 [2024-11-27 17:23:48.873672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.873695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.873777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.873922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.873946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.874039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.874266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.874513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.874727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.874838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.874926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.875158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.875421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.875624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.875814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.875927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.876016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.876225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.876453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.876666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.876867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.876985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.877070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.877303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.877513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.877759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.877893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.878010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.878235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.878466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.878707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.878907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.878996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.879112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.879307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.879534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.879775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.879890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.244 qpair failed and we were unable to recover it. 00:30:52.244 [2024-11-27 17:23:48.879977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.244 [2024-11-27 17:23:48.880058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.880164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.880384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.880622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.880813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.880987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.881075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.881304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.881582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.881770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.881910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.882001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.882242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.882476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.882680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.882787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.882881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.883169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.883397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.883634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.883852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.883961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.884050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.884283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.884494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.884733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.884843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.884956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.885166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.885422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.245 [2024-11-27 17:23:48.885674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.245 [2024-11-27 17:23:48.885817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.245 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.885910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.885998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.886141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.886376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.886603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.886812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.886923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.887017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.887259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.887534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.887759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.887897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.887988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.888212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.888421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.888710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.888816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.888905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.889166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.889392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.889629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.889859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.889980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.890098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.890327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.890559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.890762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.890877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.890991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.891194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.891419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.891646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.891761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.891877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.892137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.246 qpair failed and we were unable to recover it. 00:30:52.246 [2024-11-27 17:23:48.892336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.246 [2024-11-27 17:23:48.892450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.892551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.892634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.892658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.892787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.892866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.892890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.892977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.893197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.893398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.893638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.893850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.893959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.894083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.894319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.894513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.894781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.894895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.894984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.895218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.895506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.895732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.895842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.895933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.896188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.896411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.896649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.896882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.896983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.897078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.897290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.897522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.897732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.897844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.897930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.898159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.898373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.898620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.898777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.247 qpair failed and we were unable to recover it. 00:30:52.247 [2024-11-27 17:23:48.898917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.899000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.247 [2024-11-27 17:23:48.899025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.899121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.899377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.899595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.899789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.899902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.899986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.900201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.900429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.900704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.900823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.900910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.901142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.901352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.901561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.901759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.901867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.901962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.902167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.902401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.902602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.902805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.902948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.903036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.903275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.903473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.903669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.903852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.903937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.904154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.904374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.904676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.904887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.904974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.905008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.905099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.905181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.905206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.248 qpair failed and we were unable to recover it. 00:30:52.248 [2024-11-27 17:23:48.905294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.248 [2024-11-27 17:23:48.905443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.905467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.905567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.905658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.905682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.905783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.905869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.905893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.905986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.906216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.906414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.906655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.906879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.906997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.907118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.907355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.907559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.907757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.907873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.907989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.908193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.908399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.908669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.908816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.908908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.909135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.909357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.909625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.909833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.909950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.910036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.910324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.910536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.910740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.910854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.910951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.911175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.911394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.911624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.249 qpair failed and we were unable to recover it. 00:30:52.249 [2024-11-27 17:23:48.911852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.249 [2024-11-27 17:23:48.911934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.911961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.912053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.912245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.912489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.912732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.912843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.912929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.913212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.913411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.913624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.913880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.913995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.914082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.914282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.914490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.914741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.914855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.914943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.915166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.915368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.915577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.915783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.915898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.915992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.916220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.916428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.916677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.916878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.916984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.917076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.917156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.917181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.250 qpair failed and we were unable to recover it. 00:30:52.250 [2024-11-27 17:23:48.917267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.250 [2024-11-27 17:23:48.917361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.917385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.917473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.917575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.917600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.917700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.917780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.917804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.917919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.918115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.918307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.918535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.918777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.918887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.918981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.919181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.919388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.919588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.919762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.919907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.920127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.920325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.920557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.920783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.920896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.920984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.921204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.921411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.921661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.921859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.921970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.922065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.922261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.922488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.922701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.922820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.922914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.923113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.923381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.251 qpair failed and we were unable to recover it. 00:30:52.251 [2024-11-27 17:23:48.923604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.251 [2024-11-27 17:23:48.923689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.923713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.923835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.923947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.923971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.924062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.924261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.924466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.924708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.924908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.924993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.925101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.925318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.925556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.925780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.925895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.925984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.926244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.926445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.926686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.926891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.926977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.927086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.927316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.927552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.927752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.927862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.927982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.928181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.928381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.928592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.928832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.928942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.929057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.929288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.929513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.929734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.929843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.252 qpair failed and we were unable to recover it. 00:30:52.252 [2024-11-27 17:23:48.929925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.252 [2024-11-27 17:23:48.930017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.930128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.930363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.930573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.930792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.930902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.930991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.931239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.931469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.931731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.931845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.931942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.932142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.932371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.932581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.932814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.932931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.933015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.933240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.933467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.933680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.933784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.933874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.934127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.934338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.934567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.934793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.934901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.934993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.935245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.935535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.935748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.935852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.935939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.936087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.936112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.936312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.936336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.253 qpair failed and we were unable to recover it. 00:30:52.253 [2024-11-27 17:23:48.936430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.253 [2024-11-27 17:23:48.936520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.936553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.936671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.936766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.936789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.936880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.936968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.936992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.937138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.937362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.937620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.937853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.937960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.938048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.938265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.938462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.938667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.938884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.938999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.939097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.939310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.939543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.939766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.939873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.939987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.940227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.940434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.940696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.940803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.940923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.941135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.941374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.941588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.941816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.941957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.942077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.942160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.254 [2024-11-27 17:23:48.942185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.254 qpair failed and we were unable to recover it. 00:30:52.254 [2024-11-27 17:23:48.942279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.942510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.942731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.942850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.942934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.943134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.943331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.943575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.943804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.943939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.944059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.944251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.944449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.944651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.944865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.944976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.945067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.945261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.945494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.945724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.945835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.945937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.946150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.946355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.946554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.946787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.946898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.946993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.947207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.947410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.947631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.947864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.947975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.948070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.948191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.948217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.255 [2024-11-27 17:23:48.948305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.948431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.255 [2024-11-27 17:23:48.948455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.255 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.948546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.948633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.948657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.948741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.948852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.948876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.948965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.949191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.949435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.949677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.949816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.949908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.950140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.950381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.950590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.950825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.950935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.951019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.951218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.951452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.951665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.951869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.951980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.952078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.952313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.952522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.952758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.952867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.952966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.953202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.953451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.953667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.953870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.953988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.954074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.954362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.954589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.256 [2024-11-27 17:23:48.954791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.256 [2024-11-27 17:23:48.954901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.256 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.954991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.955193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.955388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.955605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.955809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.955959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.956046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.956271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.956477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.956717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.956834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.956932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.957142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.957345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.957555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.957752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.957866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.957957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.958180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.958414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.958613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.958826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.958974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.959090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.959295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.959510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.959742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.959856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.959945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.960176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.960406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.960630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.960769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.960888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.961014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.961039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.257 qpair failed and we were unable to recover it. 00:30:52.257 [2024-11-27 17:23:48.961129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.961251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.257 [2024-11-27 17:23:48.961279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.961398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.961496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.961520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.961636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.961727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.961751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.961869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.961983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.962100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.962334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.962542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.962777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.962885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.962976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.963230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.963478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.963717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.963852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.963941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.964147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.964342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.964556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.964787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.964900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.964985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.965214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.965409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.965701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.965838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.965956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.966148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.966356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.966558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.966768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.966880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.967003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.967248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.967448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.258 qpair failed and we were unable to recover it. 00:30:52.258 [2024-11-27 17:23:48.967697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.258 [2024-11-27 17:23:48.967839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.967957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.968174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.968417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.968641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.968842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.968957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.969075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.969275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.969537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.969775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.969893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.970017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.970218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.970424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.970638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.970843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.970979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.971066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.971259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.971466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.971697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.971814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.971904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.972175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.972372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.972585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.972789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.972904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.972989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.973080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.973105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.259 [2024-11-27 17:23:48.973201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.973291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.259 [2024-11-27 17:23:48.973315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.259 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.973402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.973609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.973850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.973972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.974053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.974317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.974512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.974748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.974884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.974984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.975182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.975413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.975655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.975880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.975993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.976105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.976358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.976573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.976835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.976943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.977034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.977299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.977505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.977727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.977850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.977938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.978177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.978377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.978576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.978778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.978916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.979010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.979241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.979453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.260 qpair failed and we were unable to recover it. 00:30:52.260 [2024-11-27 17:23:48.979690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.260 [2024-11-27 17:23:48.979774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.979799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.979890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.979982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.980137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.980334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.980566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.980797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.980910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.981006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.981248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.981455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.981693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.981841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.981956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.982154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.982378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.982618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.982825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.982933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.983027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.983217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.983407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.983654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.983861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.983984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.984071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.984334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.984546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.984754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.984864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.984987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.985185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.985386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.985607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.985828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.261 [2024-11-27 17:23:48.985941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.261 qpair failed and we were unable to recover it. 00:30:52.261 [2024-11-27 17:23:48.986034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.986267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.986474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.986675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.986797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.986887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.987124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.987363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.987584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.987791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.987900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.987986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.988226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.988451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.988694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.988808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.988923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.989152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.989358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.989616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.989849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.989987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.990070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.990281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.990509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.990723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.990873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.990965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.991156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.991382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.991594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.991833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.991944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.992077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.992162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.992185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.262 [2024-11-27 17:23:48.992272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.992393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.262 [2024-11-27 17:23:48.992417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.262 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.992515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.992603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.992627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.992720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.992807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.992831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.992924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.993136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.993340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.993581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.993780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.993892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.994008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.994236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.994438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.994648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.994846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.994966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.995057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.995282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.995529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.995731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.995842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.995933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.996173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.996372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.996608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.996858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.996996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.997095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.997328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.997557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.997756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.997904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.997997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.998252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.998486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.998712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.263 [2024-11-27 17:23:48.998855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.263 qpair failed and we were unable to recover it. 00:30:52.263 [2024-11-27 17:23:48.998950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:48.999148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:48.999345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:48.999593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:48.999801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:48.999915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.000034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.000285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.000483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.000740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.000860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.000948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.001245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.001483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.001681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.001796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.001909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.002118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.002322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.002517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.002739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.002884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.002974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.003184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.003414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.003626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.003740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.003886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.004124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.004350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.264 qpair failed and we were unable to recover it. 00:30:52.264 [2024-11-27 17:23:49.004569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.264 [2024-11-27 17:23:49.004660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.004685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.004809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.004897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.004921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.005007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.005223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.005456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.005677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.005892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.005980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.006089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.006300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.006536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.006754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.006870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.006959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.007188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.007378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.007620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.007866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.007978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.008091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.008288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.008499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.008706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.008819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.008915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.009121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.009344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.009540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.009780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.009887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.009975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.010206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.010406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.010667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.265 qpair failed and we were unable to recover it. 00:30:52.265 [2024-11-27 17:23:49.010878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.265 [2024-11-27 17:23:49.010972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.010997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.011101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.011341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.011566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.011772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.011883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.011975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.012168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.012405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.012616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.012851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.012963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.013045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.013286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.013506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.013760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.013907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.014023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.014292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.014493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.014776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.014890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.014984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.015209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.015451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.015692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.015806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.015944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.016183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.016398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.016601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.016841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.016982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.017076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.017192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.017216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.017305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.017420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.017444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.266 qpair failed and we were unable to recover it. 00:30:52.266 [2024-11-27 17:23:49.017534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.266 [2024-11-27 17:23:49.017648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.017672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.017764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.017850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.017874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.017972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.018197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.018425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.018671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.018869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.018987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.019112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.019314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.019510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.019749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.019865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.019956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.020184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.020426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.020685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.020792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.020882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.021114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.021319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.021561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.021766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.021908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.021999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.022237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.022456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.022723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.022838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.022925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.023192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.023392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.023596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.023792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.023899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.267 qpair failed and we were unable to recover it. 00:30:52.267 [2024-11-27 17:23:49.023988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.267 [2024-11-27 17:23:49.024110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.024221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.024434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.024672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.024820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.024918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.025170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.025368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.025563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.025773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.025884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.025976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.026174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.026397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.026623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.026834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.026943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.027044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.027285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.027538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.027787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.027902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.027996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.028234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.028446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.028692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.028807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.028905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.029155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.029397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.268 qpair failed and we were unable to recover it. 00:30:52.268 [2024-11-27 17:23:49.029618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.268 [2024-11-27 17:23:49.029731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.029819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.029933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.029957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.030047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.030281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.030507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.030734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.030841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.030930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.031161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.031366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.031606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.031820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.031931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.032017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.032217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.032441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.032686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.032799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.032931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.033148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.033377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.033591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.033813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.033923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.034042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.034247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.034504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.034712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.034821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.034914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.035132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.035364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.035567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.035786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.035922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.269 qpair failed and we were unable to recover it. 00:30:52.269 [2024-11-27 17:23:49.036037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.269 [2024-11-27 17:23:49.036118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.036235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.036438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.036657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.036891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.036989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.037100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.037342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.037606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.037819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.037966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.038054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.038246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.038509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.038707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.038897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.038984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.039113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.039305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.039539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.039787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.039899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.039985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.040203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.040393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.040602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.040867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.040980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.041073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.041342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.041574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.041782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.041917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.042001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.042083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.042107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.042188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.042297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.042322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.270 qpair failed and we were unable to recover it. 00:30:52.270 [2024-11-27 17:23:49.042408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.270 [2024-11-27 17:23:49.042497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.042523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.042632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.042730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.042755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.042872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.042961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.042989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.043080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.043306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.043533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.043742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.043848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.043964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.044192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.044446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.044655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.044853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.044964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.045064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.045293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.045533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.045736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.045875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.045959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.046160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.046363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.046626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.046850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.046973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.047069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.047297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.047513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.047756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.047869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.047961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.048163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.048360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.048599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.271 qpair failed and we were unable to recover it. 00:30:52.271 [2024-11-27 17:23:49.048837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.271 [2024-11-27 17:23:49.048929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.048954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.049058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.049288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.049530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.049744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.049853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.049937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.050134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.050371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.050590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.050815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.050932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.051020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.051254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.051485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.051708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.051815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.051906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.052176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.052381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.052597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.052804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.052945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.053063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.053261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.053488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.053699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.053841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.053929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.054178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.054380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.054583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.054812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.054932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.055084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.055169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.055193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.272 qpair failed and we were unable to recover it. 00:30:52.272 [2024-11-27 17:23:49.055317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.272 [2024-11-27 17:23:49.055434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.055458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.055546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.055635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.055661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.055877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.055902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.056002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.056229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.056462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.056700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.056809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.056901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.057190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.057418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.057650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.057853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.057976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.058066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.058281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.058549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.058762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.058898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.058998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.059241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.059450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.059683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.059881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.059997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.060146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.060347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.273 qpair failed and we were unable to recover it. 00:30:52.273 [2024-11-27 17:23:49.060564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.273 [2024-11-27 17:23:49.060688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.060713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.060799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.060893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.060917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.061011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.061224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.061425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.061637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.061831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.061940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.062064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.062265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.062533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.062734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.062872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.062959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.063196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.063432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.063669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.063903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.063990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.064132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.064370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.064565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.064783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.064891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.064984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.065186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.065413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.065620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.065842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.065989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.066115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.066324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.066555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.066763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.066869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.274 qpair failed and we were unable to recover it. 00:30:52.274 [2024-11-27 17:23:49.066960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.274 [2024-11-27 17:23:49.067079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.067400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.067614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.067872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.067989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.068111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.068344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.068592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.068802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.068944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.069042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.069241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.069448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.069663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.069810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.069901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.070167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.070362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.070554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.070772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.070915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.071005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.071206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.071410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.071688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.071800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.071893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.072160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.072367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.072659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.072882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.072978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.073097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.073348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.275 qpair failed and we were unable to recover it. 00:30:52.275 [2024-11-27 17:23:49.073589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.275 [2024-11-27 17:23:49.073688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.073712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.073805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.073890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.073916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.074040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.074255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.074456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.074662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.074787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.074877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.075129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.075361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.075608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.075813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.075924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.076011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.076215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.076452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.076692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.076902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.076991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.077095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.077303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.077535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.077744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.077856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.077953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.078151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.078343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.078598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.078805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.078946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.079061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.079294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.079508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.079751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.079894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.276 qpair failed and we were unable to recover it. 00:30:52.276 [2024-11-27 17:23:49.079981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.276 [2024-11-27 17:23:49.080107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.080222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.080426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.080687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.080889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.080975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.081085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.081518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.081768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.081910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.082035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.082248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.082470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.082700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.082817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.082904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.083131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.083355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.083574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.083778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.083883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.083987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.084244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.084443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.084647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.084847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.084964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.085080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.085298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.277 [2024-11-27 17:23:49.085533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.277 [2024-11-27 17:23:49.085654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.277 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.085747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.085829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.085854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.085981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.086225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.086470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.086672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.086875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.086996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.087081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.087285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.087514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.087760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.087903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.088022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.088223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.088420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.088666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.088879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.088988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.089072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.089315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.089545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.089779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.089893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.089983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.090210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.090438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.090661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.090897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.090984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.091128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.091323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.091567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.091818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.091960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.278 qpair failed and we were unable to recover it. 00:30:52.278 [2024-11-27 17:23:49.092055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.278 [2024-11-27 17:23:49.092173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.092313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.092522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.092781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.092896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.093013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.093284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.093492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.093720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.093830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.093927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.094157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.094385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.094587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.094788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.094933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.095029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.095290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.095497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.095738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.095851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.095942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.096172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.096428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.096668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.096873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.096995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.097098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.097296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.097496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.097718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.097863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.097959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.098184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.098396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.098623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.279 [2024-11-27 17:23:49.098831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.279 [2024-11-27 17:23:49.098973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.279 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.099068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.099288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.099530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.099766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.099877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.099999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.100234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.100464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.100696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.100807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.100900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.101156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.101395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.101610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.101806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.101919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.102032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.102230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.102445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.102685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.102859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.102975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.103179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.103418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.103683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.103835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.103958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.104163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.104397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.104622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.104850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.104987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.105106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.105315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.105552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.105764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.105899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.280 [2024-11-27 17:23:49.105981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.106069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.280 [2024-11-27 17:23:49.106093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.280 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.106190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.106398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.106640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.106856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.106978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.107131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.107338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.107571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.107831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.107951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.108052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.108242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.108483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.108733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.108880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.108972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.109182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.109415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.109619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.109823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.109928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.110041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.110237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.110465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.110670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.110888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.110976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.111090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.111321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.111540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.111747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.111892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.111983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.112184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.112435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.112649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.112847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.281 [2024-11-27 17:23:49.112958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.281 qpair failed and we were unable to recover it. 00:30:52.281 [2024-11-27 17:23:49.113042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.113246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.113457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.113669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.113817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.113941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.114147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.114345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.114576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.114844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.114950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.115072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.115274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.115486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.115710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.115911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.115996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.116119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.116320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.116513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.116762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.116930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.117021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.117269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.117529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.117731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.117843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.282 [2024-11-27 17:23:49.117970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.118060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.282 [2024-11-27 17:23:49.118084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.282 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.118171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.118380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.118618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.118816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.118921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.119034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.119271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.119486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.119699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.119807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.119886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.120126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.120354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.120596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.120795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.120904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.121024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.121225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.121473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.121687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.121832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.121922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.122118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.122320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.122535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.122746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.122886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.283 qpair failed and we were unable to recover it. 00:30:52.283 [2024-11-27 17:23:49.122983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.283 [2024-11-27 17:23:49.123066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.123211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.123411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.123685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.123827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.123941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.124139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.124408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.124617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.124815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.124932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.125079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.125393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.125610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.125818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.125965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.126047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.126283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.126514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.126742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.126860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.126955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.127214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.127422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.127662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.127896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.127982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.128095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.128357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.128558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.128765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.128906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.129022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.129221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.129450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.284 [2024-11-27 17:23:49.129557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.284 qpair failed and we were unable to recover it. 00:30:52.284 [2024-11-27 17:23:49.129653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.129746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.129778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.129869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.129962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.129986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.130072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.130308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.130509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.130747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.130860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.131154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.131353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.131653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.131794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.131912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.132164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.132374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.132579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.132816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.132935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.133028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.133284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.133479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.133719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.133838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.133924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.134128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.134367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.134575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.134815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.134930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.135015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.135250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.135490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.135709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.135825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.135941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.136055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.285 [2024-11-27 17:23:49.136079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.285 qpair failed and we were unable to recover it. 00:30:52.285 [2024-11-27 17:23:49.136174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.136401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.136619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.136855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.136993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.137079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.137340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.137584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.137802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.137943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.138032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.138254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.138457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.138756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.138875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.139002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.139202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.139427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.139642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.139901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.139989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.140098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.140356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.140572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.140801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.140916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.141012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.141247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.141488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.141707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.141821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.141916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.142146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.142359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.142587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.286 [2024-11-27 17:23:49.142695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.286 qpair failed and we were unable to recover it. 00:30:52.286 [2024-11-27 17:23:49.142780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.142873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.142898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.142984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.143194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.143406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.143669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.143813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.143898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.144125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.144319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.144528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.144761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.144905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.144994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.145200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.145452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.145685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.145792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.145912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.146183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.146383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.146673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.146872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.146979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.147068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.147296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.147500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.147704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.147849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.287 [2024-11-27 17:23:49.147942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.148025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.287 [2024-11-27 17:23:49.148049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.287 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.148200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.148442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.148676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.148792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.148939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.149170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.149368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.149563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.149769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.149912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.150001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.150233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.150462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.150657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.150879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.150991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.151077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.151282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.151547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.151749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.151896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.152021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.152234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.152462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.152701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.152899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.152996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.153144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.153338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.153558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.153813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.153954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.154074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.154274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.288 [2024-11-27 17:23:49.154478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.288 [2024-11-27 17:23:49.154624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.288 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.154716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.154806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.154831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.154919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.155123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.155350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.155587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.155792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.155901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.156027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.156227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.156461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.156710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.156871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.156967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.157174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.157458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.157667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.157774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.157893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.158156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.158357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.158589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.158825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.158943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.159057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.159308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.159551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.159787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.159903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.159990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.160251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.160459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.160702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.160822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.160916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.161036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.289 [2024-11-27 17:23:49.161062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.289 qpair failed and we were unable to recover it. 00:30:52.289 [2024-11-27 17:23:49.161149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.161386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.161605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.161819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.161939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.162029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.162283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.162551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.162808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.162977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.163123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.163258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.163291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.554 qpair failed and we were unable to recover it. 00:30:52.554 [2024-11-27 17:23:49.163401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.554 [2024-11-27 17:23:49.163508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.163551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.163659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.163771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.163803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.163919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.164168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.164445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.164696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.164874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.165013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.165287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.165508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.165725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.165871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.165961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.166194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.166484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.166754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.166898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.166989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.167193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.167430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.167660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.167806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.167892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.168155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.168393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.168646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.168877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.168987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.169073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.169300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.169552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.169766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.169879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.170006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.170123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.170147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.555 [2024-11-27 17:23:49.170244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.170339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.555 [2024-11-27 17:23:49.170363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.555 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.170450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.170566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.170591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.170678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.170757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.170781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.170874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.170999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.171114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.171311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.171532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.171775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.171885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.171979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.172180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.172418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.172629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.172864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.172981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.173066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.173291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.173500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.173731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.173874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.173991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.174186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.174423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.174657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.174886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.174996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.175087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.175321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.175529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.175734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.175855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.175955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.176189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.176388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.556 [2024-11-27 17:23:49.176627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.556 [2024-11-27 17:23:49.176743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.556 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.176892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.176981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.177121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.177321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.177554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.177745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.177863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.177952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.178193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.178408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.178638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.178844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.178963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.179063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.179333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.179587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.179849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.179961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.180051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.180248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.180481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.180700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.180906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.180994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.181114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.181347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.181555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.181777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.181921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.182005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.182232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.182435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.182645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.182863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.182977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.183002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.557 [2024-11-27 17:23:49.183094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.183213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.557 [2024-11-27 17:23:49.183237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.557 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.183328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.183562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.183758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.183906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.184027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.184239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.184463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.184685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.184807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.184925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.185121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.185350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.185604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.185804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.185949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.186037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.186258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.186465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.186725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.186839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.186927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.187160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.187410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.187658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.187797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.187885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.188147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.188360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.188569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.188834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.188950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.189048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.189255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.189457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.558 [2024-11-27 17:23:49.189701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.558 [2024-11-27 17:23:49.189817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.558 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.189910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.190154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.190362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.190577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.190792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.190933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.191025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.191234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.191437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.191658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.191870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.191989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.192103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.192302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.192543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.192749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.192862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.192958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.193168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.193412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.193631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.193862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.193972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.194054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.194291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.194502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.194725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.194867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.194956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.195057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.195081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.559 qpair failed and we were unable to recover it. 00:30:52.559 [2024-11-27 17:23:49.195167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.559 [2024-11-27 17:23:49.195261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.195406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.195617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.195858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.195966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.196090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.196293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.196539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.196783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.196896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.197020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.197222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.197417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.197646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.197857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.197963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.198051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.198260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.198498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.198717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.198829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.198946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.199183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.199388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.199632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.199832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.199978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.200070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.200295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.200489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.200705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.200819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.200906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.201112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.201347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.560 qpair failed and we were unable to recover it. 00:30:52.560 [2024-11-27 17:23:49.201552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.560 [2024-11-27 17:23:49.201641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.201665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.201752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.201835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.201859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.201983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.202185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.202426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.202695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.202845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.202937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.203175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.203370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.203581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.203851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.203962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.204046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.204251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.204461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.204692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.204897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.204985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.205103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.205305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.205520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.205723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.205834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.205935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.206160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.206354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.206601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 17:23:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:52.561 [2024-11-27 17:23:49.206808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.206950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 17:23:49 -- common/autotest_common.sh@862 -- # return 0 00:30:52.561 [2024-11-27 17:23:49.207047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.207278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 17:23:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:52.561 [2024-11-27 17:23:49.207399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 [2024-11-27 17:23:49.207493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.561 qpair failed and we were unable to recover it. 00:30:52.561 17:23:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:52.561 [2024-11-27 17:23:49.207724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.561 [2024-11-27 17:23:49.207835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.207925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.562 [2024-11-27 17:23:49.208015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.208145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.208343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.208569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.208811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.208930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.209048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.209256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.209461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.209712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.209816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.209934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.210192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.210426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.210636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.210875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.210991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.211089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.211289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.211534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.211749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.211856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.211975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.212204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.212435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.212660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.212872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.212989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.213131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.213371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.213614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.213839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.213988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.214083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.214166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.214190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.562 qpair failed and we were unable to recover it. 00:30:52.562 [2024-11-27 17:23:49.214281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.214398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.562 [2024-11-27 17:23:49.214423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.214513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.214654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.214679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.214807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.214900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.214925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.215051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.215257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.215460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.215684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.215886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.215997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.216091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.216335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.216574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.216781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.216913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.216999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.217263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.217466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.217675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.217880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.217988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.218089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.218320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.218549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.218749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.218894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.219020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.219220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.219458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.219669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.219878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.219996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.563 qpair failed and we were unable to recover it. 00:30:52.563 [2024-11-27 17:23:49.220079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.563 [2024-11-27 17:23:49.220168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.220285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.220481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.220691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.220813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.220901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.221147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.221377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.221592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.221817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.221925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.222042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.222243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.222445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.222698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.222847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.222968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.223213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.223444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.223657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.223905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.223984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.224106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.224303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.224510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.224726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.224836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.224929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.225168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.225405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.225664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.225871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.225994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.226121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.226361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.564 qpair failed and we were unable to recover it. 00:30:52.564 [2024-11-27 17:23:49.226564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.564 [2024-11-27 17:23:49.226689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.226783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.226876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.226900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.226985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.227250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.227472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.227677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.227908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.227996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.228111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.228336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.228581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.228819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.228961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.229057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.229257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.229459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.229686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.229828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.229920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.230181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.230403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 17:23:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:52.565 [2024-11-27 17:23:49.230639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.230866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 17:23:49 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:52.565 [2024-11-27 17:23:49.230967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.230993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.231087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.231293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.565 [2024-11-27 17:23:49.231505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.231723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.231840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.231959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.232191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.232419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.232634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.565 [2024-11-27 17:23:49.232864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.565 [2024-11-27 17:23:49.232982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.565 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.233105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.233342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.233540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.233806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.233970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.234065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.234313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.234521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.234729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.234845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.234930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.235135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.235465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.235679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.235817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.235912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.236127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.236365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.236568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.236816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.236985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.237078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.237303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.237517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.237777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.237889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.238013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.238229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.238463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.238674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.238788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.238882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.239112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.239358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.566 qpair failed and we were unable to recover it. 00:30:52.566 [2024-11-27 17:23:49.239629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.566 [2024-11-27 17:23:49.239743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.239831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.239950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.239973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.240073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.240279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.240519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.240742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.240863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.240968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.241200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.241408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.241653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.241777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.241904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.242165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.242400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.242652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.242872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.242984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.243101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.243317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.243531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.243784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.243913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.244025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.244234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.244471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.244685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.244809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.244969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.245176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.245440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.245680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.245899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.245987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.246011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.246100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.246224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.246247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.567 qpair failed and we were unable to recover it. 00:30:52.567 [2024-11-27 17:23:49.246347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.246440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.567 [2024-11-27 17:23:49.246464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.246560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.246665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.246688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.246786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.246868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.246892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.246974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.247204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.247445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.247710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.247821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.247913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.248174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.248383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.248638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.248864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.248976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.249102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.249309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.249550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.249763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.249875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.249970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.250176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.250400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.250610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.250841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.250986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.251087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.251289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.251517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.568 [2024-11-27 17:23:49.251734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.568 [2024-11-27 17:23:49.251840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.568 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.251959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.252153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.252384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.252644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.252759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.252917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.253147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.253358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.253569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.253773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.253905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.254069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.254272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.254517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.254791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.254938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.255114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.255262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.255287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.255415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.255520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.255562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.255717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 Malloc0 00:30:52.569 [2024-11-27 17:23:49.255845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.255870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.255969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.256168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.569 [2024-11-27 17:23:49.256262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 17:23:49 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:52.569 [2024-11-27 17:23:49.256379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.256594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.569 [2024-11-27 17:23:49.256689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.256846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.256992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.257120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.257431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.257718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.257858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.257974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.258269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.258504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.569 [2024-11-27 17:23:49.258726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.569 [2024-11-27 17:23:49.258846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.569 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.258942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.259193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.259388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259402] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:52.570 [2024-11-27 17:23:49.259480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.259615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.259846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.259982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.260075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.260272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.260512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.260728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.260846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.260944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.261150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.261382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.261646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.261905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.261999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.262114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.262332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.262570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.262788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.262912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.263007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.263247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.263474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.263708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.263821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.263939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.264138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.264347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.264559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.264812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.264926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.265019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.265174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.265198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.570 qpair failed and we were unable to recover it. 00:30:52.570 [2024-11-27 17:23:49.265318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.265402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.570 [2024-11-27 17:23:49.265426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.265521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.265637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.265662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.265757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.265848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.265872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.265952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.266215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.266420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.266715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.266832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.266919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.267143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.267357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.267627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.571 [2024-11-27 17:23:49.267714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 17:23:49 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:52.571 [2024-11-27 17:23:49.267835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.571 [2024-11-27 17:23:49.267931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.267955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.571 [2024-11-27 17:23:49.268047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.268305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.268629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.268780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.268918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.269218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.269481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.269763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.269910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.270002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.270216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.270427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.270664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.270882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.270991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.271105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.271321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.271557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.271763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.271912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.571 [2024-11-27 17:23:49.272012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.272099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.571 [2024-11-27 17:23:49.272123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.571 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.272210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.272410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.272652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.272894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.272979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.273127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.273313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.273549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.273837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.273948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.274036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.274244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.274453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.274691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.274801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.274921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.275132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.275328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.275659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.572 [2024-11-27 17:23:49.275741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.275766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 17:23:49 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:52.572 [2024-11-27 17:23:49.275858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.572 [2024-11-27 17:23:49.275979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.572 [2024-11-27 17:23:49.276093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.276333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.276632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.276813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.276942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.277202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.277451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.277679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.277791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.277920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.278014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.278038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.572 qpair failed and we were unable to recover it. 00:30:52.572 [2024-11-27 17:23:49.278136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.572 [2024-11-27 17:23:49.278224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.278331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.278604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.278816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.278936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.279059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.279258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.279489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.279726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.279873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.279960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.280177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.280415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.280661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.280877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.280985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.281103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.281333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.281539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.281797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.281939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.282035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.282238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.282441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.282652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.282872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.282985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.283074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.283337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.283600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.573 [2024-11-27 17:23:49.283720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.283815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 17:23:49 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:52.573 [2024-11-27 17:23:49.283936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.283961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.573 [2024-11-27 17:23:49.284058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.573 [2024-11-27 17:23:49.284153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.284180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.284321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.284438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.284475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.573 qpair failed and we were unable to recover it. 00:30:52.573 [2024-11-27 17:23:49.284644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.573 [2024-11-27 17:23:49.284749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.284793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.284954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.285207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.285506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.285754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.285895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.286014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.286323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.286538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.286750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.286898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.286989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.287076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.287100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.287221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.287310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.287334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b66390 with addr=10.0.0.2, port=4420 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.287457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:52.574 [2024-11-27 17:23:49.287674] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:52.574 [2024-11-27 17:23:49.290333] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:30:52.574 [2024-11-27 17:23:49.290401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b66390 (107): Transport endpoint is not connected 00:30:52.574 [2024-11-27 17:23:49.290486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.574 17:23:49 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:52.574 17:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.574 17:23:49 -- common/autotest_common.sh@10 -- # set +x 00:30:52.574 17:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.574 17:23:49 -- host/target_disconnect.sh@58 -- # wait 1875144 00:30:52.574 [2024-11-27 17:23:49.300048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.300173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.300202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.300217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.300230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.300259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.309953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.310043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.310070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.310083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.310096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.310124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.320022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.320168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.320194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.320208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.320220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.320248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.329991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.330093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.330118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.330131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.330144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.330172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.340097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.340243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.340269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.340283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.340295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.340323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.350092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.350204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.350230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.350244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.350256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.350284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.360041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.360140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.574 [2024-11-27 17:23:49.360165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.574 [2024-11-27 17:23:49.360178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.574 [2024-11-27 17:23:49.360190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.574 [2024-11-27 17:23:49.360218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.574 qpair failed and we were unable to recover it. 00:30:52.574 [2024-11-27 17:23:49.370122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.574 [2024-11-27 17:23:49.370220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.370245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.370258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.370276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.370305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.380254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.380362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.380388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.380402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.380414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.380443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.390394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.390490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.390516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.390541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.390554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.390583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.400253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.400353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.400379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.400393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.400406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.400434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.410226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.410321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.410347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.410361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.410373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.410400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.420170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.420266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.420291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.420304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.420318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.420346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.430211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.430299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.430324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.430338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.430350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.430378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.440274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.440378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.440403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.440416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.440429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.440458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.450372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.450475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.450500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.450514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.450531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.450563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.460304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.460400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.460425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.460438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.460456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.460485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.470330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.470435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.470460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.470474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.470486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.470514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.480405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.480507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.480538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.480553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.480566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.480594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.575 [2024-11-27 17:23:49.490422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.575 [2024-11-27 17:23:49.490531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.575 [2024-11-27 17:23:49.490557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.575 [2024-11-27 17:23:49.490570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.575 [2024-11-27 17:23:49.490582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.575 [2024-11-27 17:23:49.490610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.575 qpair failed and we were unable to recover it. 00:30:52.834 [2024-11-27 17:23:49.500436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.834 [2024-11-27 17:23:49.500540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.834 [2024-11-27 17:23:49.500568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.834 [2024-11-27 17:23:49.500581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.834 [2024-11-27 17:23:49.500595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.834 [2024-11-27 17:23:49.500624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.834 qpair failed and we were unable to recover it. 00:30:52.834 [2024-11-27 17:23:49.510471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.834 [2024-11-27 17:23:49.510576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.834 [2024-11-27 17:23:49.510603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.510616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.510641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.510669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.520477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.520583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.520608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.520621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.520634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.520662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.530510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.530618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.530644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.530658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.530671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.530699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.540587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.540690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.540715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.540729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.540741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.540770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.550566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.550663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.550688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.550707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.550721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.550749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.560612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.560711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.560735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.560749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.560761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.560789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.570624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.570717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.570743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.570756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.570768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.570796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.580645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.580742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.580767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.580781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.580794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.580821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.590679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.590779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.590805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.590819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.590832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.590859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.600738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.600834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.600859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.600873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.600886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.600914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.610751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.610848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.610882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.610895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.610908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.610936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.620784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.620911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.620936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.620950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.620962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.620989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.630825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.630915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.630940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.630953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.630965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.835 [2024-11-27 17:23:49.630993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.835 qpair failed and we were unable to recover it. 00:30:52.835 [2024-11-27 17:23:49.640939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.835 [2024-11-27 17:23:49.641038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.835 [2024-11-27 17:23:49.641063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.835 [2024-11-27 17:23:49.641085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.835 [2024-11-27 17:23:49.641099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.641127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.650872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.651005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.651030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.651043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.651055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.651082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.660888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.661030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.661055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.661068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.661081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.661108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.670909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.671006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.671031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.671044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.671057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.671085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.681007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.681152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.681177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.681190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.681203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.681231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.690980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.691073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.691098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.691111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.691123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.691151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.701023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.701122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.701147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.701161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.701174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.701201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.711046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.711143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.711167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.711180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.711193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.711221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.721063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.721175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.721200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.721213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.721225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.721253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.731132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.731232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.731256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.731276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.731289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.731317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.741146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.741234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.741260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.741273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.741285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.741314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.751157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.751295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.751319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.751332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.751345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.751373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.761276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.761407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.761432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.761446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.761458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.761487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.771197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.771291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.836 [2024-11-27 17:23:49.771316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.836 [2024-11-27 17:23:49.771329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.836 [2024-11-27 17:23:49.771341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.836 [2024-11-27 17:23:49.771370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.836 qpair failed and we were unable to recover it. 00:30:52.836 [2024-11-27 17:23:49.781245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:52.836 [2024-11-27 17:23:49.781369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:52.837 [2024-11-27 17:23:49.781397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:52.837 [2024-11-27 17:23:49.781422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:52.837 [2024-11-27 17:23:49.781437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:52.837 [2024-11-27 17:23:49.781476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:52.837 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.791307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.791406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.791436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.791450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.791463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.791491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.801333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.801429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.801455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.801469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.801481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.801511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.811297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.811390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.811416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.811429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.811441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.811468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.821372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.821469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.821494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.821514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.821535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.821566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.831369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.831466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.831491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.831504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.831516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.831550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.841413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.841510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.841543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.841558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.841570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.841597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.851460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.851587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.851613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.851626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.851638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.851667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.861485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.861597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.861623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.861636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.861648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.861675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.871504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.871604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.871630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.871643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.871656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.096 [2024-11-27 17:23:49.871683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.096 qpair failed and we were unable to recover it. 00:30:53.096 [2024-11-27 17:23:49.881600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.096 [2024-11-27 17:23:49.881702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.096 [2024-11-27 17:23:49.881730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.096 [2024-11-27 17:23:49.881745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.096 [2024-11-27 17:23:49.881759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.881788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.891597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.891703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.891728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.891743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.891755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.891783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.901585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.901683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.901708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.901721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.901734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.901762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.911656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.911753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.911782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.911796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.911809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.911836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.921708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.921809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.921834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.921847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.921860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.921887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.931672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.931772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.931797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.931810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.931822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.931852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.941699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.941796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.941821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.941834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.941846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.941874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.951748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.951853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.951879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.951892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.951905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.951934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.961779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.961890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.961915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.961929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.961942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.961970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.971809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.971920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.971946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.971959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.971972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.972000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.981889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.981992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.982018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.982031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.982043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.982072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:49.991979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:49.992106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:49.992132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:49.992145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:49.992157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:49.992185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:50.001916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:50.002017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:50.002047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:50.002062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:50.002074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:50.002103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:50.011954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:50.012074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.097 [2024-11-27 17:23:50.012109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.097 [2024-11-27 17:23:50.012133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.097 [2024-11-27 17:23:50.012155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.097 [2024-11-27 17:23:50.012206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.097 qpair failed and we were unable to recover it. 00:30:53.097 [2024-11-27 17:23:50.021987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.097 [2024-11-27 17:23:50.022096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.098 [2024-11-27 17:23:50.022132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.098 [2024-11-27 17:23:50.022159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.098 [2024-11-27 17:23:50.022183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.098 [2024-11-27 17:23:50.022230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.098 qpair failed and we were unable to recover it. 00:30:53.098 [2024-11-27 17:23:50.032095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.098 [2024-11-27 17:23:50.032208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.098 [2024-11-27 17:23:50.032237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.098 [2024-11-27 17:23:50.032251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.098 [2024-11-27 17:23:50.032264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.098 [2024-11-27 17:23:50.032294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.098 qpair failed and we were unable to recover it. 00:30:53.098 [2024-11-27 17:23:50.042043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.098 [2024-11-27 17:23:50.042155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.098 [2024-11-27 17:23:50.042185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.098 [2024-11-27 17:23:50.042200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.098 [2024-11-27 17:23:50.042213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.098 [2024-11-27 17:23:50.042250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.098 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.052042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.052147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.052179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.052193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.052205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.052234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.062092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.062195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.062224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.062239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.062252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.062281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.072127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.072244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.072271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.072284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.072297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.072326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.082105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.082206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.082232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.082245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.082258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.082286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.092160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.092294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.092323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.092338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.092350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.092378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.102161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.102255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.102281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.102294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.102307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.102335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.112454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.112572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.357 [2024-11-27 17:23:50.112597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.357 [2024-11-27 17:23:50.112611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.357 [2024-11-27 17:23:50.112625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.357 [2024-11-27 17:23:50.112652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.357 qpair failed and we were unable to recover it. 00:30:53.357 [2024-11-27 17:23:50.122251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.357 [2024-11-27 17:23:50.122348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.122374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.122387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.122399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.122429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.132260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.132352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.132377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.132391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.132403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.132437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.142320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.142444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.142469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.142483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.142495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.142523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.152296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.152386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.152411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.152425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.152437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.152465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.162377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.162488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.162518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.162542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.162555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.162582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.172355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.172452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.172477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.172490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.172503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.172539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.182413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.182570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.182601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.182615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.182627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.182655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.192465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.192564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.192591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.192605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.192617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.192645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.202456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.202567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.202600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.202614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.202627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.202656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.212493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.212598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.212623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.212637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.212649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.212677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.222608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.222700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.222725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.222738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.222751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.222784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.232545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.232649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.232674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.232688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.232701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.232728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.242615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.242735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.242759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.242773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.358 [2024-11-27 17:23:50.242785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.358 [2024-11-27 17:23:50.242813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.358 qpair failed and we were unable to recover it. 00:30:53.358 [2024-11-27 17:23:50.252621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.358 [2024-11-27 17:23:50.252728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.358 [2024-11-27 17:23:50.252753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.358 [2024-11-27 17:23:50.252766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.252778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.252806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.359 [2024-11-27 17:23:50.262631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.359 [2024-11-27 17:23:50.262719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.359 [2024-11-27 17:23:50.262743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.359 [2024-11-27 17:23:50.262756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.262767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.262795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.359 [2024-11-27 17:23:50.272690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.359 [2024-11-27 17:23:50.272803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.359 [2024-11-27 17:23:50.272837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.359 [2024-11-27 17:23:50.272852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.272865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.272893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.359 [2024-11-27 17:23:50.282731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.359 [2024-11-27 17:23:50.282832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.359 [2024-11-27 17:23:50.282857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.359 [2024-11-27 17:23:50.282870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.282883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.282910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.359 [2024-11-27 17:23:50.292731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.359 [2024-11-27 17:23:50.292855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.359 [2024-11-27 17:23:50.292880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.359 [2024-11-27 17:23:50.292894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.292906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.292934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.359 [2024-11-27 17:23:50.302783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.359 [2024-11-27 17:23:50.302910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.359 [2024-11-27 17:23:50.302936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.359 [2024-11-27 17:23:50.302950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.359 [2024-11-27 17:23:50.302962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.359 [2024-11-27 17:23:50.302990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.359 qpair failed and we were unable to recover it. 00:30:53.618 [2024-11-27 17:23:50.312844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.312974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.313001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.313016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.313028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.313065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.322875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.322973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.322999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.323012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.323024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.323052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.332840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.332935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.332960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.332973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.332986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.333014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.342910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.343004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.343029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.343042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.343055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.343082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.352982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.353128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.353153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.353167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.353180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.353207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.362973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.363073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.363104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.363119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.363131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.363159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.372970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.373063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.373088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.373101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.373113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.373140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.382993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.383087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.383112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.383125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.383137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.383165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.393031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.393134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.393160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.393173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.393186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.393214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.403103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.403250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.403275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.403288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.403306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.403335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.413089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.413178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.413204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.413217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.413229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.413258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.423123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.423232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.423257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.423271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.423283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.423311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.433222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.433324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.433349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.619 [2024-11-27 17:23:50.433362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.619 [2024-11-27 17:23:50.433375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.619 [2024-11-27 17:23:50.433403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.619 qpair failed and we were unable to recover it. 00:30:53.619 [2024-11-27 17:23:50.443211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.619 [2024-11-27 17:23:50.443306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.619 [2024-11-27 17:23:50.443331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.443343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.443356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.443383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.453257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.453405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.453431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.453444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.453456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.453483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.463272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.463366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.463390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.463403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.463416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.463444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.473287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.473418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.473442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.473456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.473468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.473496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.483378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.483478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.483503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.483516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.483538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.483568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.493361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.493476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.493501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.493514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.493541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.493571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.503403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.503502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.503535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.503550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.503563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.503591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.513408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.513507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.513538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.513553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.513565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.513594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.523438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.523548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.523573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.523586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.523600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.523628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.533475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.533593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.533618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.533631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.533644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.533672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.543474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.543583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.543608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.543622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.543634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.543661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.553502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.553600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.553625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.553639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.553651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.553681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.620 [2024-11-27 17:23:50.563564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.620 [2024-11-27 17:23:50.563680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.620 [2024-11-27 17:23:50.563711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.620 [2024-11-27 17:23:50.563736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.620 [2024-11-27 17:23:50.563760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.620 [2024-11-27 17:23:50.563797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.620 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.573569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.573668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.573695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.573709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.573722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.573750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.583621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.583716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.583742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.583755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.583773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.583802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.593690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.593787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.593813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.593827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.593839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.593869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.603672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.603771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.603796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.603809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.603822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.603850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.613686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.613784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.613809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.613822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.613834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.613862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.623753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.623845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.623870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.623883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.623895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.623923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.633735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.633831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.633857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.633870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.633883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.633910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.643803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.643944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.643968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.643981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.643993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.644021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.880 [2024-11-27 17:23:50.653808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.880 [2024-11-27 17:23:50.653914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.880 [2024-11-27 17:23:50.653939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.880 [2024-11-27 17:23:50.653952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.880 [2024-11-27 17:23:50.653965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.880 [2024-11-27 17:23:50.653992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.880 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.663856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.663985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.664009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.664023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.664035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.664063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.673879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.673976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.674001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.674014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.674032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.674061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.683944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.684051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.684075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.684089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.684101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.684130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.693972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.694085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.694110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.694123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.694136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.694163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.704007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.704103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.704128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.704141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.704153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.704181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.713974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.714100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.714125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.714138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.714151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.714178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.724046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.724139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.724164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.724178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.724190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.724217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.734048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.734142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.734167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.734180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.734193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.734220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.744157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.744262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.744291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.744305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.744319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.744348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.754146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.754241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.754267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.754281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.754294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.754322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.764182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.764280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.764305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.764325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.764338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.764368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.774196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.774295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.774320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.881 [2024-11-27 17:23:50.774334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.881 [2024-11-27 17:23:50.774346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.881 [2024-11-27 17:23:50.774373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.881 qpair failed and we were unable to recover it. 00:30:53.881 [2024-11-27 17:23:50.784234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.881 [2024-11-27 17:23:50.784360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.881 [2024-11-27 17:23:50.784385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.882 [2024-11-27 17:23:50.784399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.882 [2024-11-27 17:23:50.784411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.882 [2024-11-27 17:23:50.784438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.882 qpair failed and we were unable to recover it. 00:30:53.882 [2024-11-27 17:23:50.794224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.882 [2024-11-27 17:23:50.794361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.882 [2024-11-27 17:23:50.794387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.882 [2024-11-27 17:23:50.794400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.882 [2024-11-27 17:23:50.794413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.882 [2024-11-27 17:23:50.794442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.882 qpair failed and we were unable to recover it. 00:30:53.882 [2024-11-27 17:23:50.804267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.882 [2024-11-27 17:23:50.804363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.882 [2024-11-27 17:23:50.804389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.882 [2024-11-27 17:23:50.804402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.882 [2024-11-27 17:23:50.804414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.882 [2024-11-27 17:23:50.804442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.882 qpair failed and we were unable to recover it. 00:30:53.882 [2024-11-27 17:23:50.814300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.882 [2024-11-27 17:23:50.814436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.882 [2024-11-27 17:23:50.814460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.882 [2024-11-27 17:23:50.814474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.882 [2024-11-27 17:23:50.814487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.882 [2024-11-27 17:23:50.814515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.882 qpair failed and we were unable to recover it. 00:30:53.882 [2024-11-27 17:23:50.824299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:53.882 [2024-11-27 17:23:50.824396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:53.882 [2024-11-27 17:23:50.824422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:53.882 [2024-11-27 17:23:50.824436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:53.882 [2024-11-27 17:23:50.824449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:53.882 [2024-11-27 17:23:50.824476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:53.882 qpair failed and we were unable to recover it. 00:30:54.141 [2024-11-27 17:23:50.834373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.834468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.834495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.834511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.834532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.834564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.844387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.844484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.844509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.844523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.844544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.844573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.854389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.854507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.854539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.854560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.854574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.854602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.864432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.864534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.864561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.864575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.864587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.864615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.874461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.874567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.874592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.874605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.874618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.874646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.884536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.884645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.884670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.884683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.884695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.884724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.894513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.894620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.894645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.894659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.894671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.894700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.904570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.904677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.904703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.904716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.904728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.904756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.914606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.914701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.914726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.914739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.914752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.914780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.924674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.924817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.924845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.924860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.924873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.924901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.934640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.934739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.934765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.934778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.934790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.934820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.944655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.944757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.944782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.944803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.944823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.944851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.954710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.142 [2024-11-27 17:23:50.954805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.142 [2024-11-27 17:23:50.954830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.142 [2024-11-27 17:23:50.954844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.142 [2024-11-27 17:23:50.954856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.142 [2024-11-27 17:23:50.954884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.142 qpair failed and we were unable to recover it. 00:30:54.142 [2024-11-27 17:23:50.964752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:50.964856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:50.964881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:50.964895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:50.964907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:50.964934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:50.974780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:50.974915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:50.974940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:50.974953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:50.974964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:50.974993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:50.984760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:50.984851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:50.984876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:50.984889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:50.984901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:50.984929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:50.994795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:50.994889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:50.994914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:50.994927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:50.994940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:50.994967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.004841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.004935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.004960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.004974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.004986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.005014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.014855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.014947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.014972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.014985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.014998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.015027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.024896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.024990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.025015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.025029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.025041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.025068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.034952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.035064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.035089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.035108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.035122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.035149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.044969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.045067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.045091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.045105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.045117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.045145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.055015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.055116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.055140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.055153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.055165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.055194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.065036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.065136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.065161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.065174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.065186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.065214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.075092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.075200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.075226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.075241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.075253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.075281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.143 [2024-11-27 17:23:51.085139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.143 [2024-11-27 17:23:51.085238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.143 [2024-11-27 17:23:51.085263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.143 [2024-11-27 17:23:51.085277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.143 [2024-11-27 17:23:51.085289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.143 [2024-11-27 17:23:51.085317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.143 qpair failed and we were unable to recover it. 00:30:54.402 [2024-11-27 17:23:51.095110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.402 [2024-11-27 17:23:51.095215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.402 [2024-11-27 17:23:51.095247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.402 [2024-11-27 17:23:51.095261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.402 [2024-11-27 17:23:51.095276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.402 [2024-11-27 17:23:51.095305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.402 qpair failed and we were unable to recover it. 00:30:54.402 [2024-11-27 17:23:51.105135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.402 [2024-11-27 17:23:51.105262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.402 [2024-11-27 17:23:51.105288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.402 [2024-11-27 17:23:51.105301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.402 [2024-11-27 17:23:51.105314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.402 [2024-11-27 17:23:51.105342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.402 qpair failed and we were unable to recover it. 00:30:54.402 [2024-11-27 17:23:51.115169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.402 [2024-11-27 17:23:51.115280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.402 [2024-11-27 17:23:51.115309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.402 [2024-11-27 17:23:51.115324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.402 [2024-11-27 17:23:51.115336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.402 [2024-11-27 17:23:51.115365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.402 qpair failed and we were unable to recover it. 00:30:54.402 [2024-11-27 17:23:51.125252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.402 [2024-11-27 17:23:51.125368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.402 [2024-11-27 17:23:51.125408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.402 [2024-11-27 17:23:51.125423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.402 [2024-11-27 17:23:51.125436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.402 [2024-11-27 17:23:51.125464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.402 qpair failed and we were unable to recover it. 00:30:54.402 [2024-11-27 17:23:51.135219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.402 [2024-11-27 17:23:51.135317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.402 [2024-11-27 17:23:51.135343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.135357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.135369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.135397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.145251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.145348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.145377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.145391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.145404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.145433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.155292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.155392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.155417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.155431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.155443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.155473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.165323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.165422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.165448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.165461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.165472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.165500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.175323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.175414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.175439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.175453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.175465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.175493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.185369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.185495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.185520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.185547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.185560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.185588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.195388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.195480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.195506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.195520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.195544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.195573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.205458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.205569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.205595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.205608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.205620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.205650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.215432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.215571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.215604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.215618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.215631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.215659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.225497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.225594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.225619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.225633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.225646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.225673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.235504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.235601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.235626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.235640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.235652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.235680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.245546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.245659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.245683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.245697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.245709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.245737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.255559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.255686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.255711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.255724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.255736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.403 [2024-11-27 17:23:51.255770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.403 qpair failed and we were unable to recover it. 00:30:54.403 [2024-11-27 17:23:51.265623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.403 [2024-11-27 17:23:51.265717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.403 [2024-11-27 17:23:51.265741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.403 [2024-11-27 17:23:51.265754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.403 [2024-11-27 17:23:51.265765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.265793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.275613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.275707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.275732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.275746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.275758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.275786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.285687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.285784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.285809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.285822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.285834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.285862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.295748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.295886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.295911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.295924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.295936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.295965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.305718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.305814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.305843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.305857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.305870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.305899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.315749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.315841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.315865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.315879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.315891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.315919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.325833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.325926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.325952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.325965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.325978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.326008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.335803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.335897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.335922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.335935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.335948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.335976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.404 [2024-11-27 17:23:51.345806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.404 [2024-11-27 17:23:51.345912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.404 [2024-11-27 17:23:51.345937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.404 [2024-11-27 17:23:51.345951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.404 [2024-11-27 17:23:51.345964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.404 [2024-11-27 17:23:51.345997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.404 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.355855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.355966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.355999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.356022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.356045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.356083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.365880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.366005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.366031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.366044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.366057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.366085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.375894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.375993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.376018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.376032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.376044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.376072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.385919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.386055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.386080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.386093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.386105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.386132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.396094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.396236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.396266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.396281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.396293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.396321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.406092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.406200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.406224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.406238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.406251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.406280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.416044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.416139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.416164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.416177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.416189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.416217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.426137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.426236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.426262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.426276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.426288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.426315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.436079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.436172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.436197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.436210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.436222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.436255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.446143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.446246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.446274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.446289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.663 [2024-11-27 17:23:51.446301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.663 [2024-11-27 17:23:51.446330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.663 qpair failed and we were unable to recover it. 00:30:54.663 [2024-11-27 17:23:51.456175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.663 [2024-11-27 17:23:51.456277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.663 [2024-11-27 17:23:51.456302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.663 [2024-11-27 17:23:51.456316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.456328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.456356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.466159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.466298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.466323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.466336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.466349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.466377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.476168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.476265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.476290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.476303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.476316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.476344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.486200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.486325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.486355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.486369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.486381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.486409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.496273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.496390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.496415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.496429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.496442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.496469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.506307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.506421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.506447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.506461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.506473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.506501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.516308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.516430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.516456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.516469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.516482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.516511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.526326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.526422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.526447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.526460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.526473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.526507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.536337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.536437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.536462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.536476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.536488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.536517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.546392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.546504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.546536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.546552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.546564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.546592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.556419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.556518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.556552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.556566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.556578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.556608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.566479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.566583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.566609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.566622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.566635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.566662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.576460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.576567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.576598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.576612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.576624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.576653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.586507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.586613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.586641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.586655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.586668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.586696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.596565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.596699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.664 [2024-11-27 17:23:51.596725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.664 [2024-11-27 17:23:51.596739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.664 [2024-11-27 17:23:51.596751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.664 [2024-11-27 17:23:51.596781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.664 qpair failed and we were unable to recover it. 00:30:54.664 [2024-11-27 17:23:51.606595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.664 [2024-11-27 17:23:51.606694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.665 [2024-11-27 17:23:51.606719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.665 [2024-11-27 17:23:51.606733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.665 [2024-11-27 17:23:51.606745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.665 [2024-11-27 17:23:51.606773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.665 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.616633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.616756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.616786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.616808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.616837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.616877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.626638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.626744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.626774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.626789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.626801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.626830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.636656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.636785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.636811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.636825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.636837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.636865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.646705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.646806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.646831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.646844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.646856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.646884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.656743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.656867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.656893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.656907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.656919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.656947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.666731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.666868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.666894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.666907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.666920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.666947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.676788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.676876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.676901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.676914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.676927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.676954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.686807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.686902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.686927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.686940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.686953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.686981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.696832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.696939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.696964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.696978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.696990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.697017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.706856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.706947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.706972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.706986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.707004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.707032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.716898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.717027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.717052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.717065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.717078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.717105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.726942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.727043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.923 [2024-11-27 17:23:51.727068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.923 [2024-11-27 17:23:51.727081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.923 [2024-11-27 17:23:51.727094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.923 [2024-11-27 17:23:51.727121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.923 qpair failed and we were unable to recover it. 00:30:54.923 [2024-11-27 17:23:51.736963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.923 [2024-11-27 17:23:51.737059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.737083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.737096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.737109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.737137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.747018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.747108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.747133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.747147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.747159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.747186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.757002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.757136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.757161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.757175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.757187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.757214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.767082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.767199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.767224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.767237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.767250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.767278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.777073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.777182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.777207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.777220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.777232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.777260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.787137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.787233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.787258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.787276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.787289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.787317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.797149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.797243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.797268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.797282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.797300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.797329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.807179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.807277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.807302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.807315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.807327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.807355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.817201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.817323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.817349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.817362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.817374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.817402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.827215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.827307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.827333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.827346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.827358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.827386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.837254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.837387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.837413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.837426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.837439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.837466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.847280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.847383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.847408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.847421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.847434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.847461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.857321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.857420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.857445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.857458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.924 [2024-11-27 17:23:51.857470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.924 [2024-11-27 17:23:51.857499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.924 qpair failed and we were unable to recover it. 00:30:54.924 [2024-11-27 17:23:51.867374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:54.924 [2024-11-27 17:23:51.867466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:54.924 [2024-11-27 17:23:51.867490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:54.924 [2024-11-27 17:23:51.867504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:54.925 [2024-11-27 17:23:51.867516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:54.925 [2024-11-27 17:23:51.867553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:54.925 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.877406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.877497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.877534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.877554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.877568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.877599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.887463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.887577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.887603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.887617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.887635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.887665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.897458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.897569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.897595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.897608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.897621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.897649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.907475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.907588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.907614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.907628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.907641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.907669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.917471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.917580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.917605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.917618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.917632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.917660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.927537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.927640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.927664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.927677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.927689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.927718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.937541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.937634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.937659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.937672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.937685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.937713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.947579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.947675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.947700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.947713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.947726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.947753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.957628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.957736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.957761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.957774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.957787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.957815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.967655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.967751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.967780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.967794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.967806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.967834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.977704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.977838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.977863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.977884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.977898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.977927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.987676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.987768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.987792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.987805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.987818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.987845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:51.997733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:51.997837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:51.997865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:51.997880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:51.997893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:51.997922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:52.007759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:52.007865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:52.007890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:52.007903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:52.007916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:52.007944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:52.017774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:52.017874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:52.017899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:52.017912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:52.017924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:52.017952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:52.027857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.184 [2024-11-27 17:23:52.027954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.184 [2024-11-27 17:23:52.027978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.184 [2024-11-27 17:23:52.027992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.184 [2024-11-27 17:23:52.028004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.184 [2024-11-27 17:23:52.028033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.184 qpair failed and we were unable to recover it. 00:30:55.184 [2024-11-27 17:23:52.037838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.037929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.037953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.037967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.037980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.038007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.047891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.047983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.048009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.048022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.048034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.048062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.057876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.057969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.057994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.058007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.058020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.058048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.068002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.068114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.068140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.068160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.068174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.068202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.077989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.078076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.078101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.078114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.078126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.078154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.087975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.088073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.088098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.088111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.088124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.088151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.098075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.098177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.098202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.098215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.098228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.098256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.108049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.108142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.108167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.108180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.108193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.108220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.118096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.118198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.118226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.118240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.118253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.118283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.185 [2024-11-27 17:23:52.128095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.185 [2024-11-27 17:23:52.128192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.185 [2024-11-27 17:23:52.128218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.185 [2024-11-27 17:23:52.128231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.185 [2024-11-27 17:23:52.128243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.185 [2024-11-27 17:23:52.128271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.185 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.138163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.138259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.138286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.138300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.138313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.138342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.148230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.148330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.148356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.148369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.148381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.148409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.158216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.158306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.158331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.158351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.158364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.158393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.168248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.168346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.168371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.168384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.168396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.168423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.178234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.178331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.178357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.178370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.178383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.178412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.188268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.188363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.188389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.188403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.188417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.188444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.198298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.198435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.198461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.444 [2024-11-27 17:23:52.198475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.444 [2024-11-27 17:23:52.198489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.444 [2024-11-27 17:23:52.198517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.444 qpair failed and we were unable to recover it. 00:30:55.444 [2024-11-27 17:23:52.208394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.444 [2024-11-27 17:23:52.208509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.444 [2024-11-27 17:23:52.208553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.208568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.208582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.208611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.218403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.218498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.218538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.218554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.218568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.218597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.228435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.228555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.228581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.228596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.228608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.228638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.238496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.238612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.238639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.238653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.238666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.238695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.248456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.248584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.248610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.248631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.248645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.248674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.258512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.258623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.258649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.258662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.258676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.258704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.268499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.268608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.268632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.268645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.268656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.268683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.278571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.278664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.278690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.278704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.278718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.278747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.288593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.288691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.288717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.288731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.288744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.288773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.298638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.298739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.298766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.298781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.298794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.298823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.308644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.308736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.308762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.308776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.308790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.308819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.318671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.318766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.318792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.318806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.318820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.318858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.328715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.328812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.328840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.328854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.328867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.328895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.445 [2024-11-27 17:23:52.338755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.445 [2024-11-27 17:23:52.338863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.445 [2024-11-27 17:23:52.338898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.445 [2024-11-27 17:23:52.338914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.445 [2024-11-27 17:23:52.338927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.445 [2024-11-27 17:23:52.338955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.445 qpair failed and we were unable to recover it. 00:30:55.446 [2024-11-27 17:23:52.348743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.446 [2024-11-27 17:23:52.348846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.446 [2024-11-27 17:23:52.348870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.446 [2024-11-27 17:23:52.348884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.446 [2024-11-27 17:23:52.348896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.446 [2024-11-27 17:23:52.348925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.446 qpair failed and we were unable to recover it. 00:30:55.446 [2024-11-27 17:23:52.358849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.446 [2024-11-27 17:23:52.358946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.446 [2024-11-27 17:23:52.358972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.446 [2024-11-27 17:23:52.358985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.446 [2024-11-27 17:23:52.358998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.446 [2024-11-27 17:23:52.359027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.446 qpair failed and we were unable to recover it. 00:30:55.446 [2024-11-27 17:23:52.368828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.446 [2024-11-27 17:23:52.368927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.446 [2024-11-27 17:23:52.368951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.446 [2024-11-27 17:23:52.368965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.446 [2024-11-27 17:23:52.368977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.446 [2024-11-27 17:23:52.369004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.446 qpair failed and we were unable to recover it. 00:30:55.446 [2024-11-27 17:23:52.378847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.446 [2024-11-27 17:23:52.378969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.446 [2024-11-27 17:23:52.378993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.446 [2024-11-27 17:23:52.379008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.446 [2024-11-27 17:23:52.379021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.446 [2024-11-27 17:23:52.379050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.446 qpair failed and we were unable to recover it. 00:30:55.446 [2024-11-27 17:23:52.388861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.446 [2024-11-27 17:23:52.388956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.446 [2024-11-27 17:23:52.388980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.446 [2024-11-27 17:23:52.388993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.446 [2024-11-27 17:23:52.389006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.446 [2024-11-27 17:23:52.389034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.446 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.398897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.398983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.399009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.399023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.399035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.399064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.408982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.409093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.409117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.409131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.409144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.409173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.419007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.419115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.419140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.419153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.419166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.419195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.429031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.429136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.429165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.429180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.429193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.429222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.439060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.439185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.439213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.439228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.439241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.439270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.449072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.449180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.449207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.449221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.449234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.449263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.459124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.459219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.459244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.459257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.459270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.459299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.469110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.469218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.469243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.469257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.469271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.705 [2024-11-27 17:23:52.469305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.705 qpair failed and we were unable to recover it. 00:30:55.705 [2024-11-27 17:23:52.479133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.705 [2024-11-27 17:23:52.479230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.705 [2024-11-27 17:23:52.479254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.705 [2024-11-27 17:23:52.479268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.705 [2024-11-27 17:23:52.479281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.479309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.489166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.489265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.489289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.489303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.489315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.489344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.499199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.499297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.499322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.499336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.499348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.499376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.509228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.509323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.509347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.509361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.509373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.509402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.519262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.519355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.519384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.519398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.519411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.519440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.529292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.529391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.529414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.529428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.529440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.529469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.539306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.539438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.539463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.539477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.539490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.539518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.549354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.549450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.549474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.549488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.549501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.549536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.559375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.559470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.559495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.559509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.559521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.559563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.569412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.569518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.569549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.569563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.569575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.569604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.579450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.579597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.579625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.579639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.579652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.579681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.589462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.589563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.589588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.589603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.589615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.589644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.599544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.599650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.599675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.599689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.599701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.599730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.706 [2024-11-27 17:23:52.609573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.706 [2024-11-27 17:23:52.609681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.706 [2024-11-27 17:23:52.609713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.706 [2024-11-27 17:23:52.609728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.706 [2024-11-27 17:23:52.609741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.706 [2024-11-27 17:23:52.609770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.706 qpair failed and we were unable to recover it. 00:30:55.707 [2024-11-27 17:23:52.619640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.707 [2024-11-27 17:23:52.619739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.707 [2024-11-27 17:23:52.619763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.707 [2024-11-27 17:23:52.619776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.707 [2024-11-27 17:23:52.619788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.707 [2024-11-27 17:23:52.619817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.707 qpair failed and we were unable to recover it. 00:30:55.707 [2024-11-27 17:23:52.629605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.707 [2024-11-27 17:23:52.629704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.707 [2024-11-27 17:23:52.629728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.707 [2024-11-27 17:23:52.629741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.707 [2024-11-27 17:23:52.629754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.707 [2024-11-27 17:23:52.629783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.707 qpair failed and we were unable to recover it. 00:30:55.707 [2024-11-27 17:23:52.639599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.707 [2024-11-27 17:23:52.639696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.707 [2024-11-27 17:23:52.639720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.707 [2024-11-27 17:23:52.639734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.707 [2024-11-27 17:23:52.639746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.707 [2024-11-27 17:23:52.639775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.707 qpair failed and we were unable to recover it. 00:30:55.707 [2024-11-27 17:23:52.649659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.707 [2024-11-27 17:23:52.649761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.707 [2024-11-27 17:23:52.649789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.707 [2024-11-27 17:23:52.649803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.707 [2024-11-27 17:23:52.649817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.707 [2024-11-27 17:23:52.649852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.707 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.659668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.659768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.659794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.659809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.659822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.659851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.669706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.669830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.669856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.669870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.669883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.669912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.679731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.679858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.679893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.679908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.679921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.679949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.689759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.689866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.689890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.689905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.689917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.689946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.699785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.699881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.699911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.699926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.699938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.699967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.709797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.709891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.709915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.709928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.709941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.709969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.719870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.719961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.719986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.720000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.720012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.720040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.729919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.730018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.730042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.730056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.730068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.730097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.739921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.740049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.740077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.740092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.740105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.740139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.749997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.750102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.750129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.750144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.750157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.750185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.966 [2024-11-27 17:23:52.760041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.966 [2024-11-27 17:23:52.760136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.966 [2024-11-27 17:23:52.760164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.966 [2024-11-27 17:23:52.760179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.966 [2024-11-27 17:23:52.760193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.966 [2024-11-27 17:23:52.760222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.966 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.770005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.770105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.770129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.770143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.770156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.770184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.780009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.780107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.780132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.780145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.780158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.780186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.790060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.790177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.790207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.790223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.790236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.790264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.800107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.800201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.800225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.800239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.800251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.800279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.810112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.810209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.810234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.810247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.810260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.810288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.820129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.820219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.820244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.820258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.820270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.820299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.830161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.830254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.830278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.830292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.830310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.830339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.840195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.840288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.840312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.840325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.840338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.840366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.850275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.850392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.850416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.850430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.850443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.850472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.860269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.860366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.860391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.860405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.860420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.860449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.870283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.870378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.870403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.870417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.870429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.870457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.880300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.880392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.880417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.880430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.880442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.880470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.890408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.890513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.890543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.967 [2024-11-27 17:23:52.890558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.967 [2024-11-27 17:23:52.890571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.967 [2024-11-27 17:23:52.890600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.967 qpair failed and we were unable to recover it. 00:30:55.967 [2024-11-27 17:23:52.900355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.967 [2024-11-27 17:23:52.900453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.967 [2024-11-27 17:23:52.900477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.968 [2024-11-27 17:23:52.900491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.968 [2024-11-27 17:23:52.900504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.968 [2024-11-27 17:23:52.900540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.968 qpair failed and we were unable to recover it. 00:30:55.968 [2024-11-27 17:23:52.910393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:55.968 [2024-11-27 17:23:52.910492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:55.968 [2024-11-27 17:23:52.910516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:55.968 [2024-11-27 17:23:52.910535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:55.968 [2024-11-27 17:23:52.910549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:55.968 [2024-11-27 17:23:52.910577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:55.968 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.920466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.920567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.920594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.920609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.920627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.920658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.930483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.930597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.930622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.930637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.930650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.930680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.940486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.940587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.940612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.940625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.940638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.940667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.950530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.950624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.950649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.950662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.950674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.950703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.960558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.960680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.960705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.960719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.960732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.960761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.970590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.970744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.970771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.970785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.970797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.970826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.980599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.980692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.980716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.980730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.980743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.980771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:52.990636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:52.990747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:52.990785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:52.990802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:52.990815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:52.990844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:53.000651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:53.000751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:53.000776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:53.000789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:53.000802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:53.000831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:53.010721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:53.010824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.227 [2024-11-27 17:23:53.010852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.227 [2024-11-27 17:23:53.010867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.227 [2024-11-27 17:23:53.010886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.227 [2024-11-27 17:23:53.010917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.227 qpair failed and we were unable to recover it. 00:30:56.227 [2024-11-27 17:23:53.020733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.227 [2024-11-27 17:23:53.020829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.020856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.020870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.020883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.020912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.030786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.030887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.030912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.030927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.030940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.030970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.040792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.040888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.040913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.040928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.040940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.040971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.050840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.050952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.050978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.050992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.051005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.051034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.060859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.060956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.060982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.060997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.061010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.061040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.070873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.070973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.070999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.071014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.071026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.071056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.080904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.080996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.081020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.081034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.081047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.081075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.091011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.091119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.091143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.091156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.091168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.091198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.101012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.101109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.101135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.101150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.101170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.101199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.110973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.111068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.111095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.111109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.111122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.111151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.121033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.121132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.121159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.121173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.121186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.121216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.131044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.131145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.131171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.131186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.131198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.131228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.141092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.141191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.141215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.141229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.141241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.228 [2024-11-27 17:23:53.141270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.228 qpair failed and we were unable to recover it. 00:30:56.228 [2024-11-27 17:23:53.151127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.228 [2024-11-27 17:23:53.151232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.228 [2024-11-27 17:23:53.151258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.228 [2024-11-27 17:23:53.151272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.228 [2024-11-27 17:23:53.151284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.229 [2024-11-27 17:23:53.151313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.229 qpair failed and we were unable to recover it. 00:30:56.229 [2024-11-27 17:23:53.161152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.229 [2024-11-27 17:23:53.161245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.229 [2024-11-27 17:23:53.161272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.229 [2024-11-27 17:23:53.161286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.229 [2024-11-27 17:23:53.161299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.229 [2024-11-27 17:23:53.161327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.229 qpair failed and we were unable to recover it. 00:30:56.229 [2024-11-27 17:23:53.171189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.229 [2024-11-27 17:23:53.171330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.229 [2024-11-27 17:23:53.171355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.229 [2024-11-27 17:23:53.171370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.229 [2024-11-27 17:23:53.171383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.229 [2024-11-27 17:23:53.171411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.229 qpair failed and we were unable to recover it. 00:30:56.488 [2024-11-27 17:23:53.181183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.488 [2024-11-27 17:23:53.181287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.488 [2024-11-27 17:23:53.181318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.488 [2024-11-27 17:23:53.181344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.488 [2024-11-27 17:23:53.181369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.488 [2024-11-27 17:23:53.181404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.488 qpair failed and we were unable to recover it. 00:30:56.488 [2024-11-27 17:23:53.191211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.488 [2024-11-27 17:23:53.191307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.488 [2024-11-27 17:23:53.191331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.488 [2024-11-27 17:23:53.191351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.488 [2024-11-27 17:23:53.191365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.488 [2024-11-27 17:23:53.191394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.488 qpair failed and we were unable to recover it. 00:30:56.488 [2024-11-27 17:23:53.201261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.488 [2024-11-27 17:23:53.201368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.201396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.201410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.201424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.201455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.211311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.211439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.211463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.211478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.211490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.211520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.221310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.221415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.221443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.221458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.221471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.221501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.231321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.231412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.231436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.231451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.231463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.231493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.241377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.241501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.241531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.241548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.241561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.241590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.251371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.251465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.251489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.251503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.251516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.251553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.261406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.261535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.261561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.261575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.261587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.261616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.271426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.271519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.271549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.271563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.271576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.271604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.281463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.281566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.281590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.281610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.281623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.281652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.291504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.291609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.291633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.291646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.291659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.291687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.301548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.301648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.301672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.301687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.301699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.301728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.311555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.311678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.311701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.311715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.311729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.311758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.321585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.321683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.321710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.321724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.489 [2024-11-27 17:23:53.321737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.489 [2024-11-27 17:23:53.321766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.489 qpair failed and we were unable to recover it. 00:30:56.489 [2024-11-27 17:23:53.331634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.489 [2024-11-27 17:23:53.331736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.489 [2024-11-27 17:23:53.331766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.489 [2024-11-27 17:23:53.331790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.331803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.331833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.341660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.341771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.341810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.341825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.341838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.341868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.351697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.351832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.351859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.351874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.351886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.351914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.361752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.361867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.361893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.361907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.361920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.361949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.371766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.371863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.371888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.371909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.371924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.371952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.381767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.381899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.381926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.381941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.381953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.381983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.391813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.391909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.391935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.391949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.391962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.391991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.401844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.401971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.401997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.402012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.402026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.402069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.411883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.411996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.412025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.412040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.412054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.412084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.421853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.421962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.421988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.422002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.422015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.422044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.490 [2024-11-27 17:23:53.431913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.490 [2024-11-27 17:23:53.432013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.490 [2024-11-27 17:23:53.432047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.490 [2024-11-27 17:23:53.432062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.490 [2024-11-27 17:23:53.432076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.490 [2024-11-27 17:23:53.432104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.490 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.441957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.442058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.442085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.442100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.442114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.442143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.451958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.452063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.452090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.452104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.452117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.452146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.462023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.462137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.462167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.462189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.462203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.462233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.472064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.472173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.472199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.472213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.472227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.472256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.482082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.482195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.482224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.482239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.482253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.482281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.492134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.492270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.492298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.492313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.492327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.492355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.502132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.502236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.502265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.502280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.502294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.502323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.512129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.512238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.512263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.512277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.512291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.512319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.522199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.522303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.522329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.522343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.522357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.522386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.532183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.532284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.532309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.750 [2024-11-27 17:23:53.532323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.750 [2024-11-27 17:23:53.532337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.750 [2024-11-27 17:23:53.532365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.750 qpair failed and we were unable to recover it. 00:30:56.750 [2024-11-27 17:23:53.542254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.750 [2024-11-27 17:23:53.542361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.750 [2024-11-27 17:23:53.542386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.542400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.542414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.542442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.552255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.552376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.552406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.552421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.552434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.552463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.562275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.562373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.562399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.562413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.562427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.562456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.572328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.572434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.572459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.572474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.572487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.572516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.582339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.582452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.582479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.582493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.582507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.582542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.592364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.592464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.592489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.592504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.592517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.592553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.602391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.602504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.602539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.602555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.602569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.602597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.612437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.612558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.612584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.612598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.612612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.612640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.622450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.622558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.622584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.622598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.622611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.622640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.632485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.632590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.632616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.632630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.632643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.632672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.642511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.642622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.642653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.642668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.642682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.642711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.652582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.652706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.652732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.652746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.652760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.652788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.662571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.662673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.662699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.662713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.662727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.662755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.751 [2024-11-27 17:23:53.672627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.751 [2024-11-27 17:23:53.672731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.751 [2024-11-27 17:23:53.672757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.751 [2024-11-27 17:23:53.672771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.751 [2024-11-27 17:23:53.672784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.751 [2024-11-27 17:23:53.672813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.751 qpair failed and we were unable to recover it. 00:30:56.752 [2024-11-27 17:23:53.682646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.752 [2024-11-27 17:23:53.682748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.752 [2024-11-27 17:23:53.682774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.752 [2024-11-27 17:23:53.682788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.752 [2024-11-27 17:23:53.682801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.752 [2024-11-27 17:23:53.682836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.752 qpair failed and we were unable to recover it. 00:30:56.752 [2024-11-27 17:23:53.692719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:56.752 [2024-11-27 17:23:53.692826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:56.752 [2024-11-27 17:23:53.692852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:56.752 [2024-11-27 17:23:53.692866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:56.752 [2024-11-27 17:23:53.692879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:56.752 [2024-11-27 17:23:53.692907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:56.752 qpair failed and we were unable to recover it. 00:30:57.010 [2024-11-27 17:23:53.702687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.010 [2024-11-27 17:23:53.702796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.010 [2024-11-27 17:23:53.702823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.010 [2024-11-27 17:23:53.702838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.010 [2024-11-27 17:23:53.702852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.702880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.712772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.712881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.712909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.712923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.712936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.712981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.722784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.722888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.722914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.722928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.722941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.722970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.732792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.732902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.732933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.732949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.732963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.732991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.742798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.742905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.742930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.742945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.742958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.742986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.752829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.752932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.752958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.752973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.752986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.753015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.762875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.763006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.763031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.763045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.763059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.763088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.772913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.773023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.773049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.773063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.773076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.773110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.782921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.783020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.783045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.783059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.783072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.783100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.792951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.793044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.793069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.793083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.793097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.793125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.802998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.803099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.803124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.803138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.803152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.803180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.813047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.813171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.813199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.813214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.813227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.813256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.823021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.823117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.823148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.823163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.823176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.823206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.011 [2024-11-27 17:23:53.833094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.011 [2024-11-27 17:23:53.833200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.011 [2024-11-27 17:23:53.833229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.011 [2024-11-27 17:23:53.833244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.011 [2024-11-27 17:23:53.833258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.011 [2024-11-27 17:23:53.833286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.011 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.843099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.843206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.843231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.843245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.843259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.843288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.853150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.853257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.853283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.853298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.853311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.853339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.863164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.863266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.863291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.863305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.863319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.863354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.873213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.873324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.873349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.873364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.873377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.873406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.883247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.883359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.883384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.883399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.883413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.883441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.893258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.893365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.893391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.893405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.893419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.893447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.903294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.903399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.903426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.903440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.903453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.903482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.913314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.913418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.913449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.913464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.913478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.913506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.923312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.923411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.923436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.923451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.923464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.923492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.933416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.933530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.933556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.933570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.933584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.933612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.943387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.943497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.943522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.943544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.943558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.943588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.012 [2024-11-27 17:23:53.953408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.012 [2024-11-27 17:23:53.953501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.012 [2024-11-27 17:23:53.953534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.012 [2024-11-27 17:23:53.953550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.012 [2024-11-27 17:23:53.953564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.012 [2024-11-27 17:23:53.953598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.012 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:53.963455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:53.963567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:53.963595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:53.963611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:53.963624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:53.963653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:53.973513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:53.973657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:53.973685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:53.973700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:53.973713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:53.973743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:53.983482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:53.983588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:53.983615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:53.983629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:53.983642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:53.983672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:53.993542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:53.993689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:53.993715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:53.993729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:53.993742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:53.993771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.003608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.003722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.003753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.003768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.003782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.003810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.013590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.013685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.013711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.013725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.013738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.013767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.023634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.023740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.023766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.023780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.023794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.023822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.033622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.033726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.033751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.033764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.033778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.033806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.043694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.043795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.043821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.043836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.043855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.043884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.053712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.053820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.053846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.053859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.053873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.053901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.063719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.063823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.063849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.063863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.063876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.063905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.073778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.073873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.073899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.073914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.073927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.073956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.272 [2024-11-27 17:23:54.083762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.272 [2024-11-27 17:23:54.083859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.272 [2024-11-27 17:23:54.083885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.272 [2024-11-27 17:23:54.083900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.272 [2024-11-27 17:23:54.083913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.272 [2024-11-27 17:23:54.083942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.272 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.093823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.093936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.093961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.093975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.093988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.094017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.103888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.104005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.104031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.104045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.104059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.104087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.113857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.113955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.113981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.113995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.114009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.114036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.123949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.124054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.124084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.124101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.124114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.124143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.133961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.134068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.134095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.134109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.134132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.134162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.143974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.144078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.144105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.144119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.144132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.144161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.154026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.154138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.154164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.154178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.154191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.154219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.164019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.164113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.164137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.164151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.164163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.164192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.174075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.174181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.174208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.174223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.174236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.174265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.184106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.184209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.184235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.184249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.184261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.184290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.194088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.194183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.194209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.194223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.194236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.194266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.204144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.204260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.204286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.204301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.204314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.204342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.273 [2024-11-27 17:23:54.214155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.273 [2024-11-27 17:23:54.214298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.273 [2024-11-27 17:23:54.214324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.273 [2024-11-27 17:23:54.214338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.273 [2024-11-27 17:23:54.214351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.273 [2024-11-27 17:23:54.214380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.273 qpair failed and we were unable to recover it. 00:30:57.532 [2024-11-27 17:23:54.224210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.532 [2024-11-27 17:23:54.224307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.224333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.224348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.224366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.224397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.234249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.234391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.234418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.234433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.234447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.234475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.244272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.244373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.244401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.244416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.244428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.244458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.254292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.254391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.254421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.254437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.254449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.254478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.264301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.264424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.264450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.264464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.264476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.264507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.274338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.274440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.274464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.274478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.274490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.274518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.284393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.284490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.284516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.284537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.284551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.284581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.294465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.294604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.294630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.294653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.294666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.294694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.304416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.304557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.304583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.304597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.304610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.304639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.314457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.314553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.314578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.314592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.314609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.314640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.324504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.324623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.324653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.324668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.324681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.324710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.334512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.334622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.334646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.334661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.334677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.334706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.344578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.344703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.344730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.344744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.533 [2024-11-27 17:23:54.344757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.533 [2024-11-27 17:23:54.344786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.533 qpair failed and we were unable to recover it. 00:30:57.533 [2024-11-27 17:23:54.354585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.533 [2024-11-27 17:23:54.354689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.533 [2024-11-27 17:23:54.354713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.533 [2024-11-27 17:23:54.354726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.354739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.354767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.364642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.364745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.364769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.364783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.364796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.364824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.374654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.374754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.374778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.374792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.374804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.374832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.384662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.384758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.384782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.384796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.384808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.384836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.394752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.394893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.394919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.394933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.394947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.394975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.404774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.404878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.404903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.404924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.404939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.404968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.414793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.414916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.414941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.414955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.414968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.414996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.424773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.424868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.424892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.424906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.424918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.424946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.434799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.434895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.434920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.434934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.434946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1b66390 00:30:57.534 [2024-11-27 17:23:54.434975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.444853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.444948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.444982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.444999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.445012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f94ec000b90 00:30:57.534 [2024-11-27 17:23:54.445044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.454905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:57.534 [2024-11-27 17:23:54.455007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:57.534 [2024-11-27 17:23:54.455035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:57.534 [2024-11-27 17:23:54.455050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:57.534 [2024-11-27 17:23:54.455063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f94ec000b90 00:30:57.534 [2024-11-27 17:23:54.455094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:57.534 qpair failed and we were unable to recover it. 00:30:57.534 [2024-11-27 17:23:54.455221] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:57.534 A controller has encountered a failure and is being reset. 00:30:57.792 Controller properly reset. 00:30:57.792 Initializing NVMe Controllers 00:30:57.792 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:57.792 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:57.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:57.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:57.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:57.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:57.792 Initialization complete. Launching workers. 00:30:57.792 Starting thread on core 1 00:30:57.792 Starting thread on core 2 00:30:57.792 Starting thread on core 3 00:30:57.792 Starting thread on core 0 00:30:57.792 17:23:54 -- host/target_disconnect.sh@59 -- # sync 00:30:57.792 00:30:57.792 real 0m11.579s 00:30:57.792 user 0m21.798s 00:30:57.792 sys 0m5.265s 00:30:57.792 17:23:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:57.792 17:23:54 -- common/autotest_common.sh@10 -- # set +x 00:30:57.792 ************************************ 00:30:57.792 END TEST nvmf_target_disconnect_tc2 00:30:57.792 ************************************ 00:30:57.792 17:23:54 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:57.792 17:23:54 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:57.792 17:23:54 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:57.792 17:23:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:57.792 17:23:54 -- nvmf/common.sh@116 -- # sync 00:30:57.792 17:23:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:57.792 17:23:54 -- nvmf/common.sh@119 -- # set +e 00:30:57.792 17:23:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:57.792 17:23:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:57.792 rmmod nvme_tcp 00:30:57.792 rmmod nvme_fabrics 00:30:57.792 rmmod nvme_keyring 00:30:57.792 17:23:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:57.792 17:23:54 -- nvmf/common.sh@123 -- # set -e 00:30:57.792 17:23:54 -- nvmf/common.sh@124 -- # return 0 00:30:57.792 17:23:54 -- nvmf/common.sh@477 -- # '[' -n 1875682 ']' 00:30:57.792 17:23:54 -- nvmf/common.sh@478 -- # killprocess 1875682 00:30:57.792 17:23:54 -- common/autotest_common.sh@936 -- # '[' -z 1875682 ']' 00:30:57.792 17:23:54 -- common/autotest_common.sh@940 -- # kill -0 1875682 00:30:57.792 17:23:54 -- common/autotest_common.sh@941 -- # uname 00:30:57.792 17:23:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:57.792 17:23:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1875682 00:30:58.050 17:23:54 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:58.050 17:23:54 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:58.050 17:23:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1875682' 00:30:58.050 killing process with pid 1875682 00:30:58.050 17:23:54 -- common/autotest_common.sh@955 -- # kill 1875682 00:30:58.050 17:23:54 -- common/autotest_common.sh@960 -- # wait 1875682 00:30:58.309 17:23:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:58.309 17:23:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:58.309 17:23:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:58.309 17:23:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:58.309 17:23:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:58.309 17:23:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:58.309 17:23:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:58.309 17:23:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:00.212 17:23:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:00.212 00:31:00.212 real 0m16.487s 00:31:00.212 user 0m48.672s 00:31:00.212 sys 0m7.270s 00:31:00.212 17:23:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:00.212 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.212 ************************************ 00:31:00.212 END TEST nvmf_target_disconnect 00:31:00.212 ************************************ 00:31:00.212 17:23:57 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:31:00.212 17:23:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.212 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.212 17:23:57 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:31:00.212 00:31:00.212 real 22m56.545s 00:31:00.212 user 66m21.781s 00:31:00.212 sys 5m37.054s 00:31:00.212 17:23:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:00.212 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.212 ************************************ 00:31:00.212 END TEST nvmf_tcp 00:31:00.212 ************************************ 00:31:00.212 17:23:57 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:31:00.212 17:23:57 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:00.212 17:23:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:00.212 17:23:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:00.212 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.212 ************************************ 00:31:00.212 START TEST spdkcli_nvmf_tcp 00:31:00.212 ************************************ 00:31:00.212 17:23:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:00.212 * Looking for test storage... 00:31:00.471 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:31:00.471 17:23:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:00.471 17:23:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:00.471 17:23:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:00.471 17:23:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:00.471 17:23:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:00.471 17:23:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:00.471 17:23:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:00.471 17:23:57 -- scripts/common.sh@335 -- # IFS=.-: 00:31:00.471 17:23:57 -- scripts/common.sh@335 -- # read -ra ver1 00:31:00.471 17:23:57 -- scripts/common.sh@336 -- # IFS=.-: 00:31:00.471 17:23:57 -- scripts/common.sh@336 -- # read -ra ver2 00:31:00.471 17:23:57 -- scripts/common.sh@337 -- # local 'op=<' 00:31:00.471 17:23:57 -- scripts/common.sh@339 -- # ver1_l=2 00:31:00.471 17:23:57 -- scripts/common.sh@340 -- # ver2_l=1 00:31:00.471 17:23:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:00.471 17:23:57 -- scripts/common.sh@343 -- # case "$op" in 00:31:00.471 17:23:57 -- scripts/common.sh@344 -- # : 1 00:31:00.471 17:23:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:00.471 17:23:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:00.471 17:23:57 -- scripts/common.sh@364 -- # decimal 1 00:31:00.471 17:23:57 -- scripts/common.sh@352 -- # local d=1 00:31:00.471 17:23:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:00.471 17:23:57 -- scripts/common.sh@354 -- # echo 1 00:31:00.471 17:23:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:00.471 17:23:57 -- scripts/common.sh@365 -- # decimal 2 00:31:00.471 17:23:57 -- scripts/common.sh@352 -- # local d=2 00:31:00.471 17:23:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:00.471 17:23:57 -- scripts/common.sh@354 -- # echo 2 00:31:00.471 17:23:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:00.471 17:23:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:00.471 17:23:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:00.471 17:23:57 -- scripts/common.sh@367 -- # return 0 00:31:00.471 17:23:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:00.471 17:23:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:00.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:00.471 --rc genhtml_branch_coverage=1 00:31:00.471 --rc genhtml_function_coverage=1 00:31:00.471 --rc genhtml_legend=1 00:31:00.471 --rc geninfo_all_blocks=1 00:31:00.471 --rc geninfo_unexecuted_blocks=1 00:31:00.471 00:31:00.471 ' 00:31:00.471 17:23:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:00.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:00.471 --rc genhtml_branch_coverage=1 00:31:00.471 --rc genhtml_function_coverage=1 00:31:00.471 --rc genhtml_legend=1 00:31:00.471 --rc geninfo_all_blocks=1 00:31:00.471 --rc geninfo_unexecuted_blocks=1 00:31:00.471 00:31:00.471 ' 00:31:00.471 17:23:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:00.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:00.471 --rc genhtml_branch_coverage=1 00:31:00.471 --rc genhtml_function_coverage=1 00:31:00.471 --rc genhtml_legend=1 00:31:00.471 --rc geninfo_all_blocks=1 00:31:00.471 --rc geninfo_unexecuted_blocks=1 00:31:00.471 00:31:00.471 ' 00:31:00.471 17:23:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:00.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:00.471 --rc genhtml_branch_coverage=1 00:31:00.471 --rc genhtml_function_coverage=1 00:31:00.471 --rc genhtml_legend=1 00:31:00.471 --rc geninfo_all_blocks=1 00:31:00.471 --rc geninfo_unexecuted_blocks=1 00:31:00.471 00:31:00.471 ' 00:31:00.471 17:23:57 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:31:00.471 17:23:57 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:31:00.471 17:23:57 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:31:00.471 17:23:57 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:00.471 17:23:57 -- nvmf/common.sh@7 -- # uname -s 00:31:00.471 17:23:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:00.471 17:23:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:00.471 17:23:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:00.471 17:23:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:00.471 17:23:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:00.471 17:23:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:00.471 17:23:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:00.471 17:23:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:00.471 17:23:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:00.471 17:23:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:00.471 17:23:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:00.471 17:23:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:00.471 17:23:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:00.471 17:23:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:00.471 17:23:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:00.471 17:23:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:00.471 17:23:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:00.471 17:23:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:00.471 17:23:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:00.472 17:23:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:00.472 17:23:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:00.472 17:23:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:00.472 17:23:57 -- paths/export.sh@5 -- # export PATH 00:31:00.472 17:23:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:00.472 17:23:57 -- nvmf/common.sh@46 -- # : 0 00:31:00.472 17:23:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:00.472 17:23:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:00.472 17:23:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:00.472 17:23:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:00.472 17:23:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:00.472 17:23:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:00.472 17:23:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:00.472 17:23:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:00.472 17:23:57 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:31:00.472 17:23:57 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:31:00.472 17:23:57 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:31:00.472 17:23:57 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:31:00.472 17:23:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:00.472 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.472 17:23:57 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:31:00.472 17:23:57 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1876913 00:31:00.472 17:23:57 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:31:00.472 17:23:57 -- spdkcli/common.sh@34 -- # waitforlisten 1876913 00:31:00.472 17:23:57 -- common/autotest_common.sh@829 -- # '[' -z 1876913 ']' 00:31:00.472 17:23:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:00.472 17:23:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:00.472 17:23:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:00.472 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:00.472 17:23:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:00.472 17:23:57 -- common/autotest_common.sh@10 -- # set +x 00:31:00.472 [2024-11-27 17:23:57.308606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:00.472 [2024-11-27 17:23:57.308702] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1876913 ] 00:31:00.472 EAL: No free 2048 kB hugepages reported on node 1 00:31:00.472 [2024-11-27 17:23:57.369989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:31:00.729 [2024-11-27 17:23:57.460102] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:00.729 [2024-11-27 17:23:57.461556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:00.729 [2024-11-27 17:23:57.461557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:01.664 17:23:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:01.664 17:23:58 -- common/autotest_common.sh@862 -- # return 0 00:31:01.664 17:23:58 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:01.664 17:23:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:01.664 17:23:58 -- common/autotest_common.sh@10 -- # set +x 00:31:01.664 17:23:58 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:01.664 17:23:58 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:01.664 17:23:58 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:01.664 17:23:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:01.664 17:23:58 -- common/autotest_common.sh@10 -- # set +x 00:31:01.664 17:23:58 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:01.664 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:01.664 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:01.664 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:01.664 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:01.664 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:01.664 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:01.664 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:01.664 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:01.664 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:01.664 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:01.664 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:01.664 ' 00:31:01.923 [2024-11-27 17:23:58.711352] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:04.456 [2024-11-27 17:24:00.889085] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:05.391 [2024-11-27 17:24:02.133652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:07.917 [2024-11-27 17:24:04.420956] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:09.814 [2024-11-27 17:24:06.411395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:11.188 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:11.188 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:11.188 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:11.188 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:11.188 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:11.188 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:11.188 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:11.188 17:24:08 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:11.188 17:24:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:11.188 17:24:08 -- common/autotest_common.sh@10 -- # set +x 00:31:11.188 17:24:08 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:11.188 17:24:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:11.188 17:24:08 -- common/autotest_common.sh@10 -- # set +x 00:31:11.188 17:24:08 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:11.188 17:24:08 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:11.755 17:24:08 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:11.755 17:24:08 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:11.755 17:24:08 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:11.755 17:24:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:11.755 17:24:08 -- common/autotest_common.sh@10 -- # set +x 00:31:11.755 17:24:08 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:11.755 17:24:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:11.755 17:24:08 -- common/autotest_common.sh@10 -- # set +x 00:31:11.755 17:24:08 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:11.755 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:11.755 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:11.755 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:11.755 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:11.755 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:11.755 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:11.755 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:11.755 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:11.755 ' 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:17.095 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:17.095 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:17.095 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:17.095 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:17.095 17:24:13 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:17.095 17:24:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:17.095 17:24:13 -- common/autotest_common.sh@10 -- # set +x 00:31:17.095 17:24:13 -- spdkcli/nvmf.sh@90 -- # killprocess 1876913 00:31:17.095 17:24:13 -- common/autotest_common.sh@936 -- # '[' -z 1876913 ']' 00:31:17.095 17:24:13 -- common/autotest_common.sh@940 -- # kill -0 1876913 00:31:17.095 17:24:13 -- common/autotest_common.sh@941 -- # uname 00:31:17.095 17:24:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:17.095 17:24:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1876913 00:31:17.095 17:24:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:17.095 17:24:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:17.095 17:24:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1876913' 00:31:17.095 killing process with pid 1876913 00:31:17.095 17:24:13 -- common/autotest_common.sh@955 -- # kill 1876913 00:31:17.095 [2024-11-27 17:24:13.950178] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:17.095 17:24:13 -- common/autotest_common.sh@960 -- # wait 1876913 00:31:17.353 17:24:14 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:17.353 17:24:14 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:17.353 17:24:14 -- spdkcli/common.sh@13 -- # '[' -n 1876913 ']' 00:31:17.353 17:24:14 -- spdkcli/common.sh@14 -- # killprocess 1876913 00:31:17.353 17:24:14 -- common/autotest_common.sh@936 -- # '[' -z 1876913 ']' 00:31:17.353 17:24:14 -- common/autotest_common.sh@940 -- # kill -0 1876913 00:31:17.353 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1876913) - No such process 00:31:17.353 17:24:14 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1876913 is not found' 00:31:17.353 Process with pid 1876913 is not found 00:31:17.353 17:24:14 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:17.353 17:24:14 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:17.353 17:24:14 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:17.353 00:31:17.353 real 0m17.057s 00:31:17.353 user 0m36.425s 00:31:17.353 sys 0m0.814s 00:31:17.353 17:24:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:17.353 17:24:14 -- common/autotest_common.sh@10 -- # set +x 00:31:17.353 ************************************ 00:31:17.353 END TEST spdkcli_nvmf_tcp 00:31:17.353 ************************************ 00:31:17.353 17:24:14 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:17.353 17:24:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:17.353 17:24:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:17.353 17:24:14 -- common/autotest_common.sh@10 -- # set +x 00:31:17.353 ************************************ 00:31:17.353 START TEST nvmf_identify_passthru 00:31:17.353 ************************************ 00:31:17.353 17:24:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:17.353 * Looking for test storage... 00:31:17.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:17.353 17:24:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:17.353 17:24:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:17.353 17:24:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:17.612 17:24:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:17.612 17:24:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:17.612 17:24:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:17.612 17:24:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:17.612 17:24:14 -- scripts/common.sh@335 -- # IFS=.-: 00:31:17.612 17:24:14 -- scripts/common.sh@335 -- # read -ra ver1 00:31:17.612 17:24:14 -- scripts/common.sh@336 -- # IFS=.-: 00:31:17.612 17:24:14 -- scripts/common.sh@336 -- # read -ra ver2 00:31:17.612 17:24:14 -- scripts/common.sh@337 -- # local 'op=<' 00:31:17.612 17:24:14 -- scripts/common.sh@339 -- # ver1_l=2 00:31:17.612 17:24:14 -- scripts/common.sh@340 -- # ver2_l=1 00:31:17.612 17:24:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:17.612 17:24:14 -- scripts/common.sh@343 -- # case "$op" in 00:31:17.612 17:24:14 -- scripts/common.sh@344 -- # : 1 00:31:17.612 17:24:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:17.612 17:24:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:17.612 17:24:14 -- scripts/common.sh@364 -- # decimal 1 00:31:17.612 17:24:14 -- scripts/common.sh@352 -- # local d=1 00:31:17.612 17:24:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:17.612 17:24:14 -- scripts/common.sh@354 -- # echo 1 00:31:17.612 17:24:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:17.612 17:24:14 -- scripts/common.sh@365 -- # decimal 2 00:31:17.612 17:24:14 -- scripts/common.sh@352 -- # local d=2 00:31:17.612 17:24:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:17.612 17:24:14 -- scripts/common.sh@354 -- # echo 2 00:31:17.612 17:24:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:17.612 17:24:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:17.612 17:24:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:17.612 17:24:14 -- scripts/common.sh@367 -- # return 0 00:31:17.612 17:24:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:17.612 17:24:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.612 --rc genhtml_branch_coverage=1 00:31:17.612 --rc genhtml_function_coverage=1 00:31:17.612 --rc genhtml_legend=1 00:31:17.612 --rc geninfo_all_blocks=1 00:31:17.612 --rc geninfo_unexecuted_blocks=1 00:31:17.612 00:31:17.612 ' 00:31:17.612 17:24:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.612 --rc genhtml_branch_coverage=1 00:31:17.612 --rc genhtml_function_coverage=1 00:31:17.612 --rc genhtml_legend=1 00:31:17.612 --rc geninfo_all_blocks=1 00:31:17.612 --rc geninfo_unexecuted_blocks=1 00:31:17.612 00:31:17.612 ' 00:31:17.612 17:24:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.612 --rc genhtml_branch_coverage=1 00:31:17.612 --rc genhtml_function_coverage=1 00:31:17.612 --rc genhtml_legend=1 00:31:17.612 --rc geninfo_all_blocks=1 00:31:17.612 --rc geninfo_unexecuted_blocks=1 00:31:17.612 00:31:17.612 ' 00:31:17.612 17:24:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.612 --rc genhtml_branch_coverage=1 00:31:17.612 --rc genhtml_function_coverage=1 00:31:17.612 --rc genhtml_legend=1 00:31:17.612 --rc geninfo_all_blocks=1 00:31:17.612 --rc geninfo_unexecuted_blocks=1 00:31:17.612 00:31:17.612 ' 00:31:17.612 17:24:14 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:17.612 17:24:14 -- nvmf/common.sh@7 -- # uname -s 00:31:17.612 17:24:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:17.612 17:24:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:17.612 17:24:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:17.612 17:24:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:17.612 17:24:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:17.612 17:24:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:17.612 17:24:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:17.612 17:24:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:17.612 17:24:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:17.612 17:24:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:17.612 17:24:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:17.612 17:24:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:17.612 17:24:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:17.612 17:24:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:17.612 17:24:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:17.612 17:24:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:17.612 17:24:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:17.612 17:24:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:17.612 17:24:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:17.612 17:24:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@5 -- # export PATH 00:31:17.612 17:24:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- nvmf/common.sh@46 -- # : 0 00:31:17.612 17:24:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:17.612 17:24:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:17.612 17:24:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:17.612 17:24:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:17.612 17:24:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:17.612 17:24:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:17.612 17:24:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:17.612 17:24:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:17.612 17:24:14 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:17.612 17:24:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:17.612 17:24:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:17.612 17:24:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:17.612 17:24:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- paths/export.sh@5 -- # export PATH 00:31:17.612 17:24:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.612 17:24:14 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:17.612 17:24:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:17.612 17:24:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:17.612 17:24:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:17.612 17:24:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:17.612 17:24:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:17.613 17:24:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:17.613 17:24:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:17.613 17:24:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:17.613 17:24:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:17.613 17:24:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:17.613 17:24:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:17.613 17:24:14 -- common/autotest_common.sh@10 -- # set +x 00:31:19.514 17:24:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:19.514 17:24:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:19.514 17:24:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:19.514 17:24:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:19.514 17:24:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:19.514 17:24:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:19.514 17:24:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:19.514 17:24:16 -- nvmf/common.sh@294 -- # net_devs=() 00:31:19.514 17:24:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:19.514 17:24:16 -- nvmf/common.sh@295 -- # e810=() 00:31:19.514 17:24:16 -- nvmf/common.sh@295 -- # local -ga e810 00:31:19.514 17:24:16 -- nvmf/common.sh@296 -- # x722=() 00:31:19.514 17:24:16 -- nvmf/common.sh@296 -- # local -ga x722 00:31:19.514 17:24:16 -- nvmf/common.sh@297 -- # mlx=() 00:31:19.514 17:24:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:19.514 17:24:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:19.514 17:24:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:19.514 17:24:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:19.514 17:24:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:19.514 17:24:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:19.514 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:19.514 17:24:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:19.514 17:24:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:19.514 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:19.514 17:24:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:19.514 17:24:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:19.514 17:24:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:19.514 17:24:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:19.514 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:19.514 17:24:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:19.514 17:24:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:19.514 17:24:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:19.514 17:24:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:19.514 17:24:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:19.514 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:19.514 17:24:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:19.514 17:24:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:19.514 17:24:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:19.514 17:24:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:19.514 17:24:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:19.514 17:24:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:19.514 17:24:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:19.514 17:24:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:19.514 17:24:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:19.514 17:24:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:19.514 17:24:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:19.514 17:24:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:19.514 17:24:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:19.515 17:24:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:19.515 17:24:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:19.515 17:24:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:19.515 17:24:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:19.515 17:24:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:19.515 17:24:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:19.515 17:24:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:19.515 17:24:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:19.515 17:24:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:19.515 17:24:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:19.515 17:24:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:19.515 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:19.515 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.362 ms 00:31:19.515 00:31:19.515 --- 10.0.0.2 ping statistics --- 00:31:19.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:19.515 rtt min/avg/max/mdev = 0.362/0.362/0.362/0.000 ms 00:31:19.515 17:24:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:19.515 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:19.515 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:31:19.515 00:31:19.515 --- 10.0.0.1 ping statistics --- 00:31:19.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:19.515 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:31:19.515 17:24:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:19.515 17:24:16 -- nvmf/common.sh@410 -- # return 0 00:31:19.515 17:24:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:19.515 17:24:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:19.515 17:24:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:19.515 17:24:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:19.515 17:24:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:19.515 17:24:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:19.515 17:24:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:19.515 17:24:16 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:19.515 17:24:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.515 17:24:16 -- common/autotest_common.sh@10 -- # set +x 00:31:19.515 17:24:16 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:19.515 17:24:16 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:19.515 17:24:16 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:19.515 17:24:16 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:19.515 17:24:16 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:19.515 17:24:16 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:19.515 17:24:16 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:19.515 17:24:16 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:19.515 17:24:16 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:19.515 17:24:16 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:19.773 17:24:16 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:19.773 17:24:16 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:19.773 17:24:16 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:19.773 17:24:16 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:19.773 17:24:16 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:19.773 17:24:16 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:19.773 17:24:16 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:19.773 17:24:16 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:19.773 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.958 17:24:20 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:23.958 17:24:20 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:23.958 17:24:20 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:23.958 17:24:20 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:23.958 EAL: No free 2048 kB hugepages reported on node 1 00:31:28.142 17:24:24 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:28.142 17:24:24 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:28.142 17:24:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:28.142 17:24:24 -- common/autotest_common.sh@10 -- # set +x 00:31:28.142 17:24:24 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:28.142 17:24:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:28.142 17:24:24 -- common/autotest_common.sh@10 -- # set +x 00:31:28.142 17:24:24 -- target/identify_passthru.sh@31 -- # nvmfpid=1882266 00:31:28.142 17:24:24 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:28.142 17:24:24 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:28.142 17:24:24 -- target/identify_passthru.sh@35 -- # waitforlisten 1882266 00:31:28.142 17:24:24 -- common/autotest_common.sh@829 -- # '[' -z 1882266 ']' 00:31:28.142 17:24:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:28.142 17:24:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:28.142 17:24:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:28.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:28.142 17:24:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:28.142 17:24:24 -- common/autotest_common.sh@10 -- # set +x 00:31:28.142 [2024-11-27 17:24:25.010338] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:28.142 [2024-11-27 17:24:25.010433] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:28.142 EAL: No free 2048 kB hugepages reported on node 1 00:31:28.142 [2024-11-27 17:24:25.081250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:28.401 [2024-11-27 17:24:25.179414] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:28.401 [2024-11-27 17:24:25.179583] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:28.401 [2024-11-27 17:24:25.179602] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:28.401 [2024-11-27 17:24:25.179614] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:28.401 [2024-11-27 17:24:25.182550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:28.401 [2024-11-27 17:24:25.182584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:28.401 [2024-11-27 17:24:25.182697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:28.401 [2024-11-27 17:24:25.182700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:28.401 17:24:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:28.401 17:24:25 -- common/autotest_common.sh@862 -- # return 0 00:31:28.401 17:24:25 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:28.401 17:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.401 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:31:28.401 INFO: Log level set to 20 00:31:28.401 INFO: Requests: 00:31:28.401 { 00:31:28.401 "jsonrpc": "2.0", 00:31:28.401 "method": "nvmf_set_config", 00:31:28.401 "id": 1, 00:31:28.401 "params": { 00:31:28.401 "admin_cmd_passthru": { 00:31:28.401 "identify_ctrlr": true 00:31:28.401 } 00:31:28.401 } 00:31:28.401 } 00:31:28.401 00:31:28.401 INFO: response: 00:31:28.401 { 00:31:28.401 "jsonrpc": "2.0", 00:31:28.401 "id": 1, 00:31:28.401 "result": true 00:31:28.401 } 00:31:28.401 00:31:28.401 17:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.401 17:24:25 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:28.401 17:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.401 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:31:28.401 INFO: Setting log level to 20 00:31:28.401 INFO: Setting log level to 20 00:31:28.401 INFO: Log level set to 20 00:31:28.401 INFO: Log level set to 20 00:31:28.401 INFO: Requests: 00:31:28.401 { 00:31:28.401 "jsonrpc": "2.0", 00:31:28.401 "method": "framework_start_init", 00:31:28.401 "id": 1 00:31:28.401 } 00:31:28.401 00:31:28.401 INFO: Requests: 00:31:28.401 { 00:31:28.401 "jsonrpc": "2.0", 00:31:28.401 "method": "framework_start_init", 00:31:28.401 "id": 1 00:31:28.401 } 00:31:28.401 00:31:28.659 [2024-11-27 17:24:25.371760] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:28.659 INFO: response: 00:31:28.659 { 00:31:28.659 "jsonrpc": "2.0", 00:31:28.659 "id": 1, 00:31:28.659 "result": true 00:31:28.659 } 00:31:28.659 00:31:28.659 INFO: response: 00:31:28.659 { 00:31:28.659 "jsonrpc": "2.0", 00:31:28.659 "id": 1, 00:31:28.659 "result": true 00:31:28.659 } 00:31:28.659 00:31:28.659 17:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.659 17:24:25 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:28.659 17:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.659 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:31:28.659 INFO: Setting log level to 40 00:31:28.659 INFO: Setting log level to 40 00:31:28.659 INFO: Setting log level to 40 00:31:28.659 [2024-11-27 17:24:25.381681] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:28.659 17:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.659 17:24:25 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:28.659 17:24:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:28.659 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:31:28.659 17:24:25 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:28.659 17:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.659 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:31:31.934 Nvme0n1 00:31:31.934 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.934 17:24:28 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:31.934 17:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.934 17:24:28 -- common/autotest_common.sh@10 -- # set +x 00:31:31.934 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.934 17:24:28 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:31.934 17:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.934 17:24:28 -- common/autotest_common.sh@10 -- # set +x 00:31:31.934 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.934 17:24:28 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:31.934 17:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.934 17:24:28 -- common/autotest_common.sh@10 -- # set +x 00:31:31.934 [2024-11-27 17:24:28.271749] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.934 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.934 17:24:28 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:31.934 17:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.934 17:24:28 -- common/autotest_common.sh@10 -- # set +x 00:31:31.934 [2024-11-27 17:24:28.279466] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:31.934 [ 00:31:31.934 { 00:31:31.934 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:31.934 "subtype": "Discovery", 00:31:31.934 "listen_addresses": [], 00:31:31.934 "allow_any_host": true, 00:31:31.934 "hosts": [] 00:31:31.934 }, 00:31:31.934 { 00:31:31.934 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:31.934 "subtype": "NVMe", 00:31:31.934 "listen_addresses": [ 00:31:31.934 { 00:31:31.934 "transport": "TCP", 00:31:31.934 "trtype": "TCP", 00:31:31.934 "adrfam": "IPv4", 00:31:31.934 "traddr": "10.0.0.2", 00:31:31.934 "trsvcid": "4420" 00:31:31.934 } 00:31:31.934 ], 00:31:31.934 "allow_any_host": true, 00:31:31.934 "hosts": [], 00:31:31.934 "serial_number": "SPDK00000000000001", 00:31:31.934 "model_number": "SPDK bdev Controller", 00:31:31.934 "max_namespaces": 1, 00:31:31.934 "min_cntlid": 1, 00:31:31.934 "max_cntlid": 65519, 00:31:31.934 "namespaces": [ 00:31:31.934 { 00:31:31.934 "nsid": 1, 00:31:31.934 "bdev_name": "Nvme0n1", 00:31:31.934 "name": "Nvme0n1", 00:31:31.934 "nguid": "766459671F4C447EBBC02396F72D95BB", 00:31:31.934 "uuid": "76645967-1f4c-447e-bbc0-2396f72d95bb" 00:31:31.934 } 00:31:31.934 ] 00:31:31.934 } 00:31:31.934 ] 00:31:31.934 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.934 17:24:28 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:31.935 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.935 17:24:28 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:31.935 17:24:28 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:31.935 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.935 17:24:28 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:31.935 17:24:28 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:31.935 17:24:28 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:31.935 17:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.935 17:24:28 -- common/autotest_common.sh@10 -- # set +x 00:31:31.935 17:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.935 17:24:28 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:31.935 17:24:28 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:31.935 17:24:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:31.935 17:24:28 -- nvmf/common.sh@116 -- # sync 00:31:31.935 17:24:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:31.935 17:24:28 -- nvmf/common.sh@119 -- # set +e 00:31:31.935 17:24:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:31.935 17:24:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:31.935 rmmod nvme_tcp 00:31:31.935 rmmod nvme_fabrics 00:31:31.935 rmmod nvme_keyring 00:31:31.935 17:24:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:31.935 17:24:28 -- nvmf/common.sh@123 -- # set -e 00:31:31.935 17:24:28 -- nvmf/common.sh@124 -- # return 0 00:31:31.935 17:24:28 -- nvmf/common.sh@477 -- # '[' -n 1882266 ']' 00:31:31.935 17:24:28 -- nvmf/common.sh@478 -- # killprocess 1882266 00:31:31.935 17:24:28 -- common/autotest_common.sh@936 -- # '[' -z 1882266 ']' 00:31:31.935 17:24:28 -- common/autotest_common.sh@940 -- # kill -0 1882266 00:31:31.935 17:24:28 -- common/autotest_common.sh@941 -- # uname 00:31:31.935 17:24:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:31.935 17:24:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1882266 00:31:31.935 17:24:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:31.935 17:24:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:31.935 17:24:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1882266' 00:31:31.935 killing process with pid 1882266 00:31:31.935 17:24:28 -- common/autotest_common.sh@955 -- # kill 1882266 00:31:31.935 [2024-11-27 17:24:28.721793] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:31.935 17:24:28 -- common/autotest_common.sh@960 -- # wait 1882266 00:31:33.831 17:24:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:33.831 17:24:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:33.831 17:24:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:33.831 17:24:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:33.831 17:24:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:33.831 17:24:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:33.831 17:24:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:33.831 17:24:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:35.734 17:24:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:35.734 00:31:35.734 real 0m18.106s 00:31:35.734 user 0m26.870s 00:31:35.734 sys 0m2.300s 00:31:35.734 17:24:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:35.734 17:24:32 -- common/autotest_common.sh@10 -- # set +x 00:31:35.734 ************************************ 00:31:35.734 END TEST nvmf_identify_passthru 00:31:35.734 ************************************ 00:31:35.734 17:24:32 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:35.734 17:24:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:35.734 17:24:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:35.734 17:24:32 -- common/autotest_common.sh@10 -- # set +x 00:31:35.734 ************************************ 00:31:35.734 START TEST nvmf_dif 00:31:35.734 ************************************ 00:31:35.734 17:24:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:35.734 * Looking for test storage... 00:31:35.734 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:35.734 17:24:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:35.734 17:24:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:35.734 17:24:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:35.734 17:24:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:35.734 17:24:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:35.734 17:24:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:35.734 17:24:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:35.734 17:24:32 -- scripts/common.sh@335 -- # IFS=.-: 00:31:35.734 17:24:32 -- scripts/common.sh@335 -- # read -ra ver1 00:31:35.734 17:24:32 -- scripts/common.sh@336 -- # IFS=.-: 00:31:35.734 17:24:32 -- scripts/common.sh@336 -- # read -ra ver2 00:31:35.734 17:24:32 -- scripts/common.sh@337 -- # local 'op=<' 00:31:35.734 17:24:32 -- scripts/common.sh@339 -- # ver1_l=2 00:31:35.734 17:24:32 -- scripts/common.sh@340 -- # ver2_l=1 00:31:35.734 17:24:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:35.734 17:24:32 -- scripts/common.sh@343 -- # case "$op" in 00:31:35.734 17:24:32 -- scripts/common.sh@344 -- # : 1 00:31:35.734 17:24:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:35.734 17:24:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:35.734 17:24:32 -- scripts/common.sh@364 -- # decimal 1 00:31:35.734 17:24:32 -- scripts/common.sh@352 -- # local d=1 00:31:35.734 17:24:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:35.734 17:24:32 -- scripts/common.sh@354 -- # echo 1 00:31:35.734 17:24:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:35.734 17:24:32 -- scripts/common.sh@365 -- # decimal 2 00:31:35.734 17:24:32 -- scripts/common.sh@352 -- # local d=2 00:31:35.734 17:24:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:35.734 17:24:32 -- scripts/common.sh@354 -- # echo 2 00:31:35.734 17:24:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:35.734 17:24:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:35.734 17:24:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:35.734 17:24:32 -- scripts/common.sh@367 -- # return 0 00:31:35.734 17:24:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:35.734 17:24:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:35.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:35.734 --rc genhtml_branch_coverage=1 00:31:35.734 --rc genhtml_function_coverage=1 00:31:35.734 --rc genhtml_legend=1 00:31:35.734 --rc geninfo_all_blocks=1 00:31:35.734 --rc geninfo_unexecuted_blocks=1 00:31:35.734 00:31:35.734 ' 00:31:35.734 17:24:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:35.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:35.734 --rc genhtml_branch_coverage=1 00:31:35.734 --rc genhtml_function_coverage=1 00:31:35.734 --rc genhtml_legend=1 00:31:35.734 --rc geninfo_all_blocks=1 00:31:35.734 --rc geninfo_unexecuted_blocks=1 00:31:35.734 00:31:35.734 ' 00:31:35.734 17:24:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:35.734 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:35.734 --rc genhtml_branch_coverage=1 00:31:35.734 --rc genhtml_function_coverage=1 00:31:35.734 --rc genhtml_legend=1 00:31:35.734 --rc geninfo_all_blocks=1 00:31:35.734 --rc geninfo_unexecuted_blocks=1 00:31:35.734 00:31:35.734 ' 00:31:35.735 17:24:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:35.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:35.735 --rc genhtml_branch_coverage=1 00:31:35.735 --rc genhtml_function_coverage=1 00:31:35.735 --rc genhtml_legend=1 00:31:35.735 --rc geninfo_all_blocks=1 00:31:35.735 --rc geninfo_unexecuted_blocks=1 00:31:35.735 00:31:35.735 ' 00:31:35.735 17:24:32 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:35.735 17:24:32 -- nvmf/common.sh@7 -- # uname -s 00:31:35.735 17:24:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:35.735 17:24:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:35.735 17:24:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:35.735 17:24:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:35.735 17:24:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:35.735 17:24:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:35.735 17:24:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:35.735 17:24:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:35.735 17:24:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:35.735 17:24:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:35.735 17:24:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:35.735 17:24:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:35.735 17:24:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:35.735 17:24:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:35.735 17:24:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:35.735 17:24:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:35.735 17:24:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:35.735 17:24:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:35.735 17:24:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:35.735 17:24:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.735 17:24:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.735 17:24:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.735 17:24:32 -- paths/export.sh@5 -- # export PATH 00:31:35.735 17:24:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.735 17:24:32 -- nvmf/common.sh@46 -- # : 0 00:31:35.735 17:24:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:35.735 17:24:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:35.735 17:24:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:35.735 17:24:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:35.735 17:24:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:35.735 17:24:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:35.735 17:24:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:35.735 17:24:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:35.735 17:24:32 -- target/dif.sh@15 -- # NULL_META=16 00:31:35.735 17:24:32 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:35.735 17:24:32 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:35.735 17:24:32 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:35.735 17:24:32 -- target/dif.sh@135 -- # nvmftestinit 00:31:35.735 17:24:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:35.735 17:24:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:35.735 17:24:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:35.735 17:24:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:35.735 17:24:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:35.735 17:24:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:35.735 17:24:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:35.735 17:24:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:35.735 17:24:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:35.735 17:24:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:35.735 17:24:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:35.735 17:24:32 -- common/autotest_common.sh@10 -- # set +x 00:31:37.636 17:24:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:37.636 17:24:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:37.636 17:24:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:37.636 17:24:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:37.636 17:24:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:37.636 17:24:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:37.636 17:24:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:37.636 17:24:34 -- nvmf/common.sh@294 -- # net_devs=() 00:31:37.636 17:24:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:37.636 17:24:34 -- nvmf/common.sh@295 -- # e810=() 00:31:37.636 17:24:34 -- nvmf/common.sh@295 -- # local -ga e810 00:31:37.636 17:24:34 -- nvmf/common.sh@296 -- # x722=() 00:31:37.636 17:24:34 -- nvmf/common.sh@296 -- # local -ga x722 00:31:37.636 17:24:34 -- nvmf/common.sh@297 -- # mlx=() 00:31:37.636 17:24:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:37.636 17:24:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:37.636 17:24:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:37.636 17:24:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:37.636 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:37.636 17:24:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:37.636 17:24:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:37.636 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:37.636 17:24:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:37.636 17:24:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:37.636 17:24:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:37.636 17:24:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:37.636 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:37.636 17:24:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:37.636 17:24:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:37.636 17:24:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:37.636 17:24:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:37.636 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:37.636 17:24:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:37.636 17:24:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:37.636 17:24:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:37.636 17:24:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:37.636 17:24:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:37.636 17:24:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:37.636 17:24:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:37.636 17:24:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:37.636 17:24:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:37.636 17:24:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:37.636 17:24:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:37.636 17:24:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:37.636 17:24:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:37.636 17:24:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:37.636 17:24:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:37.636 17:24:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:37.636 17:24:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:37.636 17:24:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:37.636 17:24:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:37.636 17:24:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:37.636 17:24:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:37.636 17:24:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:37.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:37.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:31:37.636 00:31:37.636 --- 10.0.0.2 ping statistics --- 00:31:37.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:37.636 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:31:37.636 17:24:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:37.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:37.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:31:37.636 00:31:37.636 --- 10.0.0.1 ping statistics --- 00:31:37.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:37.636 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:31:37.636 17:24:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:37.636 17:24:34 -- nvmf/common.sh@410 -- # return 0 00:31:37.636 17:24:34 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:37.636 17:24:34 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:39.008 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:39.008 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:39.008 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:39.008 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:39.008 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:39.008 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:39.008 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:39.008 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:39.008 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:39.008 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:39.008 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:39.008 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:39.008 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:39.008 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:39.008 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:39.008 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:39.008 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:39.009 17:24:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:39.009 17:24:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:39.009 17:24:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:39.009 17:24:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:39.009 17:24:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:39.009 17:24:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:39.009 17:24:35 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:39.009 17:24:35 -- target/dif.sh@137 -- # nvmfappstart 00:31:39.009 17:24:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:39.009 17:24:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:39.009 17:24:35 -- common/autotest_common.sh@10 -- # set +x 00:31:39.009 17:24:35 -- nvmf/common.sh@469 -- # nvmfpid=1885589 00:31:39.009 17:24:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:39.009 17:24:35 -- nvmf/common.sh@470 -- # waitforlisten 1885589 00:31:39.009 17:24:35 -- common/autotest_common.sh@829 -- # '[' -z 1885589 ']' 00:31:39.009 17:24:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:39.009 17:24:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:39.009 17:24:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:39.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:39.009 17:24:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:39.009 17:24:35 -- common/autotest_common.sh@10 -- # set +x 00:31:39.009 [2024-11-27 17:24:35.812697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:39.009 [2024-11-27 17:24:35.812774] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:39.009 EAL: No free 2048 kB hugepages reported on node 1 00:31:39.009 [2024-11-27 17:24:35.882743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:39.267 [2024-11-27 17:24:35.971876] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:39.267 [2024-11-27 17:24:35.972066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:39.267 [2024-11-27 17:24:35.972087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:39.267 [2024-11-27 17:24:35.972102] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:39.267 [2024-11-27 17:24:35.972132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:40.208 17:24:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:40.209 17:24:36 -- common/autotest_common.sh@862 -- # return 0 00:31:40.209 17:24:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:40.209 17:24:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 17:24:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:40.209 17:24:36 -- target/dif.sh@139 -- # create_transport 00:31:40.209 17:24:36 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:40.209 17:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 [2024-11-27 17:24:36.845679] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:40.209 17:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.209 17:24:36 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:40.209 17:24:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:40.209 17:24:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 ************************************ 00:31:40.209 START TEST fio_dif_1_default 00:31:40.209 ************************************ 00:31:40.209 17:24:36 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:40.209 17:24:36 -- target/dif.sh@86 -- # create_subsystems 0 00:31:40.209 17:24:36 -- target/dif.sh@28 -- # local sub 00:31:40.209 17:24:36 -- target/dif.sh@30 -- # for sub in "$@" 00:31:40.209 17:24:36 -- target/dif.sh@31 -- # create_subsystem 0 00:31:40.209 17:24:36 -- target/dif.sh@18 -- # local sub_id=0 00:31:40.209 17:24:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:40.209 17:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 bdev_null0 00:31:40.209 17:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.209 17:24:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:40.209 17:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 17:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.209 17:24:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:40.209 17:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 17:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.209 17:24:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:40.209 17:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.209 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:31:40.209 [2024-11-27 17:24:36.881936] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:40.209 17:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.209 17:24:36 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:40.209 17:24:36 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:40.209 17:24:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:40.209 17:24:36 -- nvmf/common.sh@520 -- # config=() 00:31:40.209 17:24:36 -- nvmf/common.sh@520 -- # local subsystem config 00:31:40.209 17:24:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.209 17:24:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.209 17:24:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.209 { 00:31:40.209 "params": { 00:31:40.209 "name": "Nvme$subsystem", 00:31:40.209 "trtype": "$TEST_TRANSPORT", 00:31:40.209 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.209 "adrfam": "ipv4", 00:31:40.209 "trsvcid": "$NVMF_PORT", 00:31:40.209 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.209 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.209 "hdgst": ${hdgst:-false}, 00:31:40.209 "ddgst": ${ddgst:-false} 00:31:40.209 }, 00:31:40.209 "method": "bdev_nvme_attach_controller" 00:31:40.209 } 00:31:40.209 EOF 00:31:40.209 )") 00:31:40.209 17:24:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.209 17:24:36 -- target/dif.sh@82 -- # gen_fio_conf 00:31:40.209 17:24:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:40.209 17:24:36 -- target/dif.sh@54 -- # local file 00:31:40.209 17:24:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:40.209 17:24:36 -- target/dif.sh@56 -- # cat 00:31:40.209 17:24:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:40.209 17:24:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.209 17:24:36 -- common/autotest_common.sh@1330 -- # shift 00:31:40.209 17:24:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:40.209 17:24:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.209 17:24:36 -- nvmf/common.sh@542 -- # cat 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.209 17:24:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:40.209 17:24:36 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.209 17:24:36 -- nvmf/common.sh@544 -- # jq . 00:31:40.209 17:24:36 -- nvmf/common.sh@545 -- # IFS=, 00:31:40.209 17:24:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:40.209 "params": { 00:31:40.209 "name": "Nvme0", 00:31:40.209 "trtype": "tcp", 00:31:40.209 "traddr": "10.0.0.2", 00:31:40.209 "adrfam": "ipv4", 00:31:40.209 "trsvcid": "4420", 00:31:40.209 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:40.209 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:40.209 "hdgst": false, 00:31:40.209 "ddgst": false 00:31:40.209 }, 00:31:40.209 "method": "bdev_nvme_attach_controller" 00:31:40.209 }' 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.209 17:24:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.209 17:24:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.209 17:24:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.209 17:24:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.209 17:24:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:40.209 17:24:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.468 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:40.468 fio-3.35 00:31:40.468 Starting 1 thread 00:31:40.468 EAL: No free 2048 kB hugepages reported on node 1 00:31:40.726 [2024-11-27 17:24:37.672522] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:40.726 [2024-11-27 17:24:37.672605] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:52.918 00:31:52.918 filename0: (groupid=0, jobs=1): err= 0: pid=1885849: Wed Nov 27 17:24:47 2024 00:31:52.918 read: IOPS=103, BW=414KiB/s (424kB/s)(4144KiB/10017msec) 00:31:52.918 slat (nsec): min=4516, max=50365, avg=9088.95, stdev=3104.73 00:31:52.918 clat (usec): min=546, max=47427, avg=38645.05, stdev=11023.86 00:31:52.918 lat (usec): min=554, max=47442, avg=38654.14, stdev=11023.84 00:31:52.918 clat percentiles (usec): 00:31:52.918 | 1.00th=[ 570], 5.00th=[ 594], 10.00th=[41157], 20.00th=[41157], 00:31:52.918 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:31:52.918 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:52.918 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:31:52.918 | 99.99th=[47449] 00:31:52.918 bw ( KiB/s): min= 352, max= 608, per=99.59%, avg=412.80, stdev=53.85, samples=20 00:31:52.918 iops : min= 88, max= 152, avg=103.20, stdev=13.46, samples=20 00:31:52.918 lat (usec) : 750=7.72% 00:31:52.918 lat (msec) : 50=92.28% 00:31:52.918 cpu : usr=91.66%, sys=7.76%, ctx=28, majf=0, minf=280 00:31:52.918 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.918 issued rwts: total=1036,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.918 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:52.918 00:31:52.918 Run status group 0 (all jobs): 00:31:52.918 READ: bw=414KiB/s (424kB/s), 414KiB/s-414KiB/s (424kB/s-424kB/s), io=4144KiB (4243kB), run=10017-10017msec 00:31:52.918 17:24:48 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:52.918 17:24:48 -- target/dif.sh@43 -- # local sub 00:31:52.918 17:24:48 -- target/dif.sh@45 -- # for sub in "$@" 00:31:52.918 17:24:48 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:52.918 17:24:48 -- target/dif.sh@36 -- # local sub_id=0 00:31:52.918 17:24:48 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:52.918 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.918 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.918 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.918 17:24:48 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:52.918 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.918 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.918 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.918 00:31:52.918 real 0m11.253s 00:31:52.918 user 0m10.448s 00:31:52.918 sys 0m1.065s 00:31:52.918 17:24:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:52.918 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.918 ************************************ 00:31:52.918 END TEST fio_dif_1_default 00:31:52.918 ************************************ 00:31:52.918 17:24:48 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:52.918 17:24:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:52.918 17:24:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:52.918 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.918 ************************************ 00:31:52.918 START TEST fio_dif_1_multi_subsystems 00:31:52.918 ************************************ 00:31:52.918 17:24:48 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:52.918 17:24:48 -- target/dif.sh@92 -- # local files=1 00:31:52.918 17:24:48 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:52.918 17:24:48 -- target/dif.sh@28 -- # local sub 00:31:52.918 17:24:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.918 17:24:48 -- target/dif.sh@31 -- # create_subsystem 0 00:31:52.918 17:24:48 -- target/dif.sh@18 -- # local sub_id=0 00:31:52.919 17:24:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 bdev_null0 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 [2024-11-27 17:24:48.167061] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.919 17:24:48 -- target/dif.sh@31 -- # create_subsystem 1 00:31:52.919 17:24:48 -- target/dif.sh@18 -- # local sub_id=1 00:31:52.919 17:24:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 bdev_null1 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:52.919 17:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.919 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:31:52.919 17:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.919 17:24:48 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:52.919 17:24:48 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:52.919 17:24:48 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:52.919 17:24:48 -- nvmf/common.sh@520 -- # config=() 00:31:52.919 17:24:48 -- nvmf/common.sh@520 -- # local subsystem config 00:31:52.919 17:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.919 17:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.919 { 00:31:52.919 "params": { 00:31:52.919 "name": "Nvme$subsystem", 00:31:52.919 "trtype": "$TEST_TRANSPORT", 00:31:52.919 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.919 "adrfam": "ipv4", 00:31:52.919 "trsvcid": "$NVMF_PORT", 00:31:52.919 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.919 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.919 "hdgst": ${hdgst:-false}, 00:31:52.919 "ddgst": ${ddgst:-false} 00:31:52.919 }, 00:31:52.919 "method": "bdev_nvme_attach_controller" 00:31:52.919 } 00:31:52.919 EOF 00:31:52.919 )") 00:31:52.919 17:24:48 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.919 17:24:48 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.919 17:24:48 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:52.919 17:24:48 -- target/dif.sh@82 -- # gen_fio_conf 00:31:52.919 17:24:48 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:52.919 17:24:48 -- target/dif.sh@54 -- # local file 00:31:52.919 17:24:48 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:52.919 17:24:48 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.919 17:24:48 -- target/dif.sh@56 -- # cat 00:31:52.919 17:24:48 -- common/autotest_common.sh@1330 -- # shift 00:31:52.919 17:24:48 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:52.919 17:24:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.919 17:24:48 -- nvmf/common.sh@542 -- # cat 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:52.919 17:24:48 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.919 17:24:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.919 17:24:48 -- target/dif.sh@73 -- # cat 00:31:52.919 17:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.919 17:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.919 { 00:31:52.919 "params": { 00:31:52.919 "name": "Nvme$subsystem", 00:31:52.919 "trtype": "$TEST_TRANSPORT", 00:31:52.919 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.919 "adrfam": "ipv4", 00:31:52.919 "trsvcid": "$NVMF_PORT", 00:31:52.919 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.919 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.919 "hdgst": ${hdgst:-false}, 00:31:52.919 "ddgst": ${ddgst:-false} 00:31:52.919 }, 00:31:52.919 "method": "bdev_nvme_attach_controller" 00:31:52.919 } 00:31:52.919 EOF 00:31:52.919 )") 00:31:52.919 17:24:48 -- nvmf/common.sh@542 -- # cat 00:31:52.919 17:24:48 -- target/dif.sh@72 -- # (( file++ )) 00:31:52.919 17:24:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.919 17:24:48 -- nvmf/common.sh@544 -- # jq . 00:31:52.919 17:24:48 -- nvmf/common.sh@545 -- # IFS=, 00:31:52.919 17:24:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:52.919 "params": { 00:31:52.919 "name": "Nvme0", 00:31:52.919 "trtype": "tcp", 00:31:52.919 "traddr": "10.0.0.2", 00:31:52.919 "adrfam": "ipv4", 00:31:52.919 "trsvcid": "4420", 00:31:52.919 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:52.919 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:52.919 "hdgst": false, 00:31:52.919 "ddgst": false 00:31:52.919 }, 00:31:52.919 "method": "bdev_nvme_attach_controller" 00:31:52.919 },{ 00:31:52.919 "params": { 00:31:52.919 "name": "Nvme1", 00:31:52.919 "trtype": "tcp", 00:31:52.919 "traddr": "10.0.0.2", 00:31:52.919 "adrfam": "ipv4", 00:31:52.919 "trsvcid": "4420", 00:31:52.919 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:52.919 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:52.919 "hdgst": false, 00:31:52.919 "ddgst": false 00:31:52.919 }, 00:31:52.919 "method": "bdev_nvme_attach_controller" 00:31:52.919 }' 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.919 17:24:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.919 17:24:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.919 17:24:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.919 17:24:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.919 17:24:48 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:52.919 17:24:48 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.919 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:52.919 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:52.919 fio-3.35 00:31:52.919 Starting 2 threads 00:31:52.919 EAL: No free 2048 kB hugepages reported on node 1 00:31:52.919 [2024-11-27 17:24:49.336354] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:52.919 [2024-11-27 17:24:49.336400] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:02.885 00:32:02.885 filename0: (groupid=0, jobs=1): err= 0: pid=1887392: Wed Nov 27 17:24:59 2024 00:32:02.885 read: IOPS=188, BW=753KiB/s (771kB/s)(7536KiB/10006msec) 00:32:02.885 slat (nsec): min=6992, max=41338, avg=9087.86, stdev=3278.48 00:32:02.885 clat (usec): min=563, max=42818, avg=21215.68, stdev=20457.17 00:32:02.885 lat (usec): min=571, max=42837, avg=21224.77, stdev=20456.89 00:32:02.885 clat percentiles (usec): 00:32:02.885 | 1.00th=[ 594], 5.00th=[ 611], 10.00th=[ 619], 20.00th=[ 627], 00:32:02.885 | 30.00th=[ 635], 40.00th=[ 652], 50.00th=[41157], 60.00th=[41157], 00:32:02.885 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:32:02.885 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:32:02.885 | 99.99th=[42730] 00:32:02.885 bw ( KiB/s): min= 672, max= 768, per=49.92%, avg=752.00, stdev=28.43, samples=20 00:32:02.885 iops : min= 168, max= 192, avg=188.00, stdev= 7.11, samples=20 00:32:02.885 lat (usec) : 750=49.68% 00:32:02.885 lat (msec) : 50=50.32% 00:32:02.886 cpu : usr=95.53%, sys=4.16%, ctx=15, majf=0, minf=202 00:32:02.886 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:02.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.886 issued rwts: total=1884,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:02.886 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:02.886 filename1: (groupid=0, jobs=1): err= 0: pid=1887393: Wed Nov 27 17:24:59 2024 00:32:02.886 read: IOPS=188, BW=754KiB/s (772kB/s)(7552KiB/10016msec) 00:32:02.886 slat (nsec): min=7006, max=51184, avg=9164.93, stdev=3196.14 00:32:02.886 clat (usec): min=573, max=42849, avg=21191.61, stdev=20384.63 00:32:02.886 lat (usec): min=593, max=42874, avg=21200.78, stdev=20384.34 00:32:02.886 clat percentiles (usec): 00:32:02.886 | 1.00th=[ 594], 5.00th=[ 611], 10.00th=[ 619], 20.00th=[ 627], 00:32:02.886 | 30.00th=[ 635], 40.00th=[ 660], 50.00th=[40633], 60.00th=[41157], 00:32:02.886 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:32:02.886 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:32:02.886 | 99.99th=[42730] 00:32:02.886 bw ( KiB/s): min= 704, max= 768, per=49.99%, avg=753.60, stdev=26.42, samples=20 00:32:02.886 iops : min= 176, max= 192, avg=188.40, stdev= 6.60, samples=20 00:32:02.886 lat (usec) : 750=49.15%, 1000=0.42% 00:32:02.886 lat (msec) : 50=50.42% 00:32:02.886 cpu : usr=95.65%, sys=4.04%, ctx=18, majf=0, minf=67 00:32:02.886 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:02.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.886 issued rwts: total=1888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:02.886 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:02.886 00:32:02.886 Run status group 0 (all jobs): 00:32:02.886 READ: bw=1506KiB/s (1543kB/s), 753KiB/s-754KiB/s (771kB/s-772kB/s), io=14.7MiB (15.5MB), run=10006-10016msec 00:32:02.886 17:24:59 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:02.886 17:24:59 -- target/dif.sh@43 -- # local sub 00:32:02.886 17:24:59 -- target/dif.sh@45 -- # for sub in "$@" 00:32:02.886 17:24:59 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:02.886 17:24:59 -- target/dif.sh@36 -- # local sub_id=0 00:32:02.886 17:24:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 17:24:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 17:24:59 -- target/dif.sh@45 -- # for sub in "$@" 00:32:02.886 17:24:59 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:02.886 17:24:59 -- target/dif.sh@36 -- # local sub_id=1 00:32:02.886 17:24:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 17:24:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 00:32:02.886 real 0m11.649s 00:32:02.886 user 0m20.755s 00:32:02.886 sys 0m1.165s 00:32:02.886 17:24:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 ************************************ 00:32:02.886 END TEST fio_dif_1_multi_subsystems 00:32:02.886 ************************************ 00:32:02.886 17:24:59 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:02.886 17:24:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:02.886 17:24:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 ************************************ 00:32:02.886 START TEST fio_dif_rand_params 00:32:02.886 ************************************ 00:32:02.886 17:24:59 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:32:02.886 17:24:59 -- target/dif.sh@100 -- # local NULL_DIF 00:32:02.886 17:24:59 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:02.886 17:24:59 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:02.886 17:24:59 -- target/dif.sh@103 -- # bs=128k 00:32:02.886 17:24:59 -- target/dif.sh@103 -- # numjobs=3 00:32:02.886 17:24:59 -- target/dif.sh@103 -- # iodepth=3 00:32:02.886 17:24:59 -- target/dif.sh@103 -- # runtime=5 00:32:02.886 17:24:59 -- target/dif.sh@105 -- # create_subsystems 0 00:32:02.886 17:24:59 -- target/dif.sh@28 -- # local sub 00:32:02.886 17:24:59 -- target/dif.sh@30 -- # for sub in "$@" 00:32:02.886 17:24:59 -- target/dif.sh@31 -- # create_subsystem 0 00:32:02.886 17:24:59 -- target/dif.sh@18 -- # local sub_id=0 00:32:02.886 17:24:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 bdev_null0 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 17:24:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:02.886 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.886 17:24:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:02.886 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.886 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:03.145 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:03.145 17:24:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:03.145 17:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:03.145 17:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:03.145 [2024-11-27 17:24:59.845874] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:03.145 17:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:03.145 17:24:59 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:03.145 17:24:59 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:03.145 17:24:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:03.145 17:24:59 -- nvmf/common.sh@520 -- # config=() 00:32:03.145 17:24:59 -- nvmf/common.sh@520 -- # local subsystem config 00:32:03.145 17:24:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:03.145 17:24:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:03.145 { 00:32:03.145 "params": { 00:32:03.145 "name": "Nvme$subsystem", 00:32:03.145 "trtype": "$TEST_TRANSPORT", 00:32:03.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:03.145 "adrfam": "ipv4", 00:32:03.145 "trsvcid": "$NVMF_PORT", 00:32:03.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:03.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:03.145 "hdgst": ${hdgst:-false}, 00:32:03.145 "ddgst": ${ddgst:-false} 00:32:03.145 }, 00:32:03.145 "method": "bdev_nvme_attach_controller" 00:32:03.145 } 00:32:03.145 EOF 00:32:03.145 )") 00:32:03.145 17:24:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:03.145 17:24:59 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:03.145 17:24:59 -- target/dif.sh@82 -- # gen_fio_conf 00:32:03.145 17:24:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:03.145 17:24:59 -- target/dif.sh@54 -- # local file 00:32:03.145 17:24:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:03.145 17:24:59 -- target/dif.sh@56 -- # cat 00:32:03.145 17:24:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:03.145 17:24:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:03.146 17:24:59 -- common/autotest_common.sh@1330 -- # shift 00:32:03.146 17:24:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:03.146 17:24:59 -- nvmf/common.sh@542 -- # cat 00:32:03.146 17:24:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:03.146 17:24:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:03.146 17:24:59 -- target/dif.sh@72 -- # (( file <= files )) 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:03.146 17:24:59 -- nvmf/common.sh@544 -- # jq . 00:32:03.146 17:24:59 -- nvmf/common.sh@545 -- # IFS=, 00:32:03.146 17:24:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:03.146 "params": { 00:32:03.146 "name": "Nvme0", 00:32:03.146 "trtype": "tcp", 00:32:03.146 "traddr": "10.0.0.2", 00:32:03.146 "adrfam": "ipv4", 00:32:03.146 "trsvcid": "4420", 00:32:03.146 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:03.146 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:03.146 "hdgst": false, 00:32:03.146 "ddgst": false 00:32:03.146 }, 00:32:03.146 "method": "bdev_nvme_attach_controller" 00:32:03.146 }' 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:03.146 17:24:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:03.146 17:24:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:03.146 17:24:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:03.146 17:24:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:03.146 17:24:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:03.146 17:24:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:03.406 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:03.406 ... 00:32:03.406 fio-3.35 00:32:03.406 Starting 3 threads 00:32:03.406 EAL: No free 2048 kB hugepages reported on node 1 00:32:03.663 [2024-11-27 17:25:00.609630] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:03.663 [2024-11-27 17:25:00.609754] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:08.923 00:32:08.923 filename0: (groupid=0, jobs=1): err= 0: pid=1888829: Wed Nov 27 17:25:05 2024 00:32:08.923 read: IOPS=245, BW=30.7MiB/s (32.2MB/s)(155MiB/5047msec) 00:32:08.923 slat (nsec): min=4444, max=82273, avg=13324.08, stdev=4095.78 00:32:08.923 clat (usec): min=5006, max=59475, avg=12147.00, stdev=8139.39 00:32:08.923 lat (usec): min=5018, max=59491, avg=12160.32, stdev=8139.61 00:32:08.923 clat percentiles (usec): 00:32:08.923 | 1.00th=[ 5604], 5.00th=[ 6652], 10.00th=[ 7046], 20.00th=[ 7635], 00:32:08.923 | 30.00th=[ 8094], 40.00th=[ 8586], 50.00th=[ 9241], 60.00th=[11207], 00:32:08.923 | 70.00th=[13173], 80.00th=[15008], 90.00th=[17695], 95.00th=[19268], 00:32:08.923 | 99.00th=[51119], 99.50th=[52691], 99.90th=[54789], 99.95th=[59507], 00:32:08.923 | 99.99th=[59507] 00:32:08.923 bw ( KiB/s): min=22272, max=37888, per=38.89%, avg=31697.90, stdev=5438.72, samples=10 00:32:08.923 iops : min= 174, max= 296, avg=247.60, stdev=42.54, samples=10 00:32:08.923 lat (msec) : 10=54.63%, 20=41.02%, 50=3.14%, 100=1.21% 00:32:08.923 cpu : usr=94.41%, sys=5.13%, ctx=13, majf=0, minf=167 00:32:08.923 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:08.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 issued rwts: total=1241,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:08.923 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:08.923 filename0: (groupid=0, jobs=1): err= 0: pid=1888830: Wed Nov 27 17:25:05 2024 00:32:08.923 read: IOPS=156, BW=19.6MiB/s (20.6MB/s)(99.0MiB/5047msec) 00:32:08.923 slat (nsec): min=4057, max=52566, avg=18518.44, stdev=6125.98 00:32:08.923 clat (usec): min=4671, max=54342, avg=19036.88, stdev=16894.77 00:32:08.923 lat (usec): min=4684, max=54367, avg=19055.39, stdev=16895.35 00:32:08.923 clat percentiles (usec): 00:32:08.923 | 1.00th=[ 5473], 5.00th=[ 6063], 10.00th=[ 8160], 20.00th=[ 9372], 00:32:08.923 | 30.00th=[10028], 40.00th=[10552], 50.00th=[11076], 60.00th=[11600], 00:32:08.923 | 70.00th=[12387], 80.00th=[48497], 90.00th=[51119], 95.00th=[52167], 00:32:08.923 | 99.00th=[53216], 99.50th=[53216], 99.90th=[54264], 99.95th=[54264], 00:32:08.923 | 99.99th=[54264] 00:32:08.923 bw ( KiB/s): min=14080, max=28928, per=24.78%, avg=20198.40, stdev=5053.36, samples=10 00:32:08.923 iops : min= 110, max= 226, avg=157.80, stdev=39.48, samples=10 00:32:08.923 lat (msec) : 10=29.55%, 20=48.99%, 50=3.54%, 100=17.93% 00:32:08.923 cpu : usr=96.10%, sys=3.37%, ctx=14, majf=0, minf=65 00:32:08.923 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:08.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 issued rwts: total=792,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:08.923 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:08.923 filename0: (groupid=0, jobs=1): err= 0: pid=1888831: Wed Nov 27 17:25:05 2024 00:32:08.923 read: IOPS=235, BW=29.5MiB/s (30.9MB/s)(148MiB/5005msec) 00:32:08.923 slat (nsec): min=4263, max=37843, avg=13053.06, stdev=3062.67 00:32:08.923 clat (usec): min=4919, max=61651, avg=12694.66, stdev=7568.24 00:32:08.923 lat (usec): min=4931, max=61662, avg=12707.71, stdev=7568.55 00:32:08.923 clat percentiles (usec): 00:32:08.923 | 1.00th=[ 5145], 5.00th=[ 6194], 10.00th=[ 7635], 20.00th=[ 8586], 00:32:08.923 | 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10421], 60.00th=[11863], 00:32:08.923 | 70.00th=[13698], 80.00th=[15795], 90.00th=[18482], 95.00th=[19792], 00:32:08.923 | 99.00th=[51643], 99.50th=[54264], 99.90th=[61604], 99.95th=[61604], 00:32:08.923 | 99.99th=[61604] 00:32:08.923 bw ( KiB/s): min=26368, max=34048, per=37.00%, avg=30156.80, stdev=2811.60, samples=10 00:32:08.923 iops : min= 206, max= 266, avg=235.60, stdev=21.97, samples=10 00:32:08.923 lat (msec) : 10=44.54%, 20=50.89%, 50=3.13%, 100=1.44% 00:32:08.923 cpu : usr=94.02%, sys=5.50%, ctx=11, majf=0, minf=158 00:32:08.923 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:08.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:08.923 issued rwts: total=1181,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:08.923 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:08.923 00:32:08.923 Run status group 0 (all jobs): 00:32:08.923 READ: bw=79.6MiB/s (83.5MB/s), 19.6MiB/s-30.7MiB/s (20.6MB/s-32.2MB/s), io=402MiB (421MB), run=5005-5047msec 00:32:09.181 17:25:05 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:09.181 17:25:05 -- target/dif.sh@43 -- # local sub 00:32:09.181 17:25:05 -- target/dif.sh@45 -- # for sub in "$@" 00:32:09.181 17:25:05 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:09.181 17:25:05 -- target/dif.sh@36 -- # local sub_id=0 00:32:09.181 17:25:05 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:09.181 17:25:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:05 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:09.181 17:25:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # bs=4k 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # numjobs=8 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # iodepth=16 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # runtime= 00:32:09.181 17:25:05 -- target/dif.sh@109 -- # files=2 00:32:09.181 17:25:05 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:09.181 17:25:05 -- target/dif.sh@28 -- # local sub 00:32:09.181 17:25:05 -- target/dif.sh@30 -- # for sub in "$@" 00:32:09.181 17:25:05 -- target/dif.sh@31 -- # create_subsystem 0 00:32:09.181 17:25:05 -- target/dif.sh@18 -- # local sub_id=0 00:32:09.181 17:25:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:09.181 17:25:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 bdev_null0 00:32:09.181 17:25:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:09.181 17:25:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 [2024-11-27 17:25:06.017665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@30 -- # for sub in "$@" 00:32:09.181 17:25:06 -- target/dif.sh@31 -- # create_subsystem 1 00:32:09.181 17:25:06 -- target/dif.sh@18 -- # local sub_id=1 00:32:09.181 17:25:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 bdev_null1 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@30 -- # for sub in "$@" 00:32:09.181 17:25:06 -- target/dif.sh@31 -- # create_subsystem 2 00:32:09.181 17:25:06 -- target/dif.sh@18 -- # local sub_id=2 00:32:09.181 17:25:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 bdev_null2 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:09.181 17:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.181 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:32:09.181 17:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.181 17:25:06 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:09.181 17:25:06 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:09.181 17:25:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:09.181 17:25:06 -- nvmf/common.sh@520 -- # config=() 00:32:09.181 17:25:06 -- nvmf/common.sh@520 -- # local subsystem config 00:32:09.181 17:25:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:09.181 17:25:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:09.182 { 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme$subsystem", 00:32:09.182 "trtype": "$TEST_TRANSPORT", 00:32:09.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "$NVMF_PORT", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:09.182 "hdgst": ${hdgst:-false}, 00:32:09.182 "ddgst": ${ddgst:-false} 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 } 00:32:09.182 EOF 00:32:09.182 )") 00:32:09.182 17:25:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.182 17:25:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.182 17:25:06 -- target/dif.sh@82 -- # gen_fio_conf 00:32:09.182 17:25:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:09.182 17:25:06 -- target/dif.sh@54 -- # local file 00:32:09.182 17:25:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:09.182 17:25:06 -- target/dif.sh@56 -- # cat 00:32:09.182 17:25:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:09.182 17:25:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.182 17:25:06 -- common/autotest_common.sh@1330 -- # shift 00:32:09.182 17:25:06 -- nvmf/common.sh@542 -- # cat 00:32:09.182 17:25:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:09.182 17:25:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file <= files )) 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:09.182 17:25:06 -- target/dif.sh@73 -- # cat 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:09.182 17:25:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:09.182 17:25:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:09.182 { 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme$subsystem", 00:32:09.182 "trtype": "$TEST_TRANSPORT", 00:32:09.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "$NVMF_PORT", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:09.182 "hdgst": ${hdgst:-false}, 00:32:09.182 "ddgst": ${ddgst:-false} 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 } 00:32:09.182 EOF 00:32:09.182 )") 00:32:09.182 17:25:06 -- nvmf/common.sh@542 -- # cat 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file++ )) 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file <= files )) 00:32:09.182 17:25:06 -- target/dif.sh@73 -- # cat 00:32:09.182 17:25:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file++ )) 00:32:09.182 17:25:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:09.182 { 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme$subsystem", 00:32:09.182 "trtype": "$TEST_TRANSPORT", 00:32:09.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "$NVMF_PORT", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:09.182 "hdgst": ${hdgst:-false}, 00:32:09.182 "ddgst": ${ddgst:-false} 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 } 00:32:09.182 EOF 00:32:09.182 )") 00:32:09.182 17:25:06 -- target/dif.sh@72 -- # (( file <= files )) 00:32:09.182 17:25:06 -- nvmf/common.sh@542 -- # cat 00:32:09.182 17:25:06 -- nvmf/common.sh@544 -- # jq . 00:32:09.182 17:25:06 -- nvmf/common.sh@545 -- # IFS=, 00:32:09.182 17:25:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme0", 00:32:09.182 "trtype": "tcp", 00:32:09.182 "traddr": "10.0.0.2", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "4420", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:09.182 "hdgst": false, 00:32:09.182 "ddgst": false 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 },{ 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme1", 00:32:09.182 "trtype": "tcp", 00:32:09.182 "traddr": "10.0.0.2", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "4420", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:09.182 "hdgst": false, 00:32:09.182 "ddgst": false 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 },{ 00:32:09.182 "params": { 00:32:09.182 "name": "Nvme2", 00:32:09.182 "trtype": "tcp", 00:32:09.182 "traddr": "10.0.0.2", 00:32:09.182 "adrfam": "ipv4", 00:32:09.182 "trsvcid": "4420", 00:32:09.182 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:09.182 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:09.182 "hdgst": false, 00:32:09.182 "ddgst": false 00:32:09.182 }, 00:32:09.182 "method": "bdev_nvme_attach_controller" 00:32:09.182 }' 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:09.182 17:25:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:09.182 17:25:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:09.182 17:25:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:09.182 17:25:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:09.182 17:25:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:09.182 17:25:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.439 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:09.439 ... 00:32:09.439 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:09.439 ... 00:32:09.439 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:09.439 ... 00:32:09.439 fio-3.35 00:32:09.439 Starting 24 threads 00:32:09.439 EAL: No free 2048 kB hugepages reported on node 1 00:32:10.371 [2024-11-27 17:25:07.147791] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:10.371 [2024-11-27 17:25:07.147864] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:22.571 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889687: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=274, BW=1098KiB/s (1124kB/s)(10.8MiB/10029msec) 00:32:22.572 slat (nsec): min=5116, max=91328, avg=31670.79, stdev=15977.89 00:32:22.572 clat (msec): min=17, max=333, avg=58.06, stdev=73.12 00:32:22.572 lat (msec): min=17, max=333, avg=58.09, stdev=73.11 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 21], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 215], 95.00th=[ 271], 00:32:22.572 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 334], 00:32:22.572 | 99.99th=[ 334] 00:32:22.572 bw ( KiB/s): min= 144, max= 2052, per=4.27%, avg=1094.60, stdev=856.75, samples=20 00:32:22.572 iops : min= 36, max= 513, avg=273.65, stdev=214.19, samples=20 00:32:22.572 lat (msec) : 20=0.65%, 50=87.14%, 100=0.65%, 250=2.83%, 500=8.72% 00:32:22.572 cpu : usr=98.72%, sys=0.88%, ctx=16, majf=0, minf=28 00:32:22.572 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889688: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=263, BW=1055KiB/s (1080kB/s)(10.3MiB/10011msec) 00:32:22.572 slat (nsec): min=8243, max=68023, avg=24853.61, stdev=9615.84 00:32:22.572 clat (msec): min=17, max=504, avg=60.44, stdev=92.34 00:32:22.572 lat (msec): min=17, max=504, avg=60.46, stdev=92.34 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 321], 00:32:22.572 | 99.00th=[ 435], 99.50th=[ 451], 99.90th=[ 506], 99.95th=[ 506], 00:32:22.572 | 99.99th=[ 506] 00:32:22.572 bw ( KiB/s): min= 128, max= 2048, per=3.92%, avg=1003.79, stdev=883.51, samples=19 00:32:22.572 iops : min= 32, max= 512, avg=250.95, stdev=220.88, samples=19 00:32:22.572 lat (msec) : 20=0.61%, 50=89.70%, 100=0.61%, 250=0.23%, 500=8.71% 00:32:22.572 lat (msec) : 750=0.15% 00:32:22.572 cpu : usr=97.62%, sys=1.36%, ctx=84, majf=0, minf=26 00:32:22.572 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889689: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=273, BW=1095KiB/s (1121kB/s)(10.7MiB/10025msec) 00:32:22.572 slat (usec): min=8, max=155, avg=36.30, stdev=13.82 00:32:22.572 clat (msec): min=14, max=396, avg=58.13, stdev=75.34 00:32:22.572 lat (msec): min=14, max=396, avg=58.17, stdev=75.33 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 21], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 220], 95.00th=[ 271], 00:32:22.572 | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 397], 99.95th=[ 397], 00:32:22.572 | 99.99th=[ 397] 00:32:22.572 bw ( KiB/s): min= 176, max= 2048, per=4.26%, avg=1090.60, stdev=869.13, samples=20 00:32:22.572 iops : min= 44, max= 512, avg=272.65, stdev=217.28, samples=20 00:32:22.572 lat (msec) : 20=0.87%, 50=87.17%, 100=0.80%, 250=2.92%, 500=8.24% 00:32:22.572 cpu : usr=98.33%, sys=1.12%, ctx=41, majf=0, minf=51 00:32:22.572 IO depths : 1=5.5%, 2=11.2%, 4=23.1%, 8=53.2%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889690: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=259, BW=1039KiB/s (1064kB/s)(10.2MiB/10046msec) 00:32:22.572 slat (usec): min=8, max=190, avg=64.73, stdev=44.82 00:32:22.572 clat (msec): min=10, max=471, avg=61.09, stdev=96.89 00:32:22.572 lat (msec): min=10, max=471, avg=61.16, stdev=96.87 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 55], 95.00th=[ 359], 00:32:22.572 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], 00:32:22.572 | 99.99th=[ 472] 00:32:22.572 bw ( KiB/s): min= 128, max= 2048, per=4.03%, avg=1031.80, stdev=885.66, samples=20 00:32:22.572 iops : min= 32, max= 512, avg=257.95, stdev=221.41, samples=20 00:32:22.572 lat (msec) : 20=0.27%, 50=88.96%, 100=2.18%, 250=1.15%, 500=7.44% 00:32:22.572 cpu : usr=98.65%, sys=0.92%, ctx=16, majf=0, minf=28 00:32:22.572 IO depths : 1=2.0%, 2=7.9%, 4=23.9%, 8=55.7%, 16=10.5%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=94.1%, 8=0.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2609,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889691: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=268, BW=1073KiB/s (1099kB/s)(10.5MiB/10004msec) 00:32:22.572 slat (nsec): min=6996, max=97179, avg=37792.95, stdev=15022.83 00:32:22.572 clat (msec): min=26, max=453, avg=59.29, stdev=82.88 00:32:22.572 lat (msec): min=26, max=453, avg=59.33, stdev=82.88 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 211], 95.00th=[ 279], 00:32:22.572 | 99.00th=[ 405], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], 00:32:22.572 | 99.99th=[ 456] 00:32:22.572 bw ( KiB/s): min= 128, max= 2048, per=3.99%, avg=1022.32, stdev=856.97, samples=19 00:32:22.572 iops : min= 32, max= 512, avg=255.58, stdev=214.24, samples=19 00:32:22.572 lat (msec) : 50=89.05%, 100=0.60%, 250=1.94%, 500=8.42% 00:32:22.572 cpu : usr=98.83%, sys=0.77%, ctx=15, majf=0, minf=28 00:32:22.572 IO depths : 1=5.7%, 2=11.7%, 4=24.3%, 8=51.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=93.9%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2684,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889692: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=262, BW=1049KiB/s (1074kB/s)(10.2MiB/10007msec) 00:32:22.572 slat (usec): min=8, max=138, avg=47.60, stdev=29.43 00:32:22.572 clat (msec): min=10, max=545, avg=60.58, stdev=97.12 00:32:22.572 lat (msec): min=10, max=546, avg=60.63, stdev=97.12 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 39], 95.00th=[ 355], 00:32:22.572 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 542], 99.95th=[ 550], 00:32:22.572 | 99.99th=[ 550] 00:32:22.572 bw ( KiB/s): min= 128, max= 2048, per=3.87%, avg=990.47, stdev=895.75, samples=19 00:32:22.572 iops : min= 32, max= 512, avg=247.58, stdev=223.90, samples=19 00:32:22.572 lat (msec) : 20=1.22%, 50=89.63%, 100=0.61%, 250=0.69%, 500=7.70% 00:32:22.572 lat (msec) : 750=0.15% 00:32:22.572 cpu : usr=97.80%, sys=1.33%, ctx=84, majf=0, minf=28 00:32:22.572 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889693: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=262, BW=1049KiB/s (1074kB/s)(10.2MiB/10007msec) 00:32:22.572 slat (usec): min=8, max=130, avg=42.87, stdev=26.70 00:32:22.572 clat (msec): min=10, max=546, avg=60.64, stdev=97.15 00:32:22.572 lat (msec): min=10, max=546, avg=60.68, stdev=97.15 00:32:22.572 clat percentiles (msec): 00:32:22.572 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.572 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.572 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 39], 95.00th=[ 355], 00:32:22.572 | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 489], 99.95th=[ 550], 00:32:22.572 | 99.99th=[ 550] 00:32:22.572 bw ( KiB/s): min= 128, max= 2048, per=3.87%, avg=990.47, stdev=895.64, samples=19 00:32:22.572 iops : min= 32, max= 512, avg=247.58, stdev=223.87, samples=19 00:32:22.572 lat (msec) : 20=1.22%, 50=89.63%, 100=0.61%, 250=0.61%, 500=7.85% 00:32:22.572 lat (msec) : 750=0.08% 00:32:22.572 cpu : usr=97.52%, sys=1.57%, ctx=79, majf=0, minf=29 00:32:22.572 IO depths : 1=5.5%, 2=11.7%, 4=24.9%, 8=50.9%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:22.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.572 issued rwts: total=2624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.572 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.572 filename0: (groupid=0, jobs=1): err= 0: pid=1889695: Wed Nov 27 17:25:17 2024 00:32:22.572 read: IOPS=271, BW=1086KiB/s (1112kB/s)(10.6MiB/10019msec) 00:32:22.573 slat (nsec): min=7956, max=87650, avg=36177.97, stdev=11495.11 00:32:22.573 clat (msec): min=19, max=407, avg=58.62, stdev=77.14 00:32:22.573 lat (msec): min=19, max=407, avg=58.65, stdev=77.13 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 218], 95.00th=[ 271], 00:32:22.573 | 99.00th=[ 359], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], 00:32:22.573 | 99.99th=[ 409] 00:32:22.573 bw ( KiB/s): min= 144, max= 2048, per=4.22%, avg=1081.60, stdev=866.40, samples=20 00:32:22.573 iops : min= 36, max= 512, avg=270.40, stdev=216.60, samples=20 00:32:22.573 lat (msec) : 20=0.29%, 50=88.01%, 100=0.59%, 250=1.69%, 500=9.41% 00:32:22.573 cpu : usr=98.27%, sys=1.06%, ctx=98, majf=0, minf=29 00:32:22.573 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889696: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=263, BW=1053KiB/s (1078kB/s)(10.3MiB/10008msec) 00:32:22.573 slat (usec): min=8, max=118, avg=34.63, stdev=26.25 00:32:22.573 clat (msec): min=7, max=467, avg=60.52, stdev=97.01 00:32:22.573 lat (msec): min=7, max=467, avg=60.56, stdev=97.01 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 12], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 355], 00:32:22.573 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 468], 00:32:22.573 | 99.99th=[ 468] 00:32:22.573 bw ( KiB/s): min= 128, max= 2064, per=3.89%, avg=996.21, stdev=895.00, samples=19 00:32:22.573 iops : min= 32, max= 516, avg=249.05, stdev=223.75, samples=19 00:32:22.573 lat (msec) : 10=0.23%, 20=2.70%, 50=87.32%, 100=1.33%, 250=0.53% 00:32:22.573 lat (msec) : 500=7.90% 00:32:22.573 cpu : usr=98.73%, sys=0.86%, ctx=14, majf=0, minf=18 00:32:22.573 IO depths : 1=1.2%, 2=6.2%, 4=20.5%, 8=60.3%, 16=11.9%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=93.3%, 8=1.7%, 16=5.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889697: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=268, BW=1075KiB/s (1101kB/s)(10.5MiB/10008msec) 00:32:22.573 slat (usec): min=8, max=152, avg=56.74, stdev=37.63 00:32:22.573 clat (msec): min=12, max=483, avg=59.04, stdev=83.69 00:32:22.573 lat (msec): min=12, max=483, avg=59.10, stdev=83.67 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 176], 95.00th=[ 275], 00:32:22.573 | 99.00th=[ 405], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 485], 00:32:22.573 | 99.99th=[ 485] 00:32:22.573 bw ( KiB/s): min= 128, max= 2048, per=4.00%, avg=1024.84, stdev=864.35, samples=19 00:32:22.573 iops : min= 32, max= 512, avg=256.21, stdev=216.09, samples=19 00:32:22.573 lat (msec) : 20=0.37%, 50=88.70%, 100=0.74%, 250=1.34%, 500=8.85% 00:32:22.573 cpu : usr=98.73%, sys=0.84%, ctx=14, majf=0, minf=29 00:32:22.573 IO depths : 1=5.8%, 2=11.6%, 4=23.7%, 8=52.2%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2690,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889698: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=261, BW=1046KiB/s (1072kB/s)(10.2MiB/10007msec) 00:32:22.573 slat (usec): min=14, max=180, avg=102.99, stdev=32.26 00:32:22.573 clat (msec): min=9, max=540, avg=60.26, stdev=97.41 00:32:22.573 lat (msec): min=9, max=540, avg=60.37, stdev=97.38 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:22.573 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 351], 00:32:22.573 | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 535], 99.95th=[ 542], 00:32:22.573 | 99.99th=[ 542] 00:32:22.573 bw ( KiB/s): min= 128, max= 2048, per=3.85%, avg=987.95, stdev=893.52, samples=19 00:32:22.573 iops : min= 32, max= 512, avg=246.95, stdev=223.34, samples=19 00:32:22.573 lat (msec) : 10=0.08%, 20=1.15%, 50=89.61%, 100=0.61%, 250=0.69% 00:32:22.573 lat (msec) : 500=7.72%, 750=0.15% 00:32:22.573 cpu : usr=98.19%, sys=1.15%, ctx=30, majf=0, minf=26 00:32:22.573 IO depths : 1=5.5%, 2=11.8%, 4=25.1%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2618,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889699: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=261, BW=1045KiB/s (1070kB/s)(10.2MiB/10006msec) 00:32:22.573 slat (nsec): min=8124, max=97736, avg=23324.69, stdev=13392.13 00:32:22.573 clat (msec): min=13, max=539, avg=61.09, stdev=97.65 00:32:22.573 lat (msec): min=13, max=539, avg=61.12, stdev=97.65 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 18], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 359], 00:32:22.573 | 99.00th=[ 456], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], 00:32:22.573 | 99.99th=[ 542] 00:32:22.573 bw ( KiB/s): min= 112, max= 2048, per=3.85%, avg=986.26, stdev=882.81, samples=19 00:32:22.573 iops : min= 28, max= 512, avg=246.53, stdev=220.67, samples=19 00:32:22.573 lat (msec) : 20=1.22%, 50=89.21%, 100=1.22%, 250=0.38%, 500=7.80% 00:32:22.573 lat (msec) : 750=0.15% 00:32:22.573 cpu : usr=96.46%, sys=1.84%, ctx=306, majf=0, minf=30 00:32:22.573 IO depths : 1=2.0%, 2=4.3%, 4=9.7%, 8=69.7%, 16=14.3%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=91.2%, 8=6.7%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2614,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889700: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=272, BW=1092KiB/s (1118kB/s)(10.7MiB/10025msec) 00:32:22.573 slat (usec): min=5, max=107, avg=41.43, stdev=16.18 00:32:22.573 clat (msec): min=15, max=476, avg=58.27, stdev=77.20 00:32:22.573 lat (msec): min=15, max=476, avg=58.31, stdev=77.19 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 21], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 188], 95.00th=[ 271], 00:32:22.573 | 99.00th=[ 359], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 477], 00:32:22.573 | 99.99th=[ 477] 00:32:22.573 bw ( KiB/s): min= 128, max= 2052, per=4.25%, avg=1088.20, stdev=873.82, samples=20 00:32:22.573 iops : min= 32, max= 513, avg=272.05, stdev=218.45, samples=20 00:32:22.573 lat (msec) : 20=0.84%, 50=87.46%, 100=0.58%, 250=2.34%, 500=8.77% 00:32:22.573 cpu : usr=98.60%, sys=0.92%, ctx=14, majf=0, minf=29 00:32:22.573 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2736,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889701: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=262, BW=1049KiB/s (1074kB/s)(10.2MiB/10006msec) 00:32:22.573 slat (usec): min=8, max=151, avg=53.65, stdev=36.26 00:32:22.573 clat (msec): min=15, max=556, avg=60.53, stdev=97.64 00:32:22.573 lat (msec): min=15, max=556, avg=60.58, stdev=97.63 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 359], 00:32:22.573 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 550], 99.95th=[ 558], 00:32:22.573 | 99.99th=[ 558] 00:32:22.573 bw ( KiB/s): min= 128, max= 2048, per=3.89%, avg=997.05, stdev=896.59, samples=19 00:32:22.573 iops : min= 32, max= 512, avg=249.26, stdev=224.15, samples=19 00:32:22.573 lat (msec) : 20=0.69%, 50=90.85%, 250=0.61%, 500=7.55%, 750=0.30% 00:32:22.573 cpu : usr=98.90%, sys=0.68%, ctx=13, majf=0, minf=16 00:32:22.573 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:22.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.573 issued rwts: total=2624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.573 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.573 filename1: (groupid=0, jobs=1): err= 0: pid=1889703: Wed Nov 27 17:25:17 2024 00:32:22.573 read: IOPS=273, BW=1094KiB/s (1121kB/s)(10.7MiB/10001msec) 00:32:22.573 slat (nsec): min=3538, max=83256, avg=29113.40, stdev=12775.23 00:32:22.573 clat (msec): min=19, max=376, avg=58.25, stdev=73.34 00:32:22.573 lat (msec): min=19, max=376, avg=58.28, stdev=73.34 00:32:22.573 clat percentiles (msec): 00:32:22.573 | 1.00th=[ 23], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.573 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.573 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 218], 95.00th=[ 271], 00:32:22.574 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 376], 00:32:22.574 | 99.99th=[ 376] 00:32:22.574 bw ( KiB/s): min= 144, max= 2048, per=4.08%, avg=1044.21, stdev=848.70, samples=19 00:32:22.574 iops : min= 36, max= 512, avg=261.05, stdev=212.18, samples=19 00:32:22.574 lat (msec) : 20=0.37%, 50=87.35%, 100=0.66%, 250=2.92%, 500=8.70% 00:32:22.574 cpu : usr=97.93%, sys=1.35%, ctx=69, majf=0, minf=36 00:32:22.574 IO depths : 1=5.4%, 2=11.6%, 4=24.9%, 8=51.0%, 16=7.1%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2736,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename1: (groupid=0, jobs=1): err= 0: pid=1889704: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=280, BW=1123KiB/s (1150kB/s)(11.0MiB/10019msec) 00:32:22.574 slat (usec): min=7, max=117, avg=39.60, stdev=23.77 00:32:22.574 clat (msec): min=8, max=446, avg=56.66, stdev=80.66 00:32:22.574 lat (msec): min=8, max=446, avg=56.70, stdev=80.66 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 19], 5.00th=[ 20], 10.00th=[ 27], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 61], 95.00th=[ 279], 00:32:22.574 | 99.00th=[ 372], 99.50th=[ 393], 99.90th=[ 426], 99.95th=[ 447], 00:32:22.574 | 99.99th=[ 447] 00:32:22.574 bw ( KiB/s): min= 128, max= 2528, per=4.37%, avg=1118.40, stdev=915.06, samples=20 00:32:22.574 iops : min= 32, max= 632, avg=279.60, stdev=228.76, samples=20 00:32:22.574 lat (msec) : 10=0.28%, 20=6.37%, 50=82.89%, 100=0.57%, 250=0.78% 00:32:22.574 lat (msec) : 500=9.10% 00:32:22.574 cpu : usr=98.16%, sys=1.07%, ctx=31, majf=0, minf=28 00:32:22.574 IO depths : 1=4.8%, 2=9.9%, 4=21.4%, 8=56.0%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=93.1%, 8=1.2%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2812,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889705: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=261, BW=1048KiB/s (1073kB/s)(10.2MiB/10010msec) 00:32:22.574 slat (usec): min=8, max=148, avg=36.44, stdev=24.69 00:32:22.574 clat (msec): min=13, max=539, avg=60.71, stdev=99.07 00:32:22.574 lat (msec): min=13, max=539, avg=60.75, stdev=99.06 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 19], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 39], 95.00th=[ 363], 00:32:22.574 | 99.00th=[ 456], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], 00:32:22.574 | 99.99th=[ 542] 00:32:22.574 bw ( KiB/s): min= 112, max= 2048, per=3.87%, avg=990.47, stdev=894.88, samples=19 00:32:22.574 iops : min= 28, max= 512, avg=247.58, stdev=223.68, samples=19 00:32:22.574 lat (msec) : 20=1.07%, 50=89.78%, 100=1.22%, 500=7.70%, 750=0.23% 00:32:22.574 cpu : usr=98.74%, sys=0.83%, ctx=13, majf=0, minf=25 00:32:22.574 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889706: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=274, BW=1098KiB/s (1124kB/s)(10.8MiB/10030msec) 00:32:22.574 slat (usec): min=5, max=135, avg=46.74, stdev=26.40 00:32:22.574 clat (msec): min=20, max=347, avg=57.93, stdev=73.19 00:32:22.574 lat (msec): min=20, max=347, avg=57.98, stdev=73.18 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 21], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 215], 95.00th=[ 271], 00:32:22.574 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 347], 00:32:22.574 | 99.99th=[ 347] 00:32:22.574 bw ( KiB/s): min= 144, max= 2048, per=4.27%, avg=1094.40, stdev=856.52, samples=20 00:32:22.574 iops : min= 36, max= 512, avg=273.60, stdev=214.13, samples=20 00:32:22.574 lat (msec) : 50=87.79%, 100=0.65%, 250=2.83%, 500=8.72% 00:32:22.574 cpu : usr=98.59%, sys=1.00%, ctx=19, majf=0, minf=23 00:32:22.574 IO depths : 1=5.5%, 2=11.8%, 4=25.0%, 8=50.7%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889707: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=268, BW=1075KiB/s (1101kB/s)(10.5MiB/10004msec) 00:32:22.574 slat (usec): min=7, max=169, avg=78.95, stdev=38.86 00:32:22.574 clat (msec): min=25, max=522, avg=58.87, stdev=81.79 00:32:22.574 lat (msec): min=25, max=522, avg=58.95, stdev=81.77 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 218], 95.00th=[ 279], 00:32:22.574 | 99.00th=[ 405], 99.50th=[ 456], 99.90th=[ 489], 99.95th=[ 523], 00:32:22.574 | 99.99th=[ 523] 00:32:22.574 bw ( KiB/s): min= 128, max= 2048, per=4.00%, avg=1024.00, stdev=855.35, samples=19 00:32:22.574 iops : min= 32, max= 512, avg=256.00, stdev=213.84, samples=19 00:32:22.574 lat (msec) : 50=88.76%, 100=0.60%, 250=1.79%, 500=8.78%, 750=0.07% 00:32:22.574 cpu : usr=98.94%, sys=0.64%, ctx=10, majf=0, minf=18 00:32:22.574 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889708: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=262, BW=1051KiB/s (1076kB/s)(10.3MiB/10010msec) 00:32:22.574 slat (nsec): min=4697, max=84205, avg=34271.59, stdev=14310.52 00:32:22.574 clat (msec): min=10, max=539, avg=60.57, stdev=98.84 00:32:22.574 lat (msec): min=10, max=539, avg=60.61, stdev=98.84 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 363], 00:32:22.574 | 99.00th=[ 456], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], 00:32:22.574 | 99.99th=[ 542] 00:32:22.574 bw ( KiB/s): min= 128, max= 2048, per=3.87%, avg=992.84, stdev=894.99, samples=19 00:32:22.574 iops : min= 32, max= 512, avg=248.21, stdev=223.75, samples=19 00:32:22.574 lat (msec) : 20=1.44%, 50=90.04%, 100=0.61%, 500=7.76%, 750=0.15% 00:32:22.574 cpu : usr=98.78%, sys=0.80%, ctx=17, majf=0, minf=26 00:32:22.574 IO depths : 1=5.7%, 2=11.6%, 4=23.8%, 8=51.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=93.9%, 8=0.5%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889709: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=274, BW=1098KiB/s (1124kB/s)(10.8MiB/10027msec) 00:32:22.574 slat (usec): min=5, max=157, avg=51.19, stdev=28.43 00:32:22.574 clat (msec): min=11, max=350, avg=57.86, stdev=73.24 00:32:22.574 lat (msec): min=12, max=350, avg=57.92, stdev=73.23 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 21], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 215], 95.00th=[ 271], 00:32:22.574 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 351], 00:32:22.574 | 99.99th=[ 351] 00:32:22.574 bw ( KiB/s): min= 144, max= 2048, per=4.27%, avg=1094.40, stdev=866.53, samples=20 00:32:22.574 iops : min= 36, max= 512, avg=273.60, stdev=216.63, samples=20 00:32:22.574 lat (msec) : 20=0.65%, 50=87.14%, 100=0.65%, 250=2.83%, 500=8.72% 00:32:22.574 cpu : usr=98.76%, sys=0.82%, ctx=12, majf=0, minf=16 00:32:22.574 IO depths : 1=5.2%, 2=11.4%, 4=25.0%, 8=51.1%, 16=7.3%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 issued rwts: total=2752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.574 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.574 filename2: (groupid=0, jobs=1): err= 0: pid=1889710: Wed Nov 27 17:25:17 2024 00:32:22.574 read: IOPS=262, BW=1048KiB/s (1073kB/s)(10.2MiB/10015msec) 00:32:22.574 slat (nsec): min=8352, max=88956, avg=28002.57, stdev=12249.29 00:32:22.574 clat (msec): min=16, max=562, avg=60.79, stdev=97.11 00:32:22.574 lat (msec): min=16, max=562, avg=60.81, stdev=97.11 00:32:22.574 clat percentiles (msec): 00:32:22.574 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.574 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.574 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 355], 00:32:22.574 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 558], 99.95th=[ 567], 00:32:22.574 | 99.99th=[ 567] 00:32:22.574 bw ( KiB/s): min= 128, max= 2048, per=3.89%, avg=997.05, stdev=891.26, samples=19 00:32:22.574 iops : min= 32, max= 512, avg=249.26, stdev=222.81, samples=19 00:32:22.574 lat (msec) : 20=0.61%, 50=90.24%, 100=0.61%, 250=0.30%, 500=7.77% 00:32:22.574 lat (msec) : 750=0.46% 00:32:22.574 cpu : usr=98.64%, sys=0.88%, ctx=34, majf=0, minf=29 00:32:22.574 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:22.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.574 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.575 issued rwts: total=2624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.575 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.575 filename2: (groupid=0, jobs=1): err= 0: pid=1889711: Wed Nov 27 17:25:17 2024 00:32:22.575 read: IOPS=268, BW=1075KiB/s (1101kB/s)(10.5MiB/10004msec) 00:32:22.575 slat (nsec): min=8302, max=80675, avg=36536.25, stdev=11450.08 00:32:22.575 clat (msec): min=25, max=405, avg=59.22, stdev=80.18 00:32:22.575 lat (msec): min=25, max=405, avg=59.26, stdev=80.17 00:32:22.575 clat percentiles (msec): 00:32:22.575 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.575 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.575 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 245], 95.00th=[ 279], 00:32:22.575 | 99.00th=[ 372], 99.50th=[ 393], 99.90th=[ 401], 99.95th=[ 405], 00:32:22.575 | 99.99th=[ 405] 00:32:22.575 bw ( KiB/s): min= 144, max= 2048, per=3.99%, avg=1023.79, stdev=857.67, samples=19 00:32:22.575 iops : min= 36, max= 512, avg=255.95, stdev=214.42, samples=19 00:32:22.575 lat (msec) : 50=88.69%, 100=0.67%, 250=1.04%, 500=9.60% 00:32:22.575 cpu : usr=98.86%, sys=0.74%, ctx=9, majf=0, minf=23 00:32:22.575 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:22.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.575 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.575 issued rwts: total=2688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.575 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.575 filename2: (groupid=0, jobs=1): err= 0: pid=1889713: Wed Nov 27 17:25:17 2024 00:32:22.575 read: IOPS=269, BW=1079KiB/s (1105kB/s)(10.6MiB/10021msec) 00:32:22.575 slat (nsec): min=3545, max=78719, avg=24148.80, stdev=14552.88 00:32:22.575 clat (msec): min=23, max=435, avg=59.09, stdev=81.31 00:32:22.575 lat (msec): min=23, max=435, avg=59.11, stdev=81.31 00:32:22.575 clat percentiles (msec): 00:32:22.575 | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:22.575 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:22.575 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 215], 95.00th=[ 279], 00:32:22.575 | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], 00:32:22.575 | 99.99th=[ 435] 00:32:22.575 bw ( KiB/s): min= 128, max= 2048, per=4.20%, avg=1075.20, stdev=873.27, samples=20 00:32:22.575 iops : min= 32, max= 512, avg=268.80, stdev=218.32, samples=20 00:32:22.575 lat (msec) : 50=89.42%, 250=1.63%, 500=8.95% 00:32:22.575 cpu : usr=97.77%, sys=1.28%, ctx=74, majf=0, minf=21 00:32:22.575 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:22.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.575 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:22.575 issued rwts: total=2704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:22.575 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:22.575 00:32:22.575 Run status group 0 (all jobs): 00:32:22.575 READ: bw=25.0MiB/s (26.2MB/s), 1039KiB/s-1123KiB/s (1064kB/s-1150kB/s), io=251MiB (263MB), run=10001-10046msec 00:32:22.575 17:25:17 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:22.575 17:25:17 -- target/dif.sh@43 -- # local sub 00:32:22.575 17:25:17 -- target/dif.sh@45 -- # for sub in "$@" 00:32:22.575 17:25:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:22.575 17:25:17 -- target/dif.sh@36 -- # local sub_id=0 00:32:22.575 17:25:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@45 -- # for sub in "$@" 00:32:22.575 17:25:17 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:22.575 17:25:17 -- target/dif.sh@36 -- # local sub_id=1 00:32:22.575 17:25:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@45 -- # for sub in "$@" 00:32:22.575 17:25:17 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:22.575 17:25:17 -- target/dif.sh@36 -- # local sub_id=2 00:32:22.575 17:25:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # numjobs=2 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # iodepth=8 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # runtime=5 00:32:22.575 17:25:17 -- target/dif.sh@115 -- # files=1 00:32:22.575 17:25:17 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:22.575 17:25:17 -- target/dif.sh@28 -- # local sub 00:32:22.575 17:25:17 -- target/dif.sh@30 -- # for sub in "$@" 00:32:22.575 17:25:17 -- target/dif.sh@31 -- # create_subsystem 0 00:32:22.575 17:25:17 -- target/dif.sh@18 -- # local sub_id=0 00:32:22.575 17:25:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 bdev_null0 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 [2024-11-27 17:25:17.721756] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@30 -- # for sub in "$@" 00:32:22.575 17:25:17 -- target/dif.sh@31 -- # create_subsystem 1 00:32:22.575 17:25:17 -- target/dif.sh@18 -- # local sub_id=1 00:32:22.575 17:25:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 bdev_null1 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:22.575 17:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.575 17:25:17 -- common/autotest_common.sh@10 -- # set +x 00:32:22.575 17:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.575 17:25:17 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:22.575 17:25:17 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:22.575 17:25:17 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:22.575 17:25:17 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:22.575 17:25:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:22.575 17:25:17 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:22.575 17:25:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:22.575 17:25:17 -- target/dif.sh@82 -- # gen_fio_conf 00:32:22.575 17:25:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:22.575 17:25:17 -- nvmf/common.sh@520 -- # config=() 00:32:22.575 17:25:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:22.575 17:25:17 -- target/dif.sh@54 -- # local file 00:32:22.575 17:25:17 -- nvmf/common.sh@520 -- # local subsystem config 00:32:22.575 17:25:17 -- common/autotest_common.sh@1330 -- # shift 00:32:22.575 17:25:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:22.575 17:25:17 -- target/dif.sh@56 -- # cat 00:32:22.575 17:25:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:22.575 17:25:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:22.575 17:25:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:22.575 { 00:32:22.575 "params": { 00:32:22.575 "name": "Nvme$subsystem", 00:32:22.575 "trtype": "$TEST_TRANSPORT", 00:32:22.575 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:22.575 "adrfam": "ipv4", 00:32:22.575 "trsvcid": "$NVMF_PORT", 00:32:22.575 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:22.575 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:22.576 "hdgst": ${hdgst:-false}, 00:32:22.576 "ddgst": ${ddgst:-false} 00:32:22.576 }, 00:32:22.576 "method": "bdev_nvme_attach_controller" 00:32:22.576 } 00:32:22.576 EOF 00:32:22.576 )") 00:32:22.576 17:25:17 -- nvmf/common.sh@542 -- # cat 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:22.576 17:25:17 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:22.576 17:25:17 -- target/dif.sh@72 -- # (( file <= files )) 00:32:22.576 17:25:17 -- target/dif.sh@73 -- # cat 00:32:22.576 17:25:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:22.576 17:25:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:22.576 { 00:32:22.576 "params": { 00:32:22.576 "name": "Nvme$subsystem", 00:32:22.576 "trtype": "$TEST_TRANSPORT", 00:32:22.576 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:22.576 "adrfam": "ipv4", 00:32:22.576 "trsvcid": "$NVMF_PORT", 00:32:22.576 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:22.576 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:22.576 "hdgst": ${hdgst:-false}, 00:32:22.576 "ddgst": ${ddgst:-false} 00:32:22.576 }, 00:32:22.576 "method": "bdev_nvme_attach_controller" 00:32:22.576 } 00:32:22.576 EOF 00:32:22.576 )") 00:32:22.576 17:25:17 -- target/dif.sh@72 -- # (( file++ )) 00:32:22.576 17:25:17 -- target/dif.sh@72 -- # (( file <= files )) 00:32:22.576 17:25:17 -- nvmf/common.sh@542 -- # cat 00:32:22.576 17:25:17 -- nvmf/common.sh@544 -- # jq . 00:32:22.576 17:25:17 -- nvmf/common.sh@545 -- # IFS=, 00:32:22.576 17:25:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:22.576 "params": { 00:32:22.576 "name": "Nvme0", 00:32:22.576 "trtype": "tcp", 00:32:22.576 "traddr": "10.0.0.2", 00:32:22.576 "adrfam": "ipv4", 00:32:22.576 "trsvcid": "4420", 00:32:22.576 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:22.576 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:22.576 "hdgst": false, 00:32:22.576 "ddgst": false 00:32:22.576 }, 00:32:22.576 "method": "bdev_nvme_attach_controller" 00:32:22.576 },{ 00:32:22.576 "params": { 00:32:22.576 "name": "Nvme1", 00:32:22.576 "trtype": "tcp", 00:32:22.576 "traddr": "10.0.0.2", 00:32:22.576 "adrfam": "ipv4", 00:32:22.576 "trsvcid": "4420", 00:32:22.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:22.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:22.576 "hdgst": false, 00:32:22.576 "ddgst": false 00:32:22.576 }, 00:32:22.576 "method": "bdev_nvme_attach_controller" 00:32:22.576 }' 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:22.576 17:25:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:22.576 17:25:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:22.576 17:25:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:22.576 17:25:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:22.576 17:25:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:22.576 17:25:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:22.576 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:22.576 ... 00:32:22.576 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:22.576 ... 00:32:22.576 fio-3.35 00:32:22.576 Starting 4 threads 00:32:22.576 EAL: No free 2048 kB hugepages reported on node 1 00:32:22.576 [2024-11-27 17:25:18.768670] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:22.576 [2024-11-27 17:25:18.768745] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:27.968 00:32:27.968 filename0: (groupid=0, jobs=1): err= 0: pid=1891042: Wed Nov 27 17:25:23 2024 00:32:27.968 read: IOPS=1870, BW=14.6MiB/s (15.3MB/s)(73.1MiB/5001msec) 00:32:27.968 slat (nsec): min=6378, max=67490, avg=17990.26, stdev=9105.14 00:32:27.968 clat (usec): min=725, max=7940, avg=4212.57, stdev=567.82 00:32:27.968 lat (usec): min=737, max=7967, avg=4230.56, stdev=568.03 00:32:27.968 clat percentiles (usec): 00:32:27.968 | 1.00th=[ 2245], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 3982], 00:32:27.968 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:27.968 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4621], 95.00th=[ 5014], 00:32:27.968 | 99.00th=[ 6456], 99.50th=[ 6915], 99.90th=[ 7439], 99.95th=[ 7701], 00:32:27.968 | 99.99th=[ 7963] 00:32:27.968 bw ( KiB/s): min=14592, max=15616, per=24.78%, avg=14931.33, stdev=354.88, samples=9 00:32:27.968 iops : min= 1824, max= 1952, avg=1866.33, stdev=44.33, samples=9 00:32:27.968 lat (usec) : 750=0.01%, 1000=0.05% 00:32:27.968 lat (msec) : 2=0.67%, 4=22.32%, 10=76.94% 00:32:27.968 cpu : usr=95.04%, sys=4.36%, ctx=12, majf=0, minf=119 00:32:27.968 IO depths : 1=0.1%, 2=14.9%, 4=58.0%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:27.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 complete : 0=0.0%, 4=91.7%, 8=8.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 issued rwts: total=9355,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:27.968 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:27.968 filename0: (groupid=0, jobs=1): err= 0: pid=1891043: Wed Nov 27 17:25:23 2024 00:32:27.968 read: IOPS=1882, BW=14.7MiB/s (15.4MB/s)(73.6MiB/5002msec) 00:32:27.968 slat (usec): min=4, max=113, avg=16.25, stdev= 8.74 00:32:27.968 clat (usec): min=828, max=7790, avg=4194.64, stdev=532.37 00:32:27.968 lat (usec): min=838, max=7822, avg=4210.89, stdev=533.04 00:32:27.968 clat percentiles (usec): 00:32:27.968 | 1.00th=[ 2737], 5.00th=[ 3392], 10.00th=[ 3720], 20.00th=[ 3949], 00:32:27.968 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:27.968 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4621], 95.00th=[ 5014], 00:32:27.968 | 99.00th=[ 6128], 99.50th=[ 6587], 99.90th=[ 7177], 99.95th=[ 7308], 00:32:27.968 | 99.99th=[ 7767] 00:32:27.968 bw ( KiB/s): min=14464, max=16160, per=25.00%, avg=15062.20, stdev=518.36, samples=10 00:32:27.968 iops : min= 1808, max= 2020, avg=1882.70, stdev=64.75, samples=10 00:32:27.968 lat (usec) : 1000=0.03% 00:32:27.968 lat (msec) : 2=0.22%, 4=23.66%, 10=76.08% 00:32:27.968 cpu : usr=93.78%, sys=5.62%, ctx=10, majf=0, minf=71 00:32:27.968 IO depths : 1=0.1%, 2=13.5%, 4=59.3%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:27.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 issued rwts: total=9415,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:27.968 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:27.968 filename1: (groupid=0, jobs=1): err= 0: pid=1891044: Wed Nov 27 17:25:23 2024 00:32:27.968 read: IOPS=1895, BW=14.8MiB/s (15.5MB/s)(74.1MiB/5003msec) 00:32:27.968 slat (nsec): min=4736, max=65171, avg=15391.00, stdev=8503.66 00:32:27.968 clat (usec): min=1358, max=7762, avg=4171.20, stdev=477.49 00:32:27.968 lat (usec): min=1391, max=7777, avg=4186.59, stdev=477.96 00:32:27.968 clat percentiles (usec): 00:32:27.968 | 1.00th=[ 2835], 5.00th=[ 3392], 10.00th=[ 3720], 20.00th=[ 3949], 00:32:27.968 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:27.968 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4490], 95.00th=[ 4752], 00:32:27.968 | 99.00th=[ 5997], 99.50th=[ 6325], 99.90th=[ 7242], 99.95th=[ 7504], 00:32:27.968 | 99.99th=[ 7767] 00:32:27.968 bw ( KiB/s): min=14512, max=15632, per=25.17%, avg=15166.40, stdev=321.10, samples=10 00:32:27.968 iops : min= 1814, max= 1954, avg=1895.80, stdev=40.14, samples=10 00:32:27.968 lat (msec) : 2=0.16%, 4=23.87%, 10=75.98% 00:32:27.968 cpu : usr=94.50%, sys=4.86%, ctx=12, majf=0, minf=44 00:32:27.968 IO depths : 1=0.2%, 2=9.9%, 4=62.0%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:27.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.968 issued rwts: total=9482,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:27.968 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:27.968 filename1: (groupid=0, jobs=1): err= 0: pid=1891045: Wed Nov 27 17:25:23 2024 00:32:27.968 read: IOPS=1885, BW=14.7MiB/s (15.4MB/s)(73.7MiB/5002msec) 00:32:27.968 slat (nsec): min=6551, max=70114, avg=19643.23, stdev=9520.00 00:32:27.969 clat (usec): min=651, max=8218, avg=4170.57, stdev=607.52 00:32:27.969 lat (usec): min=671, max=8237, avg=4190.21, stdev=608.13 00:32:27.969 clat percentiles (usec): 00:32:27.969 | 1.00th=[ 2089], 5.00th=[ 3392], 10.00th=[ 3720], 20.00th=[ 3949], 00:32:27.969 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4146], 60.00th=[ 4228], 00:32:27.969 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 5014], 00:32:27.969 | 99.00th=[ 6587], 99.50th=[ 6980], 99.90th=[ 7832], 99.95th=[ 7832], 00:32:27.969 | 99.99th=[ 8225] 00:32:27.969 bw ( KiB/s): min=14592, max=15504, per=24.97%, avg=15045.33, stdev=278.17, samples=9 00:32:27.969 iops : min= 1824, max= 1938, avg=1880.67, stdev=34.77, samples=9 00:32:27.969 lat (usec) : 750=0.05%, 1000=0.22% 00:32:27.969 lat (msec) : 2=0.63%, 4=25.37%, 10=73.73% 00:32:27.969 cpu : usr=92.52%, sys=5.44%, ctx=206, majf=0, minf=101 00:32:27.969 IO depths : 1=0.1%, 2=17.3%, 4=55.9%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:27.969 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.969 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:27.969 issued rwts: total=9429,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:27.969 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:27.969 00:32:27.969 Run status group 0 (all jobs): 00:32:27.969 READ: bw=58.8MiB/s (61.7MB/s), 14.6MiB/s-14.8MiB/s (15.3MB/s-15.5MB/s), io=294MiB (309MB), run=5001-5003msec 00:32:27.969 17:25:24 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:27.969 17:25:24 -- target/dif.sh@43 -- # local sub 00:32:27.969 17:25:24 -- target/dif.sh@45 -- # for sub in "$@" 00:32:27.969 17:25:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:27.969 17:25:24 -- target/dif.sh@36 -- # local sub_id=0 00:32:27.969 17:25:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@45 -- # for sub in "$@" 00:32:27.969 17:25:24 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:27.969 17:25:24 -- target/dif.sh@36 -- # local sub_id=1 00:32:27.969 17:25:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 00:32:27.969 real 0m24.397s 00:32:27.969 user 4m34.250s 00:32:27.969 sys 0m5.133s 00:32:27.969 17:25:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 ************************************ 00:32:27.969 END TEST fio_dif_rand_params 00:32:27.969 ************************************ 00:32:27.969 17:25:24 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:27.969 17:25:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:27.969 17:25:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 ************************************ 00:32:27.969 START TEST fio_dif_digest 00:32:27.969 ************************************ 00:32:27.969 17:25:24 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:27.969 17:25:24 -- target/dif.sh@123 -- # local NULL_DIF 00:32:27.969 17:25:24 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:27.969 17:25:24 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:27.969 17:25:24 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:27.969 17:25:24 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:27.969 17:25:24 -- target/dif.sh@127 -- # numjobs=3 00:32:27.969 17:25:24 -- target/dif.sh@127 -- # iodepth=3 00:32:27.969 17:25:24 -- target/dif.sh@127 -- # runtime=10 00:32:27.969 17:25:24 -- target/dif.sh@128 -- # hdgst=true 00:32:27.969 17:25:24 -- target/dif.sh@128 -- # ddgst=true 00:32:27.969 17:25:24 -- target/dif.sh@130 -- # create_subsystems 0 00:32:27.969 17:25:24 -- target/dif.sh@28 -- # local sub 00:32:27.969 17:25:24 -- target/dif.sh@30 -- # for sub in "$@" 00:32:27.969 17:25:24 -- target/dif.sh@31 -- # create_subsystem 0 00:32:27.969 17:25:24 -- target/dif.sh@18 -- # local sub_id=0 00:32:27.969 17:25:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 bdev_null0 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:27.969 17:25:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:27.969 17:25:24 -- common/autotest_common.sh@10 -- # set +x 00:32:27.969 [2024-11-27 17:25:24.274446] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:27.969 17:25:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:27.969 17:25:24 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:27.969 17:25:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:27.969 17:25:24 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:27.969 17:25:24 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:27.969 17:25:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:27.969 17:25:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:27.969 17:25:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:27.969 17:25:24 -- nvmf/common.sh@520 -- # config=() 00:32:27.969 17:25:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:27.969 17:25:24 -- target/dif.sh@82 -- # gen_fio_conf 00:32:27.969 17:25:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:27.969 17:25:24 -- nvmf/common.sh@520 -- # local subsystem config 00:32:27.969 17:25:24 -- target/dif.sh@54 -- # local file 00:32:27.969 17:25:24 -- common/autotest_common.sh@1330 -- # shift 00:32:27.969 17:25:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:27.969 17:25:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:27.969 17:25:24 -- target/dif.sh@56 -- # cat 00:32:27.969 17:25:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:27.970 17:25:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:27.970 { 00:32:27.970 "params": { 00:32:27.970 "name": "Nvme$subsystem", 00:32:27.970 "trtype": "$TEST_TRANSPORT", 00:32:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:27.970 "adrfam": "ipv4", 00:32:27.970 "trsvcid": "$NVMF_PORT", 00:32:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:27.970 "hdgst": ${hdgst:-false}, 00:32:27.970 "ddgst": ${ddgst:-false} 00:32:27.970 }, 00:32:27.970 "method": "bdev_nvme_attach_controller" 00:32:27.970 } 00:32:27.970 EOF 00:32:27.970 )") 00:32:27.970 17:25:24 -- nvmf/common.sh@542 -- # cat 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:27.970 17:25:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:27.970 17:25:24 -- target/dif.sh@72 -- # (( file <= files )) 00:32:27.970 17:25:24 -- nvmf/common.sh@544 -- # jq . 00:32:27.970 17:25:24 -- nvmf/common.sh@545 -- # IFS=, 00:32:27.970 17:25:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:27.970 "params": { 00:32:27.970 "name": "Nvme0", 00:32:27.970 "trtype": "tcp", 00:32:27.970 "traddr": "10.0.0.2", 00:32:27.970 "adrfam": "ipv4", 00:32:27.970 "trsvcid": "4420", 00:32:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:27.970 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:27.970 "hdgst": true, 00:32:27.970 "ddgst": true 00:32:27.970 }, 00:32:27.970 "method": "bdev_nvme_attach_controller" 00:32:27.970 }' 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:27.970 17:25:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:27.970 17:25:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:27.970 17:25:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:27.970 17:25:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:27.970 17:25:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:27.970 17:25:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:27.970 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:27.970 ... 00:32:27.970 fio-3.35 00:32:27.970 Starting 3 threads 00:32:27.970 EAL: No free 2048 kB hugepages reported on node 1 00:32:28.228 [2024-11-27 17:25:24.999487] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:28.228 [2024-11-27 17:25:24.999585] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:40.416 00:32:40.416 filename0: (groupid=0, jobs=1): err= 0: pid=1891917: Wed Nov 27 17:25:35 2024 00:32:40.416 read: IOPS=205, BW=25.7MiB/s (27.0MB/s)(258MiB/10046msec) 00:32:40.416 slat (nsec): min=4453, max=35865, avg=14893.77, stdev=2758.66 00:32:40.416 clat (usec): min=10289, max=53325, avg=14540.11, stdev=1486.59 00:32:40.416 lat (usec): min=10302, max=53340, avg=14555.01, stdev=1486.49 00:32:40.416 clat percentiles (usec): 00:32:40.416 | 1.00th=[12256], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:32:40.416 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:40.416 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:32:40.416 | 99.00th=[16909], 99.50th=[17433], 99.90th=[22414], 99.95th=[46400], 00:32:40.416 | 99.99th=[53216] 00:32:40.416 bw ( KiB/s): min=25856, max=27392, per=33.35%, avg=26434.60, stdev=377.35, samples=20 00:32:40.416 iops : min= 202, max= 214, avg=206.50, stdev= 2.96, samples=20 00:32:40.416 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:40.416 cpu : usr=93.47%, sys=5.92%, ctx=73, majf=0, minf=145 00:32:40.416 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:40.416 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 issued rwts: total=2067,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:40.416 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:40.416 filename0: (groupid=0, jobs=1): err= 0: pid=1891918: Wed Nov 27 17:25:35 2024 00:32:40.416 read: IOPS=202, BW=25.3MiB/s (26.6MB/s)(254MiB/10046msec) 00:32:40.416 slat (nsec): min=4367, max=44348, avg=15584.47, stdev=4286.23 00:32:40.416 clat (usec): min=11834, max=48900, avg=14768.90, stdev=1399.16 00:32:40.416 lat (usec): min=11848, max=48914, avg=14784.48, stdev=1399.10 00:32:40.416 clat percentiles (usec): 00:32:40.416 | 1.00th=[12780], 5.00th=[13304], 10.00th=[13566], 20.00th=[14091], 00:32:40.416 | 30.00th=[14353], 40.00th=[14484], 50.00th=[14746], 60.00th=[14877], 00:32:40.416 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15795], 95.00th=[16188], 00:32:40.416 | 99.00th=[16909], 99.50th=[17171], 99.90th=[26870], 99.95th=[46400], 00:32:40.416 | 99.99th=[49021] 00:32:40.416 bw ( KiB/s): min=24576, max=26624, per=32.83%, avg=26022.40, stdev=425.74, samples=20 00:32:40.416 iops : min= 192, max= 208, avg=203.30, stdev= 3.33, samples=20 00:32:40.416 lat (msec) : 20=99.75%, 50=0.25% 00:32:40.416 cpu : usr=89.35%, sys=8.04%, ctx=479, majf=0, minf=112 00:32:40.416 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:40.416 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 issued rwts: total=2035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:40.416 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:40.416 filename0: (groupid=0, jobs=1): err= 0: pid=1891919: Wed Nov 27 17:25:35 2024 00:32:40.416 read: IOPS=211, BW=26.4MiB/s (27.7MB/s)(265MiB/10048msec) 00:32:40.416 slat (nsec): min=4292, max=34745, avg=15260.42, stdev=2573.03 00:32:40.416 clat (usec): min=10739, max=51583, avg=14172.99, stdev=1468.05 00:32:40.416 lat (usec): min=10753, max=51597, avg=14188.25, stdev=1467.97 00:32:40.416 clat percentiles (usec): 00:32:40.416 | 1.00th=[12125], 5.00th=[12649], 10.00th=[12911], 20.00th=[13435], 00:32:40.416 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14353], 00:32:40.416 | 70.00th=[14615], 80.00th=[14877], 90.00th=[15270], 95.00th=[15664], 00:32:40.416 | 99.00th=[16581], 99.50th=[16909], 99.90th=[23462], 99.95th=[47449], 00:32:40.416 | 99.99th=[51643] 00:32:40.416 bw ( KiB/s): min=26368, max=28160, per=34.20%, avg=27110.40, stdev=454.17, samples=20 00:32:40.416 iops : min= 206, max= 220, avg=211.80, stdev= 3.55, samples=20 00:32:40.416 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:40.416 cpu : usr=93.81%, sys=5.65%, ctx=15, majf=0, minf=133 00:32:40.416 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:40.416 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:40.416 issued rwts: total=2121,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:40.416 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:40.416 00:32:40.416 Run status group 0 (all jobs): 00:32:40.416 READ: bw=77.4MiB/s (81.2MB/s), 25.3MiB/s-26.4MiB/s (26.6MB/s-27.7MB/s), io=778MiB (816MB), run=10046-10048msec 00:32:40.416 17:25:35 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:40.416 17:25:35 -- target/dif.sh@43 -- # local sub 00:32:40.416 17:25:35 -- target/dif.sh@45 -- # for sub in "$@" 00:32:40.416 17:25:35 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:40.416 17:25:35 -- target/dif.sh@36 -- # local sub_id=0 00:32:40.416 17:25:35 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:40.416 17:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.416 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:32:40.416 17:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.416 17:25:35 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:40.416 17:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.416 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:32:40.416 17:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.416 00:32:40.416 real 0m11.126s 00:32:40.416 user 0m28.895s 00:32:40.416 sys 0m2.250s 00:32:40.416 17:25:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:40.416 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:32:40.416 ************************************ 00:32:40.416 END TEST fio_dif_digest 00:32:40.416 ************************************ 00:32:40.416 17:25:35 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:40.416 17:25:35 -- target/dif.sh@147 -- # nvmftestfini 00:32:40.416 17:25:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:40.416 17:25:35 -- nvmf/common.sh@116 -- # sync 00:32:40.416 17:25:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:40.416 17:25:35 -- nvmf/common.sh@119 -- # set +e 00:32:40.416 17:25:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:40.416 17:25:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:40.416 rmmod nvme_tcp 00:32:40.416 rmmod nvme_fabrics 00:32:40.416 rmmod nvme_keyring 00:32:40.416 17:25:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:40.416 17:25:35 -- nvmf/common.sh@123 -- # set -e 00:32:40.416 17:25:35 -- nvmf/common.sh@124 -- # return 0 00:32:40.416 17:25:35 -- nvmf/common.sh@477 -- # '[' -n 1885589 ']' 00:32:40.416 17:25:35 -- nvmf/common.sh@478 -- # killprocess 1885589 00:32:40.416 17:25:35 -- common/autotest_common.sh@936 -- # '[' -z 1885589 ']' 00:32:40.416 17:25:35 -- common/autotest_common.sh@940 -- # kill -0 1885589 00:32:40.416 17:25:35 -- common/autotest_common.sh@941 -- # uname 00:32:40.416 17:25:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:40.417 17:25:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1885589 00:32:40.417 17:25:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:40.417 17:25:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:40.417 17:25:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1885589' 00:32:40.417 killing process with pid 1885589 00:32:40.417 17:25:35 -- common/autotest_common.sh@955 -- # kill 1885589 00:32:40.417 17:25:35 -- common/autotest_common.sh@960 -- # wait 1885589 00:32:40.417 17:25:35 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:40.417 17:25:35 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:40.417 Waiting for block devices as requested 00:32:40.417 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:40.417 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:40.417 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:40.417 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:40.417 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:40.417 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:40.417 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:40.676 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:40.676 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:40.676 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:40.676 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:40.934 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:40.934 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:40.934 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:40.934 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:41.192 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:41.192 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:41.192 17:25:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:41.192 17:25:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:41.192 17:25:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:41.192 17:25:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:41.192 17:25:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:41.192 17:25:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:41.192 17:25:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:43.722 17:25:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:43.722 00:32:43.722 real 1m7.808s 00:32:43.722 user 6m32.253s 00:32:43.722 sys 0m16.386s 00:32:43.722 17:25:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:43.722 17:25:40 -- common/autotest_common.sh@10 -- # set +x 00:32:43.722 ************************************ 00:32:43.722 END TEST nvmf_dif 00:32:43.722 ************************************ 00:32:43.722 17:25:40 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:43.722 17:25:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:43.722 17:25:40 -- common/autotest_common.sh@10 -- # set +x 00:32:43.722 ************************************ 00:32:43.722 START TEST nvmf_abort_qd_sizes 00:32:43.722 ************************************ 00:32:43.722 17:25:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:43.722 * Looking for test storage... 00:32:43.722 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:43.722 17:25:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:43.722 17:25:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:43.722 17:25:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:43.722 17:25:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:43.722 17:25:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:43.722 17:25:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:43.722 17:25:40 -- scripts/common.sh@335 -- # IFS=.-: 00:32:43.722 17:25:40 -- scripts/common.sh@335 -- # read -ra ver1 00:32:43.722 17:25:40 -- scripts/common.sh@336 -- # IFS=.-: 00:32:43.722 17:25:40 -- scripts/common.sh@336 -- # read -ra ver2 00:32:43.722 17:25:40 -- scripts/common.sh@337 -- # local 'op=<' 00:32:43.722 17:25:40 -- scripts/common.sh@339 -- # ver1_l=2 00:32:43.722 17:25:40 -- scripts/common.sh@340 -- # ver2_l=1 00:32:43.722 17:25:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:43.722 17:25:40 -- scripts/common.sh@343 -- # case "$op" in 00:32:43.722 17:25:40 -- scripts/common.sh@344 -- # : 1 00:32:43.722 17:25:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:43.722 17:25:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:43.722 17:25:40 -- scripts/common.sh@364 -- # decimal 1 00:32:43.722 17:25:40 -- scripts/common.sh@352 -- # local d=1 00:32:43.722 17:25:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:43.722 17:25:40 -- scripts/common.sh@354 -- # echo 1 00:32:43.722 17:25:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:43.722 17:25:40 -- scripts/common.sh@365 -- # decimal 2 00:32:43.722 17:25:40 -- scripts/common.sh@352 -- # local d=2 00:32:43.722 17:25:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:43.722 17:25:40 -- scripts/common.sh@354 -- # echo 2 00:32:43.722 17:25:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:43.722 17:25:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:43.722 17:25:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:43.722 17:25:40 -- scripts/common.sh@367 -- # return 0 00:32:43.722 17:25:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:43.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:43.722 --rc genhtml_branch_coverage=1 00:32:43.722 --rc genhtml_function_coverage=1 00:32:43.722 --rc genhtml_legend=1 00:32:43.722 --rc geninfo_all_blocks=1 00:32:43.722 --rc geninfo_unexecuted_blocks=1 00:32:43.722 00:32:43.722 ' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:43.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:43.722 --rc genhtml_branch_coverage=1 00:32:43.722 --rc genhtml_function_coverage=1 00:32:43.722 --rc genhtml_legend=1 00:32:43.722 --rc geninfo_all_blocks=1 00:32:43.722 --rc geninfo_unexecuted_blocks=1 00:32:43.722 00:32:43.722 ' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:43.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:43.722 --rc genhtml_branch_coverage=1 00:32:43.722 --rc genhtml_function_coverage=1 00:32:43.722 --rc genhtml_legend=1 00:32:43.722 --rc geninfo_all_blocks=1 00:32:43.722 --rc geninfo_unexecuted_blocks=1 00:32:43.722 00:32:43.722 ' 00:32:43.722 17:25:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:43.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:43.722 --rc genhtml_branch_coverage=1 00:32:43.722 --rc genhtml_function_coverage=1 00:32:43.722 --rc genhtml_legend=1 00:32:43.722 --rc geninfo_all_blocks=1 00:32:43.722 --rc geninfo_unexecuted_blocks=1 00:32:43.722 00:32:43.722 ' 00:32:43.722 17:25:40 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:43.722 17:25:40 -- nvmf/common.sh@7 -- # uname -s 00:32:43.722 17:25:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:43.722 17:25:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:43.722 17:25:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:43.722 17:25:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:43.722 17:25:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:43.722 17:25:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:43.722 17:25:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:43.722 17:25:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:43.722 17:25:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:43.722 17:25:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:43.722 17:25:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:43.722 17:25:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:43.722 17:25:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:43.722 17:25:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:43.722 17:25:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:43.722 17:25:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:43.722 17:25:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:43.722 17:25:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:43.722 17:25:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:43.722 17:25:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:43.722 17:25:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:43.722 17:25:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:43.722 17:25:40 -- paths/export.sh@5 -- # export PATH 00:32:43.722 17:25:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:43.722 17:25:40 -- nvmf/common.sh@46 -- # : 0 00:32:43.722 17:25:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:43.722 17:25:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:43.722 17:25:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:43.722 17:25:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:43.722 17:25:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:43.722 17:25:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:43.722 17:25:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:43.722 17:25:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:43.722 17:25:40 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:43.722 17:25:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:43.722 17:25:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:43.722 17:25:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:43.722 17:25:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:43.722 17:25:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:43.722 17:25:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:43.722 17:25:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:43.722 17:25:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:43.722 17:25:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:43.722 17:25:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:43.722 17:25:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:43.722 17:25:40 -- common/autotest_common.sh@10 -- # set +x 00:32:45.622 17:25:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:45.622 17:25:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:45.622 17:25:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:45.622 17:25:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:45.622 17:25:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:45.622 17:25:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:45.622 17:25:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:45.622 17:25:42 -- nvmf/common.sh@294 -- # net_devs=() 00:32:45.622 17:25:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:45.622 17:25:42 -- nvmf/common.sh@295 -- # e810=() 00:32:45.622 17:25:42 -- nvmf/common.sh@295 -- # local -ga e810 00:32:45.622 17:25:42 -- nvmf/common.sh@296 -- # x722=() 00:32:45.622 17:25:42 -- nvmf/common.sh@296 -- # local -ga x722 00:32:45.622 17:25:42 -- nvmf/common.sh@297 -- # mlx=() 00:32:45.622 17:25:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:45.622 17:25:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:45.622 17:25:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:45.622 17:25:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:45.622 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:45.622 17:25:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:45.622 17:25:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:45.622 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:45.622 17:25:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:45.622 17:25:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:45.622 17:25:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:45.622 17:25:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:45.622 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:45.622 17:25:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:45.622 17:25:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:45.622 17:25:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:45.622 17:25:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:45.622 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:45.622 17:25:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:45.622 17:25:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:45.622 17:25:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:45.622 17:25:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:45.622 17:25:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:45.622 17:25:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:45.622 17:25:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:45.622 17:25:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:45.622 17:25:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:45.622 17:25:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:45.622 17:25:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:45.622 17:25:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:45.622 17:25:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:45.622 17:25:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:45.622 17:25:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:45.622 17:25:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:45.622 17:25:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:45.622 17:25:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:45.622 17:25:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:45.622 17:25:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:45.622 17:25:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:45.622 17:25:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:45.622 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:45.622 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:32:45.622 00:32:45.622 --- 10.0.0.2 ping statistics --- 00:32:45.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:45.622 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:32:45.622 17:25:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:45.622 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:45.622 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:32:45.622 00:32:45.622 --- 10.0.0.1 ping statistics --- 00:32:45.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:45.622 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:32:45.622 17:25:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:45.622 17:25:42 -- nvmf/common.sh@410 -- # return 0 00:32:45.622 17:25:42 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:45.623 17:25:42 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:46.996 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:46.996 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:46.996 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:46.997 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:46.997 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:47.931 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:47.931 17:25:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:47.931 17:25:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:47.931 17:25:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:47.931 17:25:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:47.931 17:25:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:47.932 17:25:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:47.932 17:25:44 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:47.932 17:25:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:47.932 17:25:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:47.932 17:25:44 -- common/autotest_common.sh@10 -- # set +x 00:32:47.932 17:25:44 -- nvmf/common.sh@469 -- # nvmfpid=1896854 00:32:47.932 17:25:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:47.932 17:25:44 -- nvmf/common.sh@470 -- # waitforlisten 1896854 00:32:47.932 17:25:44 -- common/autotest_common.sh@829 -- # '[' -z 1896854 ']' 00:32:47.932 17:25:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:47.932 17:25:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:47.932 17:25:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:47.932 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:47.932 17:25:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:47.932 17:25:44 -- common/autotest_common.sh@10 -- # set +x 00:32:47.932 [2024-11-27 17:25:44.778801] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:47.932 [2024-11-27 17:25:44.778870] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:47.932 EAL: No free 2048 kB hugepages reported on node 1 00:32:47.932 [2024-11-27 17:25:44.848746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:48.190 [2024-11-27 17:25:44.944233] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:48.190 [2024-11-27 17:25:44.944407] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:48.190 [2024-11-27 17:25:44.944425] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:48.190 [2024-11-27 17:25:44.944439] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:48.190 [2024-11-27 17:25:44.947548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:48.190 [2024-11-27 17:25:44.947578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:48.190 [2024-11-27 17:25:44.947690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:48.190 [2024-11-27 17:25:44.947692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:49.123 17:25:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:49.123 17:25:45 -- common/autotest_common.sh@862 -- # return 0 00:32:49.123 17:25:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:49.123 17:25:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:49.123 17:25:45 -- common/autotest_common.sh@10 -- # set +x 00:32:49.123 17:25:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:49.123 17:25:45 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:49.123 17:25:45 -- scripts/common.sh@312 -- # local nvmes 00:32:49.123 17:25:45 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:49.123 17:25:45 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:49.123 17:25:45 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:49.123 17:25:45 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:49.123 17:25:45 -- scripts/common.sh@322 -- # uname -s 00:32:49.123 17:25:45 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:49.123 17:25:45 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:49.123 17:25:45 -- scripts/common.sh@327 -- # (( 1 )) 00:32:49.123 17:25:45 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:49.123 17:25:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:49.123 17:25:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:49.123 17:25:45 -- common/autotest_common.sh@10 -- # set +x 00:32:49.123 ************************************ 00:32:49.123 START TEST spdk_target_abort 00:32:49.123 ************************************ 00:32:49.123 17:25:45 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:49.123 17:25:45 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:49.123 17:25:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:49.123 17:25:45 -- common/autotest_common.sh@10 -- # set +x 00:32:52.415 spdk_targetn1 00:32:52.415 17:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:52.415 17:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.415 17:25:48 -- common/autotest_common.sh@10 -- # set +x 00:32:52.415 [2024-11-27 17:25:48.674661] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:52.415 17:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:52.415 17:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.415 17:25:48 -- common/autotest_common.sh@10 -- # set +x 00:32:52.415 17:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:52.415 17:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.415 17:25:48 -- common/autotest_common.sh@10 -- # set +x 00:32:52.415 17:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:52.415 17:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.415 17:25:48 -- common/autotest_common.sh@10 -- # set +x 00:32:52.415 [2024-11-27 17:25:48.706957] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:52.415 17:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:52.415 17:25:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:52.415 EAL: No free 2048 kB hugepages reported on node 1 00:32:55.695 Initializing NVMe Controllers 00:32:55.695 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:55.695 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:55.695 Initialization complete. Launching workers. 00:32:55.695 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12540, failed: 0 00:32:55.695 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1196, failed to submit 11344 00:32:55.695 success 750, unsuccess 446, failed 0 00:32:55.695 17:25:51 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:55.695 17:25:51 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:55.695 EAL: No free 2048 kB hugepages reported on node 1 00:32:58.976 Initializing NVMe Controllers 00:32:58.976 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:58.976 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:58.976 Initialization complete. Launching workers. 00:32:58.976 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8775, failed: 0 00:32:58.976 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1243, failed to submit 7532 00:32:58.976 success 393, unsuccess 850, failed 0 00:32:58.976 17:25:55 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:58.976 17:25:55 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:58.976 EAL: No free 2048 kB hugepages reported on node 1 00:33:02.255 Initializing NVMe Controllers 00:33:02.255 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:02.255 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:02.255 Initialization complete. Launching workers. 00:33:02.255 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30766, failed: 0 00:33:02.255 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2648, failed to submit 28118 00:33:02.255 success 561, unsuccess 2087, failed 0 00:33:02.255 17:25:58 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:02.255 17:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:02.255 17:25:58 -- common/autotest_common.sh@10 -- # set +x 00:33:02.255 17:25:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:02.255 17:25:58 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:02.255 17:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:02.255 17:25:58 -- common/autotest_common.sh@10 -- # set +x 00:33:03.185 17:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.185 17:25:59 -- target/abort_qd_sizes.sh@62 -- # killprocess 1896854 00:33:03.185 17:25:59 -- common/autotest_common.sh@936 -- # '[' -z 1896854 ']' 00:33:03.185 17:25:59 -- common/autotest_common.sh@940 -- # kill -0 1896854 00:33:03.185 17:25:59 -- common/autotest_common.sh@941 -- # uname 00:33:03.185 17:25:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:03.185 17:25:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1896854 00:33:03.185 17:25:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:03.185 17:25:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:03.185 17:25:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1896854' 00:33:03.185 killing process with pid 1896854 00:33:03.185 17:25:59 -- common/autotest_common.sh@955 -- # kill 1896854 00:33:03.185 17:25:59 -- common/autotest_common.sh@960 -- # wait 1896854 00:33:03.185 00:33:03.185 real 0m14.246s 00:33:03.185 user 0m56.615s 00:33:03.185 sys 0m2.599s 00:33:03.185 17:26:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:03.185 17:26:00 -- common/autotest_common.sh@10 -- # set +x 00:33:03.185 ************************************ 00:33:03.185 END TEST spdk_target_abort 00:33:03.185 ************************************ 00:33:03.185 17:26:00 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:03.185 17:26:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:03.185 17:26:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:03.185 17:26:00 -- common/autotest_common.sh@10 -- # set +x 00:33:03.185 ************************************ 00:33:03.185 START TEST kernel_target_abort 00:33:03.185 ************************************ 00:33:03.185 17:26:00 -- common/autotest_common.sh@1114 -- # kernel_target 00:33:03.185 17:26:00 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:03.185 17:26:00 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:03.185 17:26:00 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:03.185 17:26:00 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:03.185 17:26:00 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:03.185 17:26:00 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:03.185 17:26:00 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:03.185 17:26:00 -- nvmf/common.sh@627 -- # local block nvme 00:33:03.185 17:26:00 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:03.185 17:26:00 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:03.185 17:26:00 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:03.185 17:26:00 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:04.556 Waiting for block devices as requested 00:33:04.556 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:04.556 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:04.556 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:04.814 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:04.814 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:04.814 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:05.072 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:05.072 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:05.072 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:05.072 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:05.330 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:05.330 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:05.330 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:05.330 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:05.588 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:05.588 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:05.588 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:05.846 17:26:02 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:05.846 17:26:02 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:05.847 17:26:02 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:05.847 17:26:02 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:05.847 17:26:02 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:05.847 No valid GPT data, bailing 00:33:05.847 17:26:02 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:05.847 17:26:02 -- scripts/common.sh@393 -- # pt= 00:33:05.847 17:26:02 -- scripts/common.sh@394 -- # return 1 00:33:05.847 17:26:02 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:05.847 17:26:02 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:05.847 17:26:02 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:05.847 17:26:02 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:05.847 17:26:02 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:05.847 17:26:02 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:05.847 17:26:02 -- nvmf/common.sh@654 -- # echo 1 00:33:05.847 17:26:02 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:05.847 17:26:02 -- nvmf/common.sh@656 -- # echo 1 00:33:05.847 17:26:02 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:05.847 17:26:02 -- nvmf/common.sh@663 -- # echo tcp 00:33:05.847 17:26:02 -- nvmf/common.sh@664 -- # echo 4420 00:33:05.847 17:26:02 -- nvmf/common.sh@665 -- # echo ipv4 00:33:05.847 17:26:02 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:05.847 17:26:02 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:33:05.847 00:33:05.847 Discovery Log Number of Records 2, Generation counter 2 00:33:05.847 =====Discovery Log Entry 0====== 00:33:05.847 trtype: tcp 00:33:05.847 adrfam: ipv4 00:33:05.847 subtype: current discovery subsystem 00:33:05.847 treq: not specified, sq flow control disable supported 00:33:05.847 portid: 1 00:33:05.847 trsvcid: 4420 00:33:05.847 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:05.847 traddr: 10.0.0.1 00:33:05.847 eflags: none 00:33:05.847 sectype: none 00:33:05.847 =====Discovery Log Entry 1====== 00:33:05.847 trtype: tcp 00:33:05.847 adrfam: ipv4 00:33:05.847 subtype: nvme subsystem 00:33:05.847 treq: not specified, sq flow control disable supported 00:33:05.847 portid: 1 00:33:05.847 trsvcid: 4420 00:33:05.847 subnqn: kernel_target 00:33:05.847 traddr: 10.0.0.1 00:33:05.847 eflags: none 00:33:05.847 sectype: none 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:05.847 17:26:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:05.847 EAL: No free 2048 kB hugepages reported on node 1 00:33:09.127 Initializing NVMe Controllers 00:33:09.127 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:09.127 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:09.127 Initialization complete. Launching workers. 00:33:09.127 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45205, failed: 0 00:33:09.127 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45205, failed to submit 0 00:33:09.127 success 0, unsuccess 45205, failed 0 00:33:09.127 17:26:05 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:09.127 17:26:05 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:09.127 EAL: No free 2048 kB hugepages reported on node 1 00:33:12.406 Initializing NVMe Controllers 00:33:12.406 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:12.406 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:12.406 Initialization complete. Launching workers. 00:33:12.406 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 80501, failed: 0 00:33:12.406 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20298, failed to submit 60203 00:33:12.406 success 0, unsuccess 20298, failed 0 00:33:12.406 17:26:08 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:12.406 17:26:08 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:12.406 EAL: No free 2048 kB hugepages reported on node 1 00:33:15.752 Initializing NVMe Controllers 00:33:15.752 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:15.752 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:15.752 Initialization complete. Launching workers. 00:33:15.753 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78928, failed: 0 00:33:15.753 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19702, failed to submit 59226 00:33:15.753 success 0, unsuccess 19702, failed 0 00:33:15.753 17:26:12 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:15.753 17:26:12 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:15.753 17:26:12 -- nvmf/common.sh@677 -- # echo 0 00:33:15.753 17:26:12 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:15.753 17:26:12 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:15.753 17:26:12 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:15.753 17:26:12 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:15.753 17:26:12 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:15.753 17:26:12 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:15.753 00:33:15.753 real 0m12.011s 00:33:15.753 user 0m5.641s 00:33:15.753 sys 0m2.452s 00:33:15.753 17:26:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:15.753 17:26:12 -- common/autotest_common.sh@10 -- # set +x 00:33:15.753 ************************************ 00:33:15.753 END TEST kernel_target_abort 00:33:15.753 ************************************ 00:33:15.753 17:26:12 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:15.753 17:26:12 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:15.753 17:26:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:15.753 17:26:12 -- nvmf/common.sh@116 -- # sync 00:33:15.753 17:26:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:15.753 17:26:12 -- nvmf/common.sh@119 -- # set +e 00:33:15.753 17:26:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:15.753 17:26:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:15.753 rmmod nvme_tcp 00:33:15.753 rmmod nvme_fabrics 00:33:15.753 rmmod nvme_keyring 00:33:15.753 17:26:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:15.753 17:26:12 -- nvmf/common.sh@123 -- # set -e 00:33:15.753 17:26:12 -- nvmf/common.sh@124 -- # return 0 00:33:15.753 17:26:12 -- nvmf/common.sh@477 -- # '[' -n 1896854 ']' 00:33:15.753 17:26:12 -- nvmf/common.sh@478 -- # killprocess 1896854 00:33:15.753 17:26:12 -- common/autotest_common.sh@936 -- # '[' -z 1896854 ']' 00:33:15.753 17:26:12 -- common/autotest_common.sh@940 -- # kill -0 1896854 00:33:15.753 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1896854) - No such process 00:33:15.753 17:26:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1896854 is not found' 00:33:15.753 Process with pid 1896854 is not found 00:33:15.753 17:26:12 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:15.753 17:26:12 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:16.688 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:16.688 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:16.688 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:16.688 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:16.688 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:16.688 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:16.688 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:16.688 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:16.688 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:16.688 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:16.688 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:16.688 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:16.688 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:16.688 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:16.688 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:16.688 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:16.688 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:16.688 17:26:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:16.688 17:26:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:16.688 17:26:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:16.688 17:26:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:16.688 17:26:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:16.688 17:26:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:16.688 17:26:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:19.222 17:26:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:19.222 00:33:19.222 real 0m35.436s 00:33:19.222 user 1m4.663s 00:33:19.222 sys 0m8.467s 00:33:19.222 17:26:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:19.222 17:26:15 -- common/autotest_common.sh@10 -- # set +x 00:33:19.222 ************************************ 00:33:19.222 END TEST nvmf_abort_qd_sizes 00:33:19.222 ************************************ 00:33:19.222 17:26:15 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:19.222 17:26:15 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:19.222 17:26:15 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:19.222 17:26:15 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:19.222 17:26:15 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:19.222 17:26:15 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:19.222 17:26:15 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:19.222 17:26:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:19.222 17:26:15 -- common/autotest_common.sh@10 -- # set +x 00:33:19.222 17:26:15 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:19.222 17:26:15 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:19.222 17:26:15 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:19.222 17:26:15 -- common/autotest_common.sh@10 -- # set +x 00:33:20.602 INFO: APP EXITING 00:33:20.602 INFO: killing all VMs 00:33:20.602 INFO: killing vhost app 00:33:20.602 INFO: EXIT DONE 00:33:21.540 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:21.798 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:21.798 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:21.798 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:21.798 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:21.798 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:21.798 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:21.798 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:21.798 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:21.798 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:21.798 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:21.798 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:21.798 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:21.798 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:21.798 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:21.798 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:21.798 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:23.177 Cleaning 00:33:23.177 Removing: /var/run/dpdk/spdk0/config 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:23.177 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:23.177 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:23.177 Removing: /var/run/dpdk/spdk1/config 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:23.177 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:23.177 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:23.177 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:23.177 Removing: /var/run/dpdk/spdk2/config 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:23.177 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:23.177 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:23.177 Removing: /var/run/dpdk/spdk3/config 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:23.177 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:23.177 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:23.177 Removing: /var/run/dpdk/spdk4/config 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:23.177 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:23.177 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:23.177 Removing: /dev/shm/bdev_svc_trace.1 00:33:23.177 Removing: /dev/shm/nvmf_trace.0 00:33:23.177 Removing: /dev/shm/spdk_tgt_trace.pid1616825 00:33:23.177 Removing: /var/run/dpdk/spdk0 00:33:23.177 Removing: /var/run/dpdk/spdk1 00:33:23.177 Removing: /var/run/dpdk/spdk2 00:33:23.177 Removing: /var/run/dpdk/spdk3 00:33:23.177 Removing: /var/run/dpdk/spdk4 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1615106 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1615872 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1616825 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1617327 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1618673 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1619621 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1619943 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1620153 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1620501 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1620828 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1620989 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1621145 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1621335 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1621926 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1624479 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1624656 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1624955 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1625095 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1625407 00:33:23.177 Removing: /var/run/dpdk/spdk_pid1625541 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1625946 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1625995 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1626294 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1626436 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1626602 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1626744 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627124 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627278 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627555 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627785 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627804 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1627992 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1628194 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1628400 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1628547 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1628820 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1628975 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1629420 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1629776 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630060 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630201 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630365 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630505 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630781 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1630928 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631086 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631232 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631508 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631649 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631810 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1631953 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1632235 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1632374 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1632531 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1632678 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1632952 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633104 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633259 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633402 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633682 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633824 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1633986 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1634128 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1634403 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1634554 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1634713 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1634877 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1635142 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1635284 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1635446 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1635707 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1635868 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1636018 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1636279 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1638369 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1695956 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1698629 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1705875 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1709231 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1711618 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1712150 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1716070 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1716073 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1716745 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1717319 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1717980 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1718389 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1718423 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1718773 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1718870 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1718916 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1719845 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1720648 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1721326 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1721742 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1721746 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1722011 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1723065 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1723926 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1729430 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1729718 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1732404 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1736300 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1738541 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1745175 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1750596 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1752049 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1753244 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1763888 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1766139 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1769095 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1770325 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1771566 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1771834 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1771992 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1772146 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1772737 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1774224 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1775119 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1775694 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1779192 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1782773 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1787035 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1810952 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1813981 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1818138 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1819239 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1820351 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1823060 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1825504 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1830003 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1830005 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1832948 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1833082 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1833228 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1833502 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1833507 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1834736 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1835958 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1837175 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1838386 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1839604 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1840819 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1844715 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1845176 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1846611 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1847869 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1851667 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1853729 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1857407 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1861084 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1864743 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1865168 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1865592 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1866012 00:33:23.435 Removing: /var/run/dpdk/spdk_pid1866610 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1867162 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1867710 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1868136 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1870928 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1871082 00:33:23.436 Removing: /var/run/dpdk/spdk_pid1874956 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1875144 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1876913 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1882693 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1882698 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1885767 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1887205 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1888647 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1889536 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1890858 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1891760 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1897292 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1897695 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1898097 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1899673 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1899982 00:33:23.692 Removing: /var/run/dpdk/spdk_pid1900400 00:33:23.692 Clean 00:33:23.692 killing process with pid 1586371 00:33:31.803 killing process with pid 1586368 00:33:32.062 killing process with pid 1586370 00:33:32.062 killing process with pid 1586369 00:33:32.062 17:26:28 -- common/autotest_common.sh@1446 -- # return 0 00:33:32.062 17:26:28 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:32.062 17:26:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:32.062 17:26:28 -- common/autotest_common.sh@10 -- # set +x 00:33:32.062 17:26:29 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:32.062 17:26:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:32.062 17:26:29 -- common/autotest_common.sh@10 -- # set +x 00:33:32.321 17:26:29 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:32.321 17:26:29 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:32.321 17:26:29 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:32.321 17:26:29 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:32.321 17:26:29 -- spdk/autotest.sh@383 -- # hostname 00:33:32.321 17:26:29 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:32.321 geninfo: WARNING: invalid characters removed from testname! 00:34:04.428 17:26:56 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:04.428 17:27:00 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:06.333 17:27:03 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:08.867 17:27:05 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:12.153 17:27:08 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:14.682 17:27:11 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:17.217 17:27:14 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:17.217 17:27:14 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:17.217 17:27:14 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:17.217 17:27:14 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:17.217 17:27:14 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:17.217 17:27:14 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:17.217 17:27:14 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:17.217 17:27:14 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:17.217 17:27:14 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:17.217 17:27:14 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:17.217 17:27:14 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:17.217 17:27:14 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:17.217 17:27:14 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:17.217 17:27:14 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:17.217 17:27:14 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:17.217 17:27:14 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:17.217 17:27:14 -- scripts/common.sh@343 -- $ case "$op" in 00:34:17.217 17:27:14 -- scripts/common.sh@344 -- $ : 1 00:34:17.217 17:27:14 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:17.217 17:27:14 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:17.217 17:27:14 -- scripts/common.sh@364 -- $ decimal 1 00:34:17.217 17:27:14 -- scripts/common.sh@352 -- $ local d=1 00:34:17.217 17:27:14 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:17.217 17:27:14 -- scripts/common.sh@354 -- $ echo 1 00:34:17.217 17:27:14 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:17.217 17:27:14 -- scripts/common.sh@365 -- $ decimal 2 00:34:17.217 17:27:14 -- scripts/common.sh@352 -- $ local d=2 00:34:17.217 17:27:14 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:17.217 17:27:14 -- scripts/common.sh@354 -- $ echo 2 00:34:17.217 17:27:14 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:17.217 17:27:14 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:17.217 17:27:14 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:17.217 17:27:14 -- scripts/common.sh@367 -- $ return 0 00:34:17.217 17:27:14 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:17.217 17:27:14 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:17.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.217 --rc genhtml_branch_coverage=1 00:34:17.217 --rc genhtml_function_coverage=1 00:34:17.217 --rc genhtml_legend=1 00:34:17.217 --rc geninfo_all_blocks=1 00:34:17.217 --rc geninfo_unexecuted_blocks=1 00:34:17.217 00:34:17.217 ' 00:34:17.217 17:27:14 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:17.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.217 --rc genhtml_branch_coverage=1 00:34:17.217 --rc genhtml_function_coverage=1 00:34:17.217 --rc genhtml_legend=1 00:34:17.217 --rc geninfo_all_blocks=1 00:34:17.217 --rc geninfo_unexecuted_blocks=1 00:34:17.217 00:34:17.217 ' 00:34:17.217 17:27:14 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:17.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.217 --rc genhtml_branch_coverage=1 00:34:17.217 --rc genhtml_function_coverage=1 00:34:17.217 --rc genhtml_legend=1 00:34:17.217 --rc geninfo_all_blocks=1 00:34:17.217 --rc geninfo_unexecuted_blocks=1 00:34:17.217 00:34:17.217 ' 00:34:17.217 17:27:14 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:17.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.217 --rc genhtml_branch_coverage=1 00:34:17.217 --rc genhtml_function_coverage=1 00:34:17.217 --rc genhtml_legend=1 00:34:17.217 --rc geninfo_all_blocks=1 00:34:17.217 --rc geninfo_unexecuted_blocks=1 00:34:17.217 00:34:17.217 ' 00:34:17.217 17:27:14 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:17.217 17:27:14 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:17.217 17:27:14 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:17.217 17:27:14 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:17.217 17:27:14 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.218 17:27:14 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.218 17:27:14 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.218 17:27:14 -- paths/export.sh@5 -- $ export PATH 00:34:17.218 17:27:14 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.218 17:27:14 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:17.218 17:27:14 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:17.218 17:27:14 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732724834.XXXXXX 00:34:17.218 17:27:14 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732724834.9KVOTi 00:34:17.218 17:27:14 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:17.218 17:27:14 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:34:17.218 17:27:14 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:17.218 17:27:14 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:17.218 17:27:14 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:17.218 17:27:14 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:17.218 17:27:14 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:17.218 17:27:14 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:17.218 17:27:14 -- common/autotest_common.sh@10 -- $ set +x 00:34:17.218 17:27:14 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:17.218 17:27:14 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:17.218 17:27:14 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:17.218 17:27:14 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:17.218 17:27:14 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:17.218 17:27:14 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:17.218 17:27:14 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:17.218 17:27:14 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:17.218 17:27:14 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:17.218 17:27:14 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:17.477 17:27:14 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:17.477 + [[ -n 1532205 ]] 00:34:17.477 + sudo kill 1532205 00:34:17.486 [Pipeline] } 00:34:17.501 [Pipeline] // stage 00:34:17.506 [Pipeline] } 00:34:17.519 [Pipeline] // timeout 00:34:17.524 [Pipeline] } 00:34:17.537 [Pipeline] // catchError 00:34:17.542 [Pipeline] } 00:34:17.557 [Pipeline] // wrap 00:34:17.563 [Pipeline] } 00:34:17.577 [Pipeline] // catchError 00:34:17.586 [Pipeline] stage 00:34:17.588 [Pipeline] { (Epilogue) 00:34:17.601 [Pipeline] catchError 00:34:17.603 [Pipeline] { 00:34:17.616 [Pipeline] echo 00:34:17.617 Cleanup processes 00:34:17.623 [Pipeline] sh 00:34:17.905 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:17.905 1913326 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:17.918 [Pipeline] sh 00:34:18.201 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:18.201 ++ awk '{print $1}' 00:34:18.201 ++ grep -v 'sudo pgrep' 00:34:18.201 + sudo kill -9 00:34:18.201 + true 00:34:18.212 [Pipeline] sh 00:34:18.495 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:28.613 [Pipeline] sh 00:34:28.898 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:28.898 Artifacts sizes are good 00:34:28.913 [Pipeline] archiveArtifacts 00:34:28.921 Archiving artifacts 00:34:29.065 [Pipeline] sh 00:34:29.348 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:29.364 [Pipeline] cleanWs 00:34:29.375 [WS-CLEANUP] Deleting project workspace... 00:34:29.375 [WS-CLEANUP] Deferred wipeout is used... 00:34:29.382 [WS-CLEANUP] done 00:34:29.384 [Pipeline] } 00:34:29.401 [Pipeline] // catchError 00:34:29.414 [Pipeline] sh 00:34:29.694 + logger -p user.info -t JENKINS-CI 00:34:29.703 [Pipeline] } 00:34:29.718 [Pipeline] // stage 00:34:29.724 [Pipeline] } 00:34:29.739 [Pipeline] // node 00:34:29.745 [Pipeline] End of Pipeline 00:34:29.788 Finished: SUCCESS